Invention:
This technology is a unified LLM-as-a-platform service (LLMPaaS) designed to facilitate seamless integration of commercial, cloud-hosted, and on-premise open LLMs in academic settings. AI-VERDE streamlines access management for instructional and research groups by providing features such as robust access control, privacy-preserving mechanisms, native Retrieval-Augmented Generation (RAG) support, budget management for third-party LLM services, and both a conversational web interface and API access.
Background:
The majority of LLM access today is either individual or enterprise-oriented, neither of which fits shared, multi-tenant academic use. However, academic environments must allow many users, such as students, faculty, and labs, access to LLMs while enforcing privacy, fairness, budgeting, and institutional policy. AI-VERDE addresses this by acting as an institution-level LLM-as-a-platform service, combining multi-model access, multi-tenant governance, budgeting, privacy controls, and research-friendly workflows into a single system designed explicitly for academia.
Applications:
- LLM-as-a-platform service (LLMPaaS)
- Large language models
- LLMs in academia
Advantages:
- Unified access to multiple LLMs
- Research-friendly workflows
- Use in academic and research settings
- Conversational web interface
- API access
