AI
Litellm
Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, Groq (100+ LLMs)
At a glance
- Category
- AI
- Web addresses
- 1
- Main port
- 4000
Tags
- ai
- qdrant
- weaviate
- langchain
- openai
- gpt
- llm
- lmops
- anthropic
- cohere
- ollama
- sagemaker
Before you launch it
Nothing unusual: it runs in its own containers behind the proxy, with HTTPS on its web address.
More in AI
See all
Langfuse
AI
Langfuse is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.
Librechat
AI
Self-hosted, powerful, and privacy-focused chat UI for multiple AI models
Flowise
AI
Flowise is an open source low-code tool for developers to build customized LLM orchestration flows & AI agents.
Flowise with Databases
AI
Flowise is an open source low-code tool for developers to build customized LLM orchestration flows & AI agents. Also deploys Redis, Postgres and other services.
Hermes Agent
AI
Hermes Agent - autonomous AI agent with persistent memory, scheduling, and built-in web dashboard.
Hermes Agent with Webui
AI
Hermes Agent - autonomous AI agent with persistent memory, scheduling, and a self-hosted web chat UI.
Run Litellm on your own server
Free while in beta. Bring your own keys; you pay your providers directly.