Litellm

LiteLLM offers a unified OpenAI-compatible API gateway and Python SDK to access and manage over 100 large language models from multiple providers.