Skip to main content
The SDK auto-instruments these LLM providers with zero additional code:
  • OpenAI
  • Anthropic
  • Cohere
  • Azure OpenAI
  • Amazon Bedrock
  • Google Vertex AI
  • Replicate
  • HuggingFace
Local models via Ollama and hosted OpenAI-compatible endpoints (Together, Fireworks, Groq, OpenRouter, self-hosted vLLM) work through the OpenAI SDK — see Hosted Inference.