openai

OpenAIInference - OpenAI openai SDK (Chat Completions).

Requires the openai package. Authenticates from OPENAI_API_KEY. base_url can be set to point at a compatible endpoint (e.g. a local vLLM or Together AI proxy).