[Python] Call LiteLLM proxy with LiteLLM SDK and client side credentials (Bedrock IAM + OpenAI)

Discussão em 'Python' iniciado por Stack, Junho 6, 2025.

  1. Stack

    Stack Membro Participativo

    Is it possible to call a LiteLLM proxy that does not have configured model credentials with the LiteLLM Python SDK using client side credentials? Interested in doing this for bedrock with client side IAM instance role as well as OpenAI with explicit API key passed in client side. The examples in the docs https://docs.litellm.ai/docs/proxy/clientside_auth reference extra_body param for the OpenAI client but that's not something I see supported in litellm's completion.

    Continue reading...

Compartilhe esta Página