How to use LiteLLMClient with httpx.Client

[satyaloka93]

I simply would like clarification how to use the LiteLLMClient to incorporate httpx.Client settings (proxy, ssl settings), which is touched on in litellm documentation here. I checked the models documentation for litellm and google-adk, but could not see any reference to that setting, and I tried setting http_client=httpx_client, as well as trying litellm.client_session = httpx.Client(), but nothing worked. Would appreciate any pointers for implementing this.

[hangfei]

@selcukgun or @polong-lin to help take a look

[hsuyuming]

I think you can pass it as kwargs

LiteLlm(
  model=MODEL_GEMINI_2_0_FLASH,
  ssl_verify=True
)

[satyaloka93]

My key stumbling block, I discovered, was using httpx.Client, versus 'AyncClient'. So this actually works to set it globally:

litellm.aclient_session = httpx.AsyncClient(verify=False,proxy=proxy_url)

[boyangsvl]

Closing the issue since there's a working solution.