LiteLLM Provider

​

Authentication

This provider requires authentication.

• api_url: LiteLLM API endpoint URL (required: True, sensitive: False)
• api_key: Optional API key if your LiteLLM deployment requires authentication (required: False, sensitive: True)

​

In workflows

This provider can be used in workflows.

As “step” to query data, example:

steps:
    - name: Query litellm
      provider: litellm
      config: "{{ provider.my_provider_name }}"
      with:
        prompt: {value}  
        temperature: {value}  
        model: {value}  
        max_tokens: {value}  
        structured_output_format: {value}  

Check the following workflow example:

• enrich_using_structured_output_from_openai.yaml