​
Authentication

This provider requires authentication.

  • api_url: LiteLLM API endpoint URL (required: True, sensitive: False)
  • api_key: Optional API key if your LiteLLM deployment requires authentication (required: False, sensitive: True)

​
In workflows

This provider can be used in workflows.

As “step” to query data, example:

steps:
    - name: Query litellm
      provider: litellm
      config: "{{ provider.my_provider_name }}"
      with:
        prompt: {value}  
        temperature: {value}  
        model: {value}  
        max_tokens: {value}  
        structured_output_format: {value}

Check the following workflow example: