> ## Documentation Index
> Fetch the complete documentation index at: https://docs.keephq.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# vLLM Provider

> The vLLM Provider enables integration with vLLM-deployed language models into Keep.

<Tip>
  The vLLM Provider supports querying language models deployed with vLLM for prompt-based interactions.
</Tip>

## Authentication

This provider requires authentication.

* **api\_url**: vLLM API endpoint URL (required: True, sensitive: False)
* **api\_key**: Optional API key if your vLLM deployment requires authentication (required: False, sensitive: True)

## In workflows

This provider can be used in workflows.

As "step" to query data, example:

```yaml theme={null}
steps:
    - name: Query vllm
      provider: vllm
      config: "{{ provider.my_provider_name }}"
      with:
        prompt: {value}  
        temperature: {value}  
        model: {value}  
        max_tokens: {value}  
        structured_output_format: {value}  
```

Check the following workflow example:

* [enrich\_using\_structured\_output\_from\_vllm\_qwen.yaml](https://github.com/keephq/keep/blob/main/examples/workflows/enrich_using_structured_output_from_vllm_qwen.yaml)

## Connecting with the Provider

To connect to a vLLM deployment:

1. Deploy your vLLM instance or obtain the API endpoint of an existing deployment
2. Configure the API URL in your provider configuration
3. If your deployment requires authentication, configure the API key