> ## Documentation Index
> Fetch the complete documentation index at: https://docs.superagentx.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# LLMClient

### LLM Client object configuration

The `LLMClient` object from `superagentx.llm` is a configuration-driven interface to interact with large language models (LLMs) from various
providers, such as OpenAI, AWSBedrock and more. It allows users to set parameters specific to the model and
provider they intend to use, making it easier to configure different types of LLMs and interact with it.

### Supported LLMs

|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               Icon                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | LLM Name          |
| :----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :---------------- |
|                                <a href="#deepseek"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/deepseek.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=dcfeb6a017df30ad74e4cd1dcecf4109" title="deepseek" height="25" width="25" style={{ margin: 0, width: 25}} data-path="images/llms/deepseek.png" /></a>                                | **DeepSeek**      |
|                                          <a href="#openai"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/openai.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=ca645ba40b8df2c7cc5956d5b77a65ff" title="OpenAI" height="25" width="25" style={{ margin: 0, width: 25 }} data-path="images/llms/openai.png" /></a>                                         | **OpenAI**        |
|                    <a href="#azure openai"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/azure-icon.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=cdd216a4a76d321d0012cb626f5d0d54" title="Azure OpenAI" height="25" width="25" style={{ margin: 0, width: 25 }} data-path="images/llms/azure-icon.png" /></a>                   | **Azure OpenAI**  |
|                     <a href="#aws bedrock"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/awsbedrock.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=1340774356a317413d2e3019ef102a32" title="AWS Bedrock" height="25" width="25" style={{ margin: 0, width: 25 }} data-path="images/llms/awsbedrock.png" /></a>                    | **AWS Bedrock**   |
|                                   <a href="#google gemini"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/gemini.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=5e698845de8432997955450c6866d29e" title="Google Gemini" height="25" width="25" style={{ margin: 0, width: 25 }} data-path="images/llms/gemini.png" /></a>                                  | **Google Gemini** |
|                                             <a href="#meta llama"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/meta.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=5ff0d3de8b33289558642e86617ed266" title="Meta LLama" height="25" width="25" style={{ margin: 0, width: 25 }} data-path="images/llms/meta.png" /></a>                                            | **Meta Llama**    |
|                                          <a href="#ollama"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/ollama.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=64af523747daf5c640540d1af67ee40f" title="Ollama" height="15" width="25" style={{ margin: 0, width: 25 }} data-path="images/llms/ollama.png" /></a>                                         | **Ollama**        |
|      <a href="#claude ai"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/claude-ai-logo.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=8ca307f37e891b2883e4a7a71aad4f66" title="Claude AI" height="25" width="25" style={{ margin: 0, width: 25 }} data-path="images/llms/claude-ai-logo.png" /></a>     | **Claude AI**     |
| <a href="#mistral ai"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/mistral-ai-logo.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=bfb46413a8d4276c7cb6b1039e2dad68" title="Mistral AI" height="25" width="35" style={{ margin: 0, width: 25 }} data-path="images/llms/mistral-ai-logo.png" /></a> | **Mistral AI**    |
|                                             <a href="#ibm watson ai"><img src="https://mintcdn.com/superagentx/2i9VWqt1zKxPBKhG/images/llms/ibm.png?fit=max&auto=format&n=2i9VWqt1zKxPBKhG&q=85&s=a5dbfa7b056df009b5fa328f4832f6fa" title="IBM WatsonX AI" height="25" width="35" style={{ margin: 0, width: 25 }} data-path="images/llms/ibm.png" /></a>                                             | **IBM WatsonX**   |
|                                <a href="#lite llm"><img src="https://mintcdn.com/superagentx/rFS_ViAjGgBvNdxZ/images/llms/lite-llm.png?fit=max&auto=format&n=rFS_ViAjGgBvNdxZ&q=85&s=8f6fcfc75d72c0d40f90a63d1383b295" title="Lite LLM" height="25" width="35" style={{ margin: 0, width: 25 }} data-path="images/llms/lite-llm.png" /></a>                               | **Lite LLM**      |

### Parameters

| Attribute                        | Parameters    | Type   | Description                                                                                                                                                                                                               |
| :------------------------------- | :------------ | :----- | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| **LLM Type**                     | `llm_type`    | `str`  | This key identifies the service provider or platform from which the language model is sourced. Common values are: ‘openai’: Refers to OpenAI’s GPT models.                                                                |
| **Model** *(optional)*           | `model`       | `str`  | This specifies the language model you wish to use. The model is typically identified by a name or version, such as ‘gpt-4o’, ‘gpt-3.5-turbo’, or another model version that the service provider supports. Default `None` |
| **API Key**  *(optional)*        | `api_key`     | `str`  | You can provide the model API key either as a parameter or retrieve it from the environment. Default `None`                                                                                                               |
| **Base Url** *(optional)*        | `base_url`    | `str`  | The base URL for the model API. Default `None`                                                                                                                                                                            |
| **API Version** *(optional)*     | `api_version` | `str`  | The required API version for the Azure OpenAI llm\_type. Default `None`                                                                                                                                                   |
| **Async Mode**  *(optional)*     | `async_mode`  | `bool` | Asynchronous mode of OpenAI or Azure OpenAI client. Default `None`                                                                                                                                                        |
| **Embedding Model** *(optional)* | `embed_model` | `str`  | Embedding model name, supported models openai, azure-openai, mistral, llama 3.1. Default `None`                                                                                                                           |

<span id="deepseek" />

```python DeepSeek theme={null}
from superagentx.llm import LLMClient

llm_config = {
    'model': "deepseek-chat",
    'llm_type': 'deepseek',
    'base_url': 'https://api.deepseek.com/'
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
```

<span id="openai" />

```python OpenAI theme={null}
from superagentx.llm import LLMClient

llm_config = {
    "model":'gpt-4o',
    "llm_type":'openai'
}
llm_client = LLMClient(llm_config=llm_config)
```

<span id="aws bedrock" />

```python AWSBedrock theme={null}
from superagentx.llm import LLMClient

llm_config = {
    "model":'anthropic.claude-3-5-sonnet-20241022-v2:0',
    "llm_type":'bedrock'
}
llm_client = LLMClient(llm_config=llm_config)
```

<span id="ollama" />

```python ollama theme={null}
from superagentx.llm import LLMClient

llm_config = {
    'model': 'mistral',
    'llm_type': 'ollama',
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
```

<span id="claude ai" />

```python Claude AI theme={null}
from superagentx.llm import LLMClient

llm_config = {
    'model': 'claude-3-7-sonnet-20250219',
    'llm_type': 'anthropic'
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
```

<span id="lite llm" />

```python Lite LLM theme={null}
from superagentx.llm import LLMClient

llm_config = {
    'model': 'openai/gpt-5-mini',
    'llm_type': 'lite_llm'
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
```

<span id="lite llm" />

```python Lite LLM theme={null}
from superagentx.llm import LLMClient

llm_config = {
    'model': 'anthropic/claude-sonnet-4-5-20250929',
    'llm_type': 'lite_llm'
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
```

### LLM Type and its Values

| Type             | value          | Example                                     |
| :--------------- | :------------- | :------------------------------------------ |
| **DeepSeek**     | `deepseek`     | `llm_config = { 'llm_type':'deepseek'}`     |
| **Open AI**      | `openai`       | `llm_config = { 'llm_type':'openai'}`       |
| **Azure OpenAI** | `azure-openai` | `llm_config = { 'llm_type':'azure-openai'}` |
| **AWS Bedrock**  | `bedrock`      | `llm_config = { 'llm_type':'bedrock'}`      |
| **Ollama**       | `ollama`       | `llm_config = { 'llm_type':'ollama'}`       |
| **LLama**        | `llama`        | `llm_config = { 'llm_type':'llama'}`        |
| **Gemini**       | `gemini`       | `llm_config = { 'llm_type':'gemini'}`       |
| **Anthropic**    | `anthropic`    | `llm_config = { 'llm_type':'anthropic'}`    |
| **Mistral**      | `mistral`      | `Coming Soon`                               |
| **Groq**         | `groq`         | `Coming Soon`                               |
| **Together**     | `together`     | `Coming Soon`                               |

### OpenAI Supported Models

| Type                       | Example                                                                 |
| :------------------------- | :---------------------------------------------------------------------- |
| **gpt-4o**                 | `llm_config = { "model":'gpt-4o', "llm_type":'openai'}`                 |
| **gpt-4.1**                | `llm_config = { "model":'gpt-4.1', "llm_type":'openai'}`                |
| **gpt-4**                  | `llm_config = { "model":'gpt-4', "llm_type":'openai'}`                  |
| **gpt-4o-2024-05-13**      | `llm_config = { "model":'gpt-4o-2024-05-13', "llm_type":'openai'}`      |
| **gpt-4o-2024-08-06**      | `llm_config = { "model":'gpt-4o-2024-08-06', "llm_type":'openai'}`      |
| **gpt-4-turbo-2024-04-09** | `llm_config = { "model":'gpt-4-turbo-2024-04-09', "llm_type":'openai'}` |
| **gpt-4o-mini-2024-07-18** | `llm_config = { "model":'gpt-4o-mini-2024-07-18', "llm_type":'openai'}` |
| **gpt-4o-mini**            | `llm_config = { "model":'gpt-4o-mini', "llm_type":'openai'}`            |

### Bedrock Supported Models

| Type                                          | Example                                                                                     |
| :-------------------------------------------- | :------------------------------------------------------------------------------------------ |
| **anthropic.claude-3-5-sonnet-20241022-v2:0** | `llm_config = { "model":'anthropic.claude-3-5-sonnet-20241022-v2:0', "llm_type":'bedrock'}` |
| **anthropic.claude-3-5-haiku-20241022-v1:0**  | `llm_config = { "model":'anthropic.claude-3-5-haiku-20241022-v1:0', "llm_type":'bedrock'}`  |
| **anthropic.claude-instant-v1:2:100k**        | `llm_config = {"model":'anthropic.claude-instant-v1:2:100k',"llm_type":'bedrock'}`          |
| **anthropic.claude-3-sonnet-20240229-v1:0**   | `llm_config = {"model":'anthropic.claude-3-sonnet-20240229-v1:0',"llm_type":'bedrock'}`     |
| **anthropic.claude-3-haiku-20240307-v1:0**    | `llm_config = {"model":'anthropic.claude-3-haiku-20240307-v1:0',"llm_type":'bedrock'}`      |
| **anthropic.claude-3-opus-20240229-v1:0**     | `llm_config = {"model":'anthropic.claude-3-opus-20240229-v1:0',"llm_type":'bedrock'}`       |
| **anthropic.claude-3-5-sonnet-20240620-v1:0** | `llm_config = {"model":'anthropic.claude-3-5-sonnet-20240620-v1:0',"llm_type":'bedrock'}`   |
| **cohere.command-r-v1:0**                     | `llm_config = {"model":'cohere.command-r-v1:0',"llm_type":'bedrock'}`                       |
| **cohere.command-r-plus-v1:0**                | `llm_config = {"model":'cohere.command-r-plus-v1:0',"llm_type":'bedrock'}`                  |
| **meta.llama3-1-8b-instruct-v1:0**            | `llm_config = {"model":'meta.llama3-1-8b-instruct-v1:0',"llm_type":'bedrock'}`              |
| **meta.llama3-1-70b-instruct-v1:0**           | `llm_config = {"model":'meta.llama3-1-70b-instruct-v1:0',"llm_type":'bedrock'}`             |
| **meta.llama3-1-405b-instruct-v1:0**          | `llm_config = {"model":'meta.llama3-1-405b-instruct-v1:0',"llm_type":'bedrock'}`            |
| **mistral.mistral-large-2402-v1:0**           | `llm_config = {"model":'mistral.mistral-large-2402-v1:0',"llm_type":'bedrock'}`             |
| **mistral.mistral-large-2407-v1:0**           | `llm_config = {"model":'mistral.mistral-large-2407-v1:0',"llm_type":'bedrock'}`             |

### Ollama Supported Models:

| Type                | Example                                                        |
| :------------------ | :------------------------------------------------------------- |
| **mistral:latest**  | `llm_config = {"model":'mistral:latest',"llm_type":'ollama'}`  |
| **llama3.3:latest** | `llm_config = {"model":'llama3.3:latest',"llm_type":'ollama'}` |