LLM Client object configuration
TheLLMClient object from superagentx.llm is a configuration-driven interface to interact with large language models (LLMs) from various
providers, such as OpenAI, AWSBedrock and more. It allows users to set parameters specific to the model and
provider they intend to use, making it easier to configure different types of LLMs and interact with it.
Supported LLMs
| Icon | LLM Name |
|---|---|
 | DeepSeek |
 | OpenAI |
 | Azure OpenAI |
 | AWS Bedrock |
 | Google Gemini |
 | Meta Llama |
 | Ollama |
 | Claude AI |
 | Mistral AI |
 | IBM WatsonX |
 | Lite LLM |
Parameters
| Attribute | Parameters | Type | Description |
|---|---|---|---|
| LLM Type | llm_type | str | This key identifies the service provider or platform from which the language model is sourced. Common values are: ‘openai’: Refers to OpenAI’s GPT models. |
| Model (optional) | model | str | This specifies the language model you wish to use. The model is typically identified by a name or version, such as ‘gpt-4o’, ‘gpt-3.5-turbo’, or another model version that the service provider supports. Default None |
| API Key (optional) | api_key | str | You can provide the model API key either as a parameter or retrieve it from the environment. Default None |
| Base Url (optional) | base_url | str | The base URL for the model API. Default None |
| API Version (optional) | api_version | str | The required API version for the Azure OpenAI llm_type. Default None |
| Async Mode (optional) | async_mode | bool | Asynchronous mode of OpenAI or Azure OpenAI client. Default None |
| Embedding Model (optional) | embed_model | str | Embedding model name, supported models openai, azure-openai, mistral, llama 3.1. Default None |
DeepSeek
from superagentx.llm import LLMClient
llm_config = {
'model': "deepseek-chat",
'llm_type': 'deepseek',
'base_url': 'https://api.deepseek.com/'
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
OpenAI
from superagentx.llm import LLMClient
llm_config = {
"model":'gpt-4o',
"llm_type":'openai'
}
llm_client = LLMClient(llm_config=llm_config)
AWSBedrock
from superagentx.llm import LLMClient
llm_config = {
"model":'anthropic.claude-3-5-sonnet-20241022-v2:0',
"llm_type":'bedrock'
}
llm_client = LLMClient(llm_config=llm_config)
ollama
from superagentx.llm import LLMClient
llm_config = {
'model': 'mistral',
'llm_type': 'ollama',
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
Claude AI
from superagentx.llm import LLMClient
llm_config = {
'model': 'claude-3-7-sonnet-20250219',
'llm_type': 'anthropic'
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
Lite LLM
from superagentx.llm import LLMClient
llm_config = {
'model': 'openai/gpt-5-mini',
'llm_type': 'lite_llm'
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
Lite LLM
from superagentx.llm import LLMClient
llm_config = {
'model': 'anthropic/claude-sonnet-4-5-20250929',
'llm_type': 'lite_llm'
}
llm_client: LLMClient = LLMClient(llm_config=llm_config)
LLM Type and its Values
| Type | value | Example |
|---|---|---|
| DeepSeek | deepseek | llm_config = { 'llm_type':'deepseek'} |
| Open AI | openai | llm_config = { 'llm_type':'openai'} |
| Azure OpenAI | azure-openai | llm_config = { 'llm_type':'azure-openai'} |
| AWS Bedrock | bedrock | llm_config = { 'llm_type':'bedrock'} |
| Ollama | ollama | llm_config = { 'llm_type':'ollama'} |
| LLama | llama | llm_config = { 'llm_type':'llama'} |
| Gemini | gemini | llm_config = { 'llm_type':'gemini'} |
| Anthropic | anthropic | llm_config = { 'llm_type':'anthropic'} |
| Mistral | mistral | Coming Soon |
| Groq | groq | Coming Soon |
| Together | together | Coming Soon |
OpenAI Supported Models
| Type | Example |
|---|---|
| gpt-4o | llm_config = { "model":'gpt-4o', "llm_type":'openai'} |
| gpt-4.1 | llm_config = { "model":'gpt-4.1', "llm_type":'openai'} |
| gpt-4 | llm_config = { "model":'gpt-4', "llm_type":'openai'} |
| gpt-4o-2024-05-13 | llm_config = { "model":'gpt-4o-2024-05-13', "llm_type":'openai'} |
| gpt-4o-2024-08-06 | llm_config = { "model":'gpt-4o-2024-08-06', "llm_type":'openai'} |
| gpt-4-turbo-2024-04-09 | llm_config = { "model":'gpt-4-turbo-2024-04-09', "llm_type":'openai'} |
| gpt-4o-mini-2024-07-18 | llm_config = { "model":'gpt-4o-mini-2024-07-18', "llm_type":'openai'} |
| gpt-4o-mini | llm_config = { "model":'gpt-4o-mini', "llm_type":'openai'} |
Bedrock Supported Models
| Type | Example |
|---|---|
| anthropic.claude-3-5-sonnet-20241022-v2:0 | llm_config = { "model":'anthropic.claude-3-5-sonnet-20241022-v2:0', "llm_type":'bedrock'} |
| anthropic.claude-3-5-haiku-20241022-v1:0 | llm_config = { "model":'anthropic.claude-3-5-haiku-20241022-v1:0', "llm_type":'bedrock'} |
| anthropic.claude-instant-v1:2:100k | llm_config = {"model":'anthropic.claude-instant-v1:2:100k',"llm_type":'bedrock'} |
| anthropic.claude-3-sonnet-20240229-v1:0 | llm_config = {"model":'anthropic.claude-3-sonnet-20240229-v1:0',"llm_type":'bedrock'} |
| anthropic.claude-3-haiku-20240307-v1:0 | llm_config = {"model":'anthropic.claude-3-haiku-20240307-v1:0',"llm_type":'bedrock'} |
| anthropic.claude-3-opus-20240229-v1:0 | llm_config = {"model":'anthropic.claude-3-opus-20240229-v1:0',"llm_type":'bedrock'} |
| anthropic.claude-3-5-sonnet-20240620-v1:0 | llm_config = {"model":'anthropic.claude-3-5-sonnet-20240620-v1:0',"llm_type":'bedrock'} |
| cohere.command-r-v1:0 | llm_config = {"model":'cohere.command-r-v1:0',"llm_type":'bedrock'} |
| cohere.command-r-plus-v1:0 | llm_config = {"model":'cohere.command-r-plus-v1:0',"llm_type":'bedrock'} |
| meta.llama3-1-8b-instruct-v1:0 | llm_config = {"model":'meta.llama3-1-8b-instruct-v1:0',"llm_type":'bedrock'} |
| meta.llama3-1-70b-instruct-v1:0 | llm_config = {"model":'meta.llama3-1-70b-instruct-v1:0',"llm_type":'bedrock'} |
| meta.llama3-1-405b-instruct-v1:0 | llm_config = {"model":'meta.llama3-1-405b-instruct-v1:0',"llm_type":'bedrock'} |
| mistral.mistral-large-2402-v1:0 | llm_config = {"model":'mistral.mistral-large-2402-v1:0',"llm_type":'bedrock'} |
| mistral.mistral-large-2407-v1:0 | llm_config = {"model":'mistral.mistral-large-2407-v1:0',"llm_type":'bedrock'} |
Ollama Supported Models:
| Type | Example |
|---|---|
| mistral:latest | llm_config = {"model":'mistral:latest',"llm_type":'ollama'} |
| llama3.3:latest | llm_config = {"model":'llama3.3:latest',"llm_type":'ollama'} |