Expand description
This module contains clients for the different LLM providers that Rig supports.
Currently, the following providers are supported:
- Cohere
- OpenAI
- Perplexity
- Anthropic
- Google Gemini
- xAI
- EternalAI
- DeepSeek
- Azure OpenAI
- Mira
Each provider has its own module, which contains a Client
implementation that can
be used to initialize completion and embedding models and execute requests to those models.
The clients also contain methods to easily create higher level AI constructs such as agents and RAG systems, reducing the need for boilerplate.
§Example
use rig::{providers::openai, agent::AgentBuilder};
// Initialize the OpenAI client
let openai = openai::Client::new("your-openai-api-key");
// Create a model and initialize an agent
let gpt_4o = openai.completion_model("gpt-4o");
let agent = AgentBuilder::new(gpt_4o)
.preamble("\
You are Gandalf the white and you will be conversing with other \
powerful beings to discuss the fate of Middle Earth.\
")
.build();
// Alternatively, you can initialize an agent directly
let agent = openai.agent("gpt-4o")
.preamble("\
You are Gandalf the white and you will be conversing with other \
powerful beings to discuss the fate of Middle Earth.\
")
.build();
Note: The example above uses the OpenAI provider client, but the same pattern can be used with the Cohere provider client.
Modules§
- anthropic
- Anthropic API client and Rig integration
- azure
- Azure OpenAI API client and Rig integration
- cohere
- Cohere API client and Rig integration
- deepseek
- DeepSeek API client and Rig integration
- galadriel
- Galadriel API client and Rig integration
- gemini
- Google Gemini API client and Rig integration
- groq
- Groq API client and Rig integration
- huggingface
- Create a new completion model with the given name
- hyperbolic
- Hyperbolic Inference API client and Rig integration
- mira
- Mira API client and Rig integration
- mistral
- moonshot
- Moonshot API client and Rig integration
- ollama
- Ollama API client and Rig integration
- openai
- OpenAI API client and Rig integration
- openrouter
- OpenRouter Inference API client and Rig integration
- perplexity
- Perplexity API client and Rig integration
- together
- Together AI API client and Rig integration
- voyageai
- xai
- xAi API client and Rig integration