3.1 Provider Configuration

Provider Configurations define the connections to external AI services that power the Agent Systems. They specify which Large Language Model (LLM) provider to use and include the necessary credentials and settings for authentication.

Supported providers include services like OpenAI, Azure OpenAI, and other LLM platforms. Each configuration stores the provider type and a connection JSON containing API keys, endpoints, and model parameters. Multiple configurations can be created to use different providers or models for different Agents.

Supported providers include OpenAI, Azure OpenAI, Anthropic, Google (Vertex AI / Generative AI), AWS Bedrock, Cohere, NVIDIA AI Endpoints, Fireworks, Groq, Mistral, Together AI, Ollama, vLLM, Watsonx, xAI, Cerebras, and others. Each configuration stores the provider type and a connection JSON containing API keys, endpoints, and model parameters. Multiple configurations can be created to use different providers or models for different Agents.

While all listed providers can be used, the best choice depends on your use case—primarily the required intelligence/quality, latency/cost, and context window (how much information the model can process at once). In practice, teams often combine providers: e.g., a high-accuracy model for complex reasoning and a faster/cheaper model for lightweight steps, extraction, or routing.

Models with strong support (recommended)

Provider	Model family / examples	Support level	Notes
OpenAI	GPT-5.x	Good+	Recommended for highest quality and agentic workflows.
OpenAI	GPT-4.x	Good+	Strong general-purpose option.
Azure OpenAI	GPT-5.x deployments	Good+	Same model family as OpenAI, hosted in Azure; depends on your Azure deployment settings.
Azure OpenAI	GPT-4.x deployments	Good+	Stable enterprise choice; deployment-specific configuration.
Anthropic	Claude 4.5	Good+	Strong reasoning + long-context use cases.
xAI	Grok 4.x+	Good	Works well for many tasks; choose higher versions for better reasoning.
Google	Gemini 3.x+	Good	Good for multimodal and long-context scenarios depending on the chosen tier.
Meta / OSS (via Ollama, vLLM, Together, etc.)	Llama 4 (instruct variants)	OK+	Good for cost control / self-hosting; quality depends on the specific variant and serving setup.
Alibaba / OSS (via vLLM, Together, etc.)	Qwen 32B	OK+	Solid open model; good balance for many enterprise tasks.

Notes

• "Good+" means we recommend it broadly for production Agent Systems and knowledge-graph-grounded workflows.
• "OK+" means it's supported and can work well, but results vary more by model variant, prompting, and infrastructure (especially for self-hosted / open models).
• Additional models and providers can be added via Provider Configuration as long as the provider endpoint and authentication method are supported.

Create a Provider Configuration

1. Click the + Add new button to open a new Provider Configuration.

   

2. Click in the title field and add a title for the Provider Configuration.

   

3. Open the dropdown and select a provider from the list.

   

4. Enter the correct connection JSON to connect to the provider.

   

5. After entering the connection string, click Save to save the new Provider Configuration.

   

Edit a Provider Configuration

1. Navigate to the Provider Configuration section from the sidebar.

   

2. Click the Provider Configuration to edit.

   

3. Select Duplicate configuration to duplicate the Provider Configuration.

   

4. Click in the title field to edit the title, or click in the description field to edit the description.

   

5. To change the provider, select another provider from the dropdown.

   

6. Update the connection string to match the newly selected provider.

   

7. Confirm the changes by clicking Save.

   

Delete a Provider Configuration

1. Navigate to the Provider Configuration section from the sidebar.

   

2. Select the Provider Configuration to delete.

   

3. Click Delete configuration in the opened Provider Configuration.

   

4. Confirm the deletion.

   

5. Alternatively, select the checkbox for the Provider Configuration to delete.

   

6. Click the delete action.

   

7. Confirm the deletion.