Models and providers

AgentRow calls models through provider configurations set up per organisation under settings. Supported providers: OpenRouter, OpenAI, Anthropic, vLLM (self-hosted OpenAI-compatible servers) and Ollama. Each provider configuration carries its own API key or endpoint.

Per agent, and per LLM node in a workflow, you choose:

• Provider and model from the organisation catalog. A workflow node can use a different model than the agent default.
• Temperature (0 to 2) and max output tokens.
• Context limits: model context limit, max input tokens and a safety margin. The runtime trims history and knowledge to fit the budget and reports what it trimmed.
• Streaming: answers stream token by token to the chat and the widget.
• Response format: free text or JSON.
• Tool choice: let the model decide, force a tool, or disable tools for that call.
• Cost limit per run, fallback models if the primary fails, and stop sequences.
• Prompt versions and labels so a node can pin a specific version of a prompt.

Embeddings for knowledge bases, memory and tool selection use embedding provider configurations (managed Ollama embedding models are supported), chosen when you create a knowledge base index or in the node settings.