Supported LLM Models

This page details how to find the supported Large Language Models (LLMs) and recommendations for each agent type for optimal performance.

Supported Models

The full list of supported LLM models can be retrieved from GET /v1/agents/supported-models which gets the list from ML Platform and filters the list for Agent Builder compatibility.

Recommendations by Agent Type

RAG Agent

Recommended Models

We recommend using:

• Amazon Nova Micro - Best balance of performance and cost
• Amazon Nova Lite - When higher accuracy is needed

tip

Nova Micro is particularly efficient for RAG operations due to its optimized context processing capabilities.

Tool Agent

Recommended Models

We recommend using:

• Claude 3 Haiku - For most tool operations
• Claude 3.5 Haiku/Sonnet - For complex reasoning tasks

tip

Claude models excel at understanding and executing tool operations due to their strong reasoning capabilities.

Performance Considerations

• RAG Agents: Nova models are optimized for retrieval tasks and provide better performance/cost ratio
• Tool Agents: Claude models provide better reasoning capabilities for tool operations

Cost Considerations

Models are listed from most cost-effective to most expensive:

1. Amazon Nova Micro
2. Amazon Nova Lite
3. Amazon Nova
4. Claude 3 Haiku
5. Claude 3.5 Haiku
6. Claude 3.5 Sonnet

Choose models based on your specific needs and budget constraints.