Skip to main content

Supported LLM Models

This page details how to find the supported Large Language Models (LLMs) and recommendations for each agent type for optimal performance.

Supported Models​

The full list of supported LLM models can be retrieved from GET /v1/models which gets the list from Hyland AI Platform and filters the list for Agent Builder compatibility.

Recommendations by Agent Type​

We recommend using:

  • Amazon Nova Micro - Best balance of performance and cost
  • Amazon Nova Lite - When higher accuracy is needed
tip

Nova Micro is particularly efficient for RAG operations due to its optimized context processing capabilities.

Model Deprecation​

Some models will be deprecated over time as new models are supported. Deprecation will be scheduled in advance. The effective date and the recommended model to migrate to will be specified in the response from the GET /v1/models endpoint.

Agent Builder will continue to allow agents that use models scheduled for deprecation to be created, updated, and invoked until the deprecation date. At the deprecation date, requests that use the deprecated model will fail with an error response that includes the deprecation status and replacement model ID. No further actions will be permitted with this agent until the model has been updated.

Performance Considerations​

  • RAG Agents: Nova models are optimized for retrieval tasks and provide better performance/cost ratio
  • Tool Agents: Claude models provide better reasoning capabilities for tool operations

Cost Considerations​

Models are listed from most cost-effective to most expensive:

  1. Amazon Nova Micro
  2. Amazon Nova Lite
  3. Amazon Nova
  4. Claude 3 Haiku
  5. Claude 3.5 Haiku
  6. Claude 3.5 Sonnet

Choose models based on your specific needs and budget constraints.