Back to Skills

adding-models

Guide for adding new LLM models to Letta Code. Use when the user wants to add support for a new model, needs to know valid model handles, or wants to update the model configuration. Covers models.json configuration, CI test matrix, and handle validation.

1,014stars129forksUpdated 2/10/2026

Security Assessment

Safe(100/100)
Security Score100/100

About adding-models

The 'adding-models' skill provides a comprehensive guide for integrating new Large Language Models (LLMs) into Letta Code. This skill is particularly useful for users who want to expand the support for LLMs, need to validate model handles, or wish to update existing configurations. By following the outlined steps, users can easily add new models, validate them, and integrate them into their projects. The skill ensures that adding models is a smooth process by providing clear instructions on working with the necessary configuration files and workflows.

Main features of the skill include handling the models.json configuration file for adding new models, modifying the CI test matrix to include new models for automated testing, and validating model handles using the Letta API. The skill also addresses toolset detection based on model provider, ensuring seamless integration with the right toolset without requiring manual intervention. Users can quickly test new models with headless mode and add them to the CI pipeline for consistent testing across updates. This flexibility makes the skill suitable for a variety of use cases in machine learning model integration.

The skill is mainly targeted at developers and data scientists who are working with Letta Code and wish to incorporate new models into their system. It helps them manage models efficiently, integrate new models into their projects, and automate testing, ensuring that their systems are up-to-date with the latest AI technologies.

FAQ

How do I find valid model handles for new models?

You can find valid model handles by querying the Letta API using the command `curl -s https://api.letta.com/v1/models/ | jq '.[] | .handle'`. You can also filter models by provider using specific prefixes.

What should I include in the models.json file for a new model?

In the models.json file, you need to include the model's id, handle, label, description, and optionally, the 'isFeatured' flag and 'updateArgs' for configuration. These entries help integrate the model into the Letta Code system.

How do I test a new model after adding it?

You can test the new model using headless mode by running the command `bun run src/index.ts --new --model <model-id> -p 'hi, what model are you?'`. Replace `<model-id>` with your model's identifier.

What do I do if the model works but has the wrong toolset?

If the model works but is assigned the wrong toolset, you should check the `src/tools/manager.ts` file to ensure the provider prefix is correctly recognized and mapped to the appropriate toolset.

Is it necessary to update the CI test matrix when adding a new model?

Adding a model to the CI test matrix is optional, but it is recommended for automated testing. You can include the model in `.github/workflows/ci.yml` to ensure it is tested in the CI pipeline.

Install adding-models

Download and extract the skill files to your .claude/skills/ directory.

Quick Setup:

  1. Copy the skill folder to .claude/skills/
  2. Claude will automatically detect and use the skill