Skip to content

Conversation

SiavZ
Copy link

@SiavZ SiavZ commented Sep 6, 2025

Context

This PR significantly enhances the Chutes AI provider integration with three major improvements:

  1. Full API Parameter Support: Added comprehensive support for all Chutes-specific API parameters
  2. Model Reorganization: Logical grouping and chronological ordering of 65+ models for better maintainability
  3. Embedding Model Support: Added new embedding model configuration

Implementation

1. Complete Chutes API Parameter Support (26 new parameters):

  • Added full schema validation for all Chutes-specific parameters in provider-settings.ts
  • Implemented parameter mapping in API handler with proper type safety
  • Supported parameters: seed, top_p, frequency_penalty, presence_penalty, stop, min_p, best_of, logprobs, ignore_eos, logit_bias, min_tokens, top_logprobs, length_penalty, stop_token_ids, prompt_logprobs, response_format, use_beam_search, repetition_penalty, skip_special_tokens, include_stop_str_in_output, spaces_between_special_tokens

2. Model Reorganization & Expansion:

  • Logical Grouping: Organized 65+ models into architectural families:

    • DeepSeek Models (V3.1, V3, R1 series)
    • Qwen Models (Qwen3 series, Qwen2.5 series)
    • Gemma Models (Gemma 3 series, Gemma 2)
    • Llama Models (Llama 3.3, Llama 4, Nemotron)
    • Mistral Models (Mistral Small variants, Nemo)
    • Moonshot/Kimi Models (Kimi-K2, Kimi-Dev, Kimi-VL)
    • Other Models (grouped by organization)
  • Chronological Ordering: Within each group, models ordered newest to oldest based on release timelines

  • Enhanced Documentation: Clear section comments with ordering rationale

3. Embedding Model Support:

  • Added chutes-baai-bge-large-en-v1-5 embedding model with proper configuration
  • 1024 dimensions with 0.4 score threshold

Technical Details:

  • Files Modified:

    • packages/types/src/provider-settings.ts - Schema validation (+26 parameters)
    • src/api/providers/chutes.ts - API parameter implementation
    • packages/types/src/providers/chutes.ts - Model reorganization (615+ changes)
    • src/shared/embeddingModels.ts - Embedding model addition
  • Type Safety: All changes maintain full TypeScript compatibility

  • Backward Compatibility: All existing functionality preserved

Screenshots

Before (Limited) After (Comprehensive)
Basic OpenAI compatibility Full Chutes API parameter support
Unorganized model list Logical grouping + chronological ordering
Limited embedding options Expanded embedding model support

How to Test

  1. API Parameter Testing:

    • Configure various Chutes-specific parameters in provider settings
    • Verify they are properly passed to the Chutes API
    • Test parameter combinations and edge cases
  2. Model Availability:

    • Ensure all 65+ models are available and functional
    • Test models from each architectural group
    • Verify pricing and configuration remains unchanged
  3. Embedding Model:

    • Test the new chutes-baai-bge-large-en-v1-5 embedding model
    • Verify dimension and threshold settings work correctly
  4. Type Safety:

    • Run npm run type-check to confirm no compilation errors
    • Test that all schema validations work properly

Get in Touch

Available in Kilo Code Discord for questions user id: 176349800646705154

SiavZ and others added 5 commits August 9, 2025 23:07
Adding chutes.ai Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8
…onological ordering

- Grouped models by architecture/family (DeepSeek, Qwen, Gemma, Llama, Mistral, Moonshot/Kimi)
- Ordered models within each group from newest to oldest based on release timelines
- Added clear section comments for better navigation
- Maintained all model configurations and type safety
Copy link

changeset-bot bot commented Sep 6, 2025

⚠️ No Changeset found

Latest commit: 8ef4dda

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant