Skip to content

Add extra_body to CreateChatCompletionRequest #382

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

jfolz
Copy link

@jfolz jfolz commented Jun 4, 2025

OpenAI's Python library allows adding extra arguments to the request body via the extra_body kwarg. This is useful to, e.g., control thinking modes for Qwen. This PR adds the extra_body field to CreateChatCompletionRequest to accomplish the same.

@64bit
Copy link
Owner

64bit commented Jun 7, 2025

This can be achieved with byot feature:

pub struct CustomCreateChatCompletionRequest {
    #[serde(flatten)]
    pub request: CreateChatCompletionRequest,
    #[serde(flatten)]
    pub extra_body: Option<Map<String, Value>>,
}

@64bit 64bit added out of scope Requests which are not related to OpenAI API and removed out of scope Requests which are not related to OpenAI API labels Jun 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants