Skip to content

Conversation

jfolz
Copy link

@jfolz jfolz commented Jun 4, 2025

OpenAI's Python library allows adding extra arguments to the request body via the extra_body kwarg. This is useful to, e.g., control thinking modes for Qwen. This PR adds the extra_body field to CreateChatCompletionRequest to accomplish the same.

@64bit
Copy link
Owner

64bit commented Jun 7, 2025

This can be achieved with byot feature:

pub struct CustomCreateChatCompletionRequest {
    #[serde(flatten)]
    pub request: CreateChatCompletionRequest,
    #[serde(flatten)]
    pub extra_body: Option<Map<String, Value>>,
}

@64bit 64bit added out of scope Requests which are not related to OpenAI API and removed out of scope Requests which are not related to OpenAI API labels Jun 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants