Search results

高并发输出不稳定

bugSomething isn't workingSomething isn't working

enhancementNew feature or requestNew feature or request

Status: Open.

#203 In ModelTC/lightllm;

· GavinZhao19 opened on Nov 10, 2023

[BUG] Issues ablout openai /v1/chat/completions interface in streaming mode

bugSomething isn't workingSomething isn't working

enhancementNew feature or requestNew feature or request

Status: Open.

#130 In ModelTC/lightllm;

· sunxichen opened on Sep 13, 2023

Support generate() like vllm, and run without docker?

enhancementNew feature or requestNew feature or request

Status: Open.

#117 In ModelTC/lightllm;

· curname opened on Sep 4, 2023

[FEATURE] Add support for true open-source models like MPT

enhancementNew feature or requestNew feature or request

Status: Open.

#102 In ModelTC/lightllm;

· casper-hansen opened on Aug 24, 2023

是否有计划支持 lora？

enhancementNew feature or requestNew feature or request

Status: Open.

#84 In ModelTC/lightllm;

· Haskely opened on Aug 17, 2023

Supporting GPT-NEO and GPT-NEOX

enhancementNew feature or requestNew feature or request

Status: Open.

#73 In ModelTC/lightllm;

· goodbai-nlp opened on Aug 15, 2023

[feature request] add prompt styles support

enhancementNew feature or requestNew feature or request

Status: Open.

#9 In ModelTC/lightllm;

· jiacheo opened on Aug 3, 2023