Search results

PD分离部署DeepSeeK-R1-FP8模型，起tp16卡的prefill服务报错

Status: Open.

#1074 In ModelTC/lightllm;

· wenruihua opened on Sep 30, 2025

[BUG] silu_and_mul_masked UT failed

bugSomething isn't workingSomething isn't working

Status: Open.

#1068 In ModelTC/lightllm;

· froststeam opened on Sep 25, 2025

where can I find <code>lightllm_constraint_decode_kernel</code>?

Status: Open.

#1007 In ModelTC/lightllm;

· Gompyn opened on Aug 15, 2025

lightllm_kernels有计划什么时候开源吗

Status: Open.

#976 In ModelTC/lightllm;

· danielhua23 opened on Jul 21, 2025

add AI/ML API as provider

Status: Open.

#929 In ModelTC/lightllm;

· OctavianTheI opened on Jun 12, 2025

希望支持静态量化模型（AWQ/GPTQ，配合llmc）的加载与推理

Status: Open.

#894 In ModelTC/lightllm;

· poisonwine opened on May 14, 2025

add docs for multimodal models.

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#852 In ModelTC/lightllm;

· hiworldwzj opened on Apr 23, 2025

[Feature] 在LightLLM图像生成中集成ImageForLLM元数据嵌入功能

Status: Open.

#838 In ModelTC/lightllm;

· kexinoh opened on Apr 19, 2025

[Feature] Add support for Speculative Decoding

Status: Open.

#820 In ModelTC/lightllm;

· zyongye opened on Apr 9, 2025

[BUG]通过 zmq.Socket.recv_pyobj 进行的隐式 Pickle 反序列化导致远程代码执行 (RCE)

bugSomething isn't workingSomething isn't working

Status: Open.

#784 In ModelTC/lightllm;

· kexinoh opened on Mar 28, 2025

🔒 SecurityReportBot Alert: Potential Vulnerability Detected

Status: Open.

#776 In ModelTC/lightllm;

· secuityreportbot opened on Mar 23, 2025

支持以PD分离模式运行多机的DeepSeek R1吗

Status: Open.

#771 In ModelTC/lightllm;

· inkhare opened on Mar 17, 2025