Skip to content

docs: Update tensorizer.md #9

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 57 commits into
base: upstream
Choose a base branch
from
Open

docs: Update tensorizer.md #9

wants to merge 57 commits into from

Conversation

sangstar
Copy link
Collaborator

No description provided.

@sangstar sangstar force-pushed the sangstar/tensorizer-docs-updated branch 2 times, most recently from 46ef754 to 452a41c Compare July 18, 2025 14:35
zou3519 and others added 28 commits July 18, 2025 14:10
@zou3519
[Kernel] Apply torch.Tag.needs_fixed_stride_order only for torch==2.6…
b2eb2b5 
….0 (vllm-project#19346)

Signed-off-by: rzou <[email protected]>
@JialinOuyang-Meta
[Core] Avoid KVCacheBlock.__eq__ invocations in FreeKVCacheBlockQueue (…
0f199f1 
…vllm-project#21005)

Signed-off-by: Jialin Ouyang <[email protected]>
@hax0r31337
[Bugfix] Voxtral on Blackwell GPUs (RTX 50 series) (vllm-project#21077)
5782581 
Signed-off-by: hax0r31337 <[email protected]>
@ruisearch42
Elastic Expert Parallel Initial Support (vllm-project#20775)
2179372 
Signed-off-by: Rui Qiao <[email protected]>
@jeejeelee
[Quantization] Enable BNB support for more MoE models (vllm-project#2…
466e878 
…1100)

Signed-off-by: Jee Jee Li <[email protected]>
@luccafong
[Core] Support Local Chunked Attention for Hybrid KV Cache (vllm-proj…
9a9fda1 
…ect#19351)

Signed-off-by: Lucia Fang <[email protected]>
Signed-off-by: Lu Fang <[email protected]>
Signed-off-by: Lu Fang <[email protected]>
Co-authored-by: Lu Fang <[email protected]>
@varun-sundar-rabindranath
[Bugfix][Model] Fix LoRA for Mistral-Small-3.1-24B-Instruct-2503 (vll…
9ffe905 
…m-project#21183)

Signed-off-by: Varun Sundar Rabindranath <[email protected]>
Co-authored-by: Varun Sundar Rabindranath <[email protected]>
@WoosukKwon
[V0 Deprecation] Remove V0 Spec Decode workers (vllm-project#21152)
dd572c0 
Signed-off-by: Woosuk Kwon <[email protected]>
@varun-sundar-rabindranath
[Kernel][Performance] Tweak MoE Batched silu_mul_fp8_quant_deep_gemm …
dcc6cfb 
…kernel (vllm-project#21193)

Signed-off-by: Varun Sundar Rabindranath <[email protected]>
Co-authored-by: Varun Sundar Rabindranath <[email protected]>
@LucasWilkinson
[BugFix][CPU] Fix TorchSDPABackendImpl doesn't have use_irope (vl…
468e240 
…lm-project#21200)

Signed-off-by: Lucas Wilkinson <[email protected]>
@yewentao256
[Bug] DeepGemm: Fix TypeError: per_block_cast_to_fp8() missing 1 requ…
37bd8d6 
…ired positional argument: 'use_ue8m0' for SM100 (vllm-project#21187)

Signed-off-by: yewentao256 <[email protected]>
@Deepfocused
[Model] EXAONE 4.0 model support (vllm-project#21060)
3e04107 
Signed-off-by: Deepfocused <[email protected]>
Signed-off-by: woongsik <[email protected]>
@Chenyaaang
[Misc][Tools][Benchmark] Add readme file for auto_tune script (vllm-p…
3a2cb26 
…roject#20779)

Signed-off-by: Chenyaaang <[email protected]>
@huydhn
Fix a couple of Voxtral tests (vllm-project#21218)
cf8cc32 
Signed-off-by: Huy Do <[email protected]>
@jeejeelee
[V0 deprecation] Remove long context LoRA (vllm-project#21169)
1eaff27 
Signed-off-by: Jee Jee Li <[email protected]>
@Isotr0py
[Bugfix] Fix ndarray video color from VideoAsset (vllm-project#21064)
18e519e 
Signed-off-by: Isotr0py <[email protected]>
@LucasWilkinson
[BugFix] Fix potential cuda-graph IMA (vllm-project#21196)
59f9353 
Signed-off-by: Lucas Wilkinson <[email protected]>
@shixianc
Add torch golden impl for moe_align_block_size kernel test (vllm-proj…
7d94577 
…ect#20653)

Signed-off-by: Shixian Cui <[email protected]>
Co-authored-by: Shixian Cui <[email protected]>
@kaixih @mgoin
[NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low late…
6d0734c 
…ncy (vllm-project#20645)

Signed-off-by: kaixih <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: mgoin <[email protected]>
@22quinn
[Bugfix][Frontend] Fix openai CLI arg middleware (vllm-project#21220)
b3d8210 
Signed-off-by: 22quinn <[email protected]>
@bigPYJ1151
[bugfix] Fix auto thread-binding when world_size > 1 in CPU backend a…
e3a0e43 
…nd refactor code (vllm-project#21032)

Signed-off-by: jiang1.li <[email protected]>
@rabi
Fix/remove some broken model executor tests (vllm-project#21224)
c81259d 
Signed-off-by: Rabi Mishra <[email protected]>
@llsj14
[CI/CD][bugfix]fix: error argument to loads has incompatible type (vl…
da6579b 
…lm-project#21223)

Signed-off-by: Sungjae Lee <[email protected]>
Signed-off-by: Sungjae Lee <[email protected]>
@1195343015
[Docs] Update the link to the 'Prometheus/Grafana' example (vllm-proj…
6a971ed 
…ect#21225)
@kouroshHakha
[BugFix] Make PD work with Ray (vllm-project#21072)
9f414a1 
Signed-off-by: Kourosh Hakhamaneshi <[email protected]>
@tdoublep
[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (vllm-proj…
881e3cb 
…ect#21194)

Signed-off-by: Thomas Parnell <[email protected]>
@WoosukKwon
[V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (vllm-p…
752c6ad 
…roject#21217)

Signed-off-by: Woosuk Kwon <[email protected]>
@fhl2000
[BugFix] Fix full cuda graph slot_mapping (vllm-project#21228)
2e8cbb5 
Signed-off-by: fhl2000 <[email protected]>
zRzRzRzRzRzRzR and others added 27 commits July 19, 2025 22:40
@zRzRzRzRzRzRzR @Isotr0py @luccafong
GLM-4 Update (vllm-project#20736)
10eb24c 
Signed-off-by: zRzRzRzRzRzRzR <[email protected]>
Signed-off-by: Isotr0py <[email protected]>
Signed-off-by: Lu Fang <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
Co-authored-by: Lu Fang <[email protected]>
@tdoublep
[Docs] [V1] Update docs to remove enforce_eager limitation for hybrid…
2b504eb 
… models. (vllm-project#21233)

Signed-off-by: Thomas Parnell <[email protected]>
@yaochengji
[TPU] support fp8 kv cache quantization (vllm-project#19292)
3a1d894 
Signed-off-by: Chengji Yao <[email protected]>
@eicherseiji
Enable v1 metrics tests (vllm-project#20953)
d1fb65b 
Signed-off-by: Seiji Eicher <[email protected]>
@calvin0327
[Model] use AutoWeightsLoader for bart (vllm-project#18299)
51ba839 
Signed-off-by: calvin chen <[email protected]>
@zucchini-nlp @Isotr0py @DarkLight1337
[Model] Support VLMs with transformers backend (vllm-project#20543)
9499e26 
Signed-off-by: raushan <[email protected]>
Signed-off-by: Isotr0py <[email protected]>
Signed-off-by: Isotr0py <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
@1195343015
[bugfix] fix syntax warning caused by backslash (vllm-project#21251)
7ba34b1
@yankay
[CI] Cleanup modelscope version constraint in Dockerfile (vllm-projec…
8188196 
…t#21243)

Signed-off-by: Kay Yan <[email protected]>
@simon-mo
[Docs] Add RFC Meeting to Issue Template (vllm-project#21279)
92615d7 
Signed-off-by: simon-mo <[email protected]>
@huydhn
Add the instruction to run e2e validation manually before release (vl…
940af1f 
…lm-project#21023)

Signed-off-by: Huy Do <[email protected]>
@DarkLight1337
[Bugfix] Fix missing placeholder in logger debug (vllm-project#21280)
378d33c 
Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337
[Model][1/N] Support multiple poolers at model level (vllm-project#21227
042af0c 
)

Signed-off-by: DarkLight1337 <[email protected]>
@hmellor
[Docs] Fix hardcoded links in docs (vllm-project#21287)
be54a95 
Signed-off-by: Harry Mellor <[email protected]>
@hmellor
[Docs] Make tables more space efficient in supported_models.md (vll…
e6b90a2 
…m-project#21291)

Signed-off-by: Harry Mellor <[email protected]>
@andyxning
[Misc] unify variable for LLM instance (vllm-project#20996)
d978410 
Signed-off-by: Andy Xie <[email protected]>
@Edwardf0t1
Add Nvidia ModelOpt config adaptation (vllm-project#19815)
6b46c4b 
Signed-off-by: Zhiyu Cheng <[email protected]>
@WoosukKwon
[Misc] Add sliding window to flashinfer test (vllm-project#21282)
6dda13c 
Signed-off-by: Woosuk Kwon <[email protected]>
@bigPYJ1151
[CPU] Enable shared-memory based pipeline parallel for CPU backend (v…
a15a50f 
…llm-project#21289)

Signed-off-by: jiang1.li <[email protected]>
@simpx
[BugFix] make utils.current_stream thread-safety (vllm-project#21252) (…
a0e827e 
…vllm-project#21253)

Signed-off-by: simpx <[email protected]>
@minosfuture @gemini-code-assist
[Misc] Add dummy maverick test (vllm-project#21199)
6ece16c 
Signed-off-by: Ming Yang <[email protected]>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
@LucasWilkinson @mgoin
[Attention] Clean up iRoPE in V1 (vllm-project#21188)
304dce7 
Signed-off-by: Lucas Wilkinson <[email protected]>
Co-authored-by: Michael Goin <[email protected]>
@robertgshaw2-redhat
[DP] Fix Prometheus Logging (vllm-project#21257)
29d1ffc 
Signed-off-by: Robert Shaw <[email protected]>
Co-authored-by: Robert Shaw <[email protected]>
@sangstar
docs: Update docs article with usage patterns
8b296c3 
Signed-off-by: Sanger Steel <[email protected]>
@willgoldby @sangstar
fix: Rename headings and move content around
110a6fd 
Signed-off-by: William Goldby <[email protected]>
Signed-off-by: Sanger Steel <[email protected]>
@willgoldby @sangstar
fix: Add title for Tensorizer configuration
480e84e 
Signed-off-by: William Goldby <[email protected]>
Signed-off-by: Sanger Steel <[email protected]>
@sangstar
docs: Update example file docstring
b2efb9f 
Signed-off-by: Sanger Steel <[email protected]>
@sangstar
docs: Revert original markdown title
c1ba86c 
Signed-off-by: Sanger Steel <[email protected]>
@sangstar sangstar force-pushed the sangstar/tensorizer-docs-updated branch from 96cb1df to c1ba86c Compare July 21, 2025 17:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.