[router] Add Configurable L0 and L1 Tokenizer Caching #2770
CatherineSuepr-test-pd-router.yml
on: pull_request
test-disaggregation
31m 11s
summarize-benchmarks
12s
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
genai-bench-results-all-policies
|
1.89 MB |
sha256:f9d80e138654c8041def14594eddae787b6710b7e061315de0d15a52bb36df60
|
|