Skip to content

Commit 30c340b

Browse files
Switch B300 DSv4 TRT image to nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:1.3.0-deepseek-v4-dev.1
Update both dsv4-fp4-b300-trt and dsv4-fp4-b300-trt-mtp to the Dynamo TensorRT-LLM runtime image. Also removes stale perf-changelog entry that contradicted the launcher behavior. Co-authored-by: functionstackx <functionstackx@users.noreply.github.com>
1 parent 285b79a commit 30c340b

2 files changed

Lines changed: 9 additions & 9 deletions

File tree

.github/configs/nvidia-master.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3049,7 +3049,7 @@ dsv4-fp4-b300-vllm-agentic:
30493049
- { tp: 8, ep: 8, dp-attn: true, offloading: cpu, conc-list: [128, 256, 512] }
30503050

30513051
dsv4-fp4-b300-trt:
3052-
image: nvcr.io#nvidia/tensorrt-llm/release:1.3.0rc15.post1
3052+
image: nvcr.io#nvidia/ai-dynamo/tensorrtllm-runtime:1.3.0-deepseek-v4-dev.1
30533053
model: deepseek-ai/DeepSeek-V4-Pro
30543054
model-prefix: dsv4
30553055
runner: b300
@@ -3072,7 +3072,7 @@ dsv4-fp4-b300-trt:
30723072
- { tp: 8, ep: 8, dp-attn: true, conc-start: 256, conc-end: 1024 }
30733073

30743074
dsv4-fp4-b300-trt-mtp:
3075-
image: nvcr.io#nvidia/tensorrt-llm/release:1.3.0rc15.post1
3075+
image: nvcr.io#nvidia/ai-dynamo/tensorrtllm-runtime:1.3.0-deepseek-v4-dev.1
30763076
model: deepseek-ai/DeepSeek-V4-Pro
30773077
model-prefix: dsv4
30783078
runner: b300

perf-changelog.yaml

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -3387,13 +3387,6 @@
33873387
- "Add MTP speculative-decoding sibling for dsv4-fp4-mi355x-vllm (model: deepseek-ai/DeepSeek-V4-Pro) on vllm/vllm-openai-rocm:v0.22.0, per vllm-project/vllm#43385"
33883388
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1630
33893389

3390-
- config-keys:
3391-
- dsv4-fp4-b300-trt
3392-
- dsv4-fp4-b300-trt-mtp
3393-
description:
3394-
- "Point the B300 TensorRT-LLM DeepSeek-V4-Pro configs (non-MTP dsv4-fp4-b300-trt and MTP dsv4-fp4-b300-trt-mtp) at the official NVIDIA release image nvcr.io/nvidia/tensorrt-llm/release:1.3.0rc15.post1, replacing the custom ghcr.io semianalysis feat/deepseek_v4 builds (2dd03e6 and 9aa3715 respectively), to evaluate the official RC for DeepSeek-V4-Pro. Also drops the TRTLLM_DSV4_ENABLE_SWA_SCRATCH_REUSE=0 launcher workaround (specific to the custom build) so the official image runs with its native behavior. B200 TRT is unchanged (stays on feat-deepseek_v4-9aa3715)."
3395-
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1636
3396-
33973390
- config-keys:
33983391
- dsv4-fp4-mi355x-sglang-mtp
33993392
description:
@@ -3516,3 +3509,10 @@
35163509
- "Update GPT-OSS model for MI355X vLLM from amd/gpt-oss-120b-w-mxfp4-a-fp8 to openai/gpt-oss-120b"
35173510
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1670
35183511

3512+
- config-keys:
3513+
- dsv4-fp4-b300-trt
3514+
- dsv4-fp4-b300-trt-mtp
3515+
description:
3516+
- "Switch B300 DSv4 TRT (non-MTP + MTP) image from rc15.post1 to nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:1.3.0-deepseek-v4-dev.1"
3517+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1636
3518+

0 commit comments

Comments
 (0)