Skip to content

[NV] dsr1 fp4 b300 dynamo trtllm#585

Merged
cquil11 merged 25 commits intomainfrom
nv/dsr1-fp4-b300-dynamo-trtllm-260122
Jan 28, 2026
Merged

[NV] dsr1 fp4 b300 dynamo trtllm#585
cquil11 merged 25 commits intomainfrom
nv/dsr1-fp4-b300-dynamo-trtllm-260122

Conversation

@cquil11
Copy link
Collaborator

@cquil11 cquil11 commented Jan 27, 2026 •
edited
Loading

csahithi and others added 19 commits January 22, 2026 14:11
@csahithi @jthomson04
b300 srt slurm
966101b
@jthomson04
update generated srtslurm yaml
d440c1a 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@csahithi @jthomson04
fix image
1e7674e
@csahithi @jthomson04
add uv and sqsh file
81d00ea
@csahithi @jthomson04
change partition
63ff2fc
@csahithi @jthomson04
change slurm account
a438ecf
@jthomson04
use regular srt
4616105 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
update perf changelog
7087ebe 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
fix runner
17e1f13 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
correct account
dbe21a9 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
qos support
f317664 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
fix get checkout
5cd597e 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@csahithi
update runner label and partition
368ef42
@jthomson04
undo branch checkout
d8825c6 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
debug info
28a71d1 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
cleanup logging
e17f0ac 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
use local model dir
2df1c6b 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04
Merge remote-tracking branch 'public/main' into nv/dsr1-fp4-b300-dyna…
6be4ee3 
…mo-trtllm-260122
@jthomson04
checkout specific commit
e931950 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@cquil11 cquil11 requested a review from a team as a code owner January 27, 2026 20:13
@cquil11
Copy link
Collaborator Author

cquil11 commented Jan 27, 2026 •
edited
Loading

@jthomson04 @csahithi can one of y'all please re-approve this? we had to revert the original merge and re-run because the name of the directories on the clusters changed so the runs failed

edit: there seem to be some other unrelated errors having to do with image download? flakes? https://github.com/InferenceMAX/InferenceMAX/actions/runs/21412751024/job/61653699072

cc @kedarpotdar-nv

cquil11
cquil11 commented Jan 27, 2026
View reviewed changes
runners/launch_b300-nv.sh Outdated

git clone https://github.com/ishandhanani/srt-slurm.git "$SRT_REPO_DIR"
cd "$SRT_REPO_DIR"
git checkout b4abe4643a7009f3539b36bdc508408874a4c930
Copy link
Collaborator Author

@cquil11 cquil11 Jan 27, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this doesn't seem to exist
https://github.com/InferenceMAX/InferenceMAX/actions/runs/21412751024/job/61653699072#:~:text=119-,%2B%20cd%20srt%2Dslurm,Installing%20srtctl...,-124

Copy link
Collaborator Author

@cquil11 cquil11 Jan 27, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

and this appears to be possibly causing errors indirectly, since new commits have potentially been made to the main branch which introduced breaking changes?
https://github.com/InferenceMAX/InferenceMAX/actions/runs/21412751024/job/61653699014#step:4:893

@jthomson04
Copy link
Collaborator

jthomson04 commented Jan 27, 2026

Ah, we recently did a big rebase and updated our configs. I'll push a fix shortly

@jthomson04
fix b300 submission
d4bc5f0 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@jthomson04 jthomson04 force-pushed the nv/dsr1-fp4-b300-dynamo-trtllm-260122 branch from 6b7f7d9 to d4bc5f0 Compare January 27, 2026 22:30
@jthomson04
Merge remote-tracking branch 'public/main' into nv/dsr1-fp4-b300-dyna…
5b7794a 
…mo-trtllm-260122
@jthomson04
end with newline
1671c7e 
Signed-off-by: jthomson04 <jothomson@nvidia.com>
@cquil11 cquil11 merged commit 4248627 into main Jan 28, 2026
2 checks passed
@cquil11 cquil11 deleted the nv/dsr1-fp4-b300-dynamo-trtllm-260122 branch January 28, 2026 16:27
This was referenced Jan 28, 2026
Merged
Merged
nlevin-ui added a commit that referenced this pull request Jan 28, 2026
@nlevin-ui
Merge main into feature branch, resolve perf-changelog conflict
56f775c 
Keep all entries:
- H200 dynamo-trt entry (this PR)
- Evals-only entry (PR #558)
- B300 dynamo-trt entry (PR #585)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

NVIDIA sweep-enabled

Projects

InferenceMAX Board
Status: Done

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@cquil11 @jthomson04 @csahithi