Skip to content

From NVIDIA Megatron-LM for visibility#18

Open
RaymondLi0 wants to merge 7363 commits into
bigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 7363 commits into
bigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

Copy link
Copy Markdown
Collaborator

No description provided.

@RaymondLi0
RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0
RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
balasaajay and others added 27 commits June 4, 2026 11:20
@balasaajay
build: Switch DSv3 on H100 to HybridEP (#5164)
53e3748
@yfw @claude
Add MTP acceptance rate metrics (#3458)
d041544 
Signed-off-by: Yi-Fu Wu <yifu.wu@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@jenchen13
Nemotron Ultra config for ModelOpt examples (#5159)
6f14bf9 
Signed-off-by: Jennifer Chen <jennifchen@nvidia.com>
@santhnm2 @claude
Make MTP / prefix cache stats persist for engine lifetime (#4101)
53b5e6e 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
@Phlip79
Restore Greptile configuration (#5166)
2944537
@ko3n1g
chore: bump _code_freeze workflow to v1.4.2 (#5132)
96a894e 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@chtruong814
ci: Remove docs build test in favor of release test (#5182)
5a2b598 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@yaoyu-33
Move TE cross entropy guard to training args (#5162)
b574499 
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
@tdene
Fix error in deepseek parser (#5136)
5a2c6fa
@santhnm2
Fix logprob slicing for 0 generated token case (#5167)
9d33299 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@cuichenx
[Perf] Fold frozen linear dgrad matmul (#5092)
0f891a1 
Signed-off-by: Chen Cui <chcui@nvidia.com>
@tdene
Clamp max_new_tokens in MInf to mirror vllm (#5181)
53d9ba0
@kajalj22
build: add managed = true to [tool.uv] (#5190)
dbf5228 
Signed-off-by: Kajal Jain <kajalj@nvidia.com>
@shanmugamr1992 @claude
Stabilize GB200 inference perf tests against cold-start noise (#5171)
6204b92 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@megnvidia
nvidia style guide audit for getting started folder (#5168)
947c0b3 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
@megnvidia @Phlip79
AI aided audit for Nvidia Style guidance (#5141)
05c76af 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
Co-authored-by: Philip Petrakian <pgpetrak@gmail.com>
@xuantengh
Enable selective recompute for norm_out in GDN layers (#4715)
ff5264c
@balasaajay @claude
fix(elastification): align with get_batch + utils refactors (#5194)
adcdf16 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@Wohox
fix(combined-1f1b): release loss-node input storage after combined ba…
5da641c 
…ckward (#4909)
@github-actions
chore(beep boop 🤖): Bump (main) (2026-06-08)
dbf719b
@dimapihtar
Avoid stat syscall in rerun result validation (#5107)
17a5a80 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
@sbhavani
docs: Update Latest News in README.md (#3790)
71e2246
@cspades
Fix bug with Megatron-FSDP zero counter not working with decoupled gr…
3e6e32b 
…adients. (#4802)

Signed-off-by: Cory Ye <cye@nvidia.com>
@balasaajay
ci: add smoke tests (#5143)
1829fd9
@yfw @claude
Add mtp_detach_heads config to detach MTP head inputs (#3456)
71e418e 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@Connor-XY
docs: fix install guide NGC container anchor (#5224)
a95d866
@xuantengh
Fuse per-sequence AlltoAll into a unified one in GDN forward (#4913)
48032d7
Mellonta and others added 30 commits July 15, 2026 00:34
@Mellonta
Implement Quantile Balancing in MoE (#5349)
33706f9 
Signed-off-by: Haoran Zhang <haoranz@nvidia.com>
@wujingyue
Unset NCCL overrides for MFSDP v2 tests (#5794)
f8c9911 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@wujingyue
Fix MegatronFSDP root module hook dispatch (#5808)
4bf7fca 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@balasaajay
Pin cudnn-fe and cuTeDSL version (#5812)
834abc1 
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@github-actions
chore: rotate oncall schedule
5abab93
@sidsingh-nvidia
Inference: Add the nemotron_v3 reasoning parser (#5634)
82e9dc6 
Signed-off-by: Siddharth Singh <sidsingh@nvidia.com>
@jinhangchoi @cspades
Missing moe_router_dtype causes unexpected downcast in ModelOpt examp…
ccdfa7d 
…le (#5810)

Signed-off-by: Jinhang Choi <jinhangc@nvidia.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@wujingyue @svcnvidia-nemo-ci
Avoid FSDP unit terminology in MFSDP v2 (#5793)
5e45ccf 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: svcnvidia-nemo-ci <svcnvidia-nemo-ci@nvidia.com>
Co-authored-by: svcnvidia-nemo-ci <svcnvidia-nemo-ci@nvidia.com>
@shanhaoli
Fix configured norm epsilon in MambaLayer (#5750)
7711346 
Signed-off-by: Shanhao <5197744+shanhaoli@users.noreply.github.com>
@Connor-XY @claude
[refactor] Common combined-1F1B schedule-plan base (1/4 of #4798) (#4941
ffbe018 
)

Signed-off-by: Yan Xu <yxu1@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@svcnemo-autobot
chore(tests): AUT-851 move NCCL defaults from run_ci_test.sh to conft…
ecf5547 
…est (#5826)

Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
@santhnm2
Set num_splits to 0 for FA4 inference (#5804)
8bf7365 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@balasaajay
ci: Enhance nightly/mr/weekly error reporting (#5831)
06bb399 
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@balasaajay
feat(docker): Add NCCL installation script and install NCCL 2.30.4 (#…
3927d9b 
…5815)

Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@shanmugamr1992
IMA fix by making the copy of book keeping buffer to GPU blocking (#5715
53a2dd5 
)

Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com>
@Phlip79
Add GPTModel to HybridModel migration guide (#5698)
802da56 
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@wujingyue
Pair frozen FSDP backward hooks (#5710)
38626c2 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@wujingyue
Clarify NVIDIA email signing guidance (#5699)
c2f0df5 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@wujingyue
Overlap FSDP communication with compute (#5719)
d981f66 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@ko3n1g @claude
chore(skills): add Regent Open Plugin manifest (#5840)
7b2a97b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@ko3n1g
chore(skills): remove Open Plugin manifest (superseded) (#5842)
2aa3645 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@sidsingh-nvidia
return prefix cache hits data from the chat completions api (#5609)
edd4562 
Signed-off-by: Siddharth Singh <sidsingh@nvidia.com>
@santhnm2
Refactor data parallel coordinator to enable modular handlers (#5550)
f8e1ac6 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@wujingyue
Pass device IDs to cleanup barrier (#5702)
407ea4f 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@Marks101
Fix averaging for MoE z-loss metric tracking (#3199)
4abeecc 
Signed-off-by: Markus Schnös <markus.schnoes@deepl.com>
Co-authored-by: Markus Schnös <markus.schnoes@deepl.com>
@svcnemo-autobot
test(mfsdp): AUT-881 mark test_overlaps_communication_and_compute fla…
9a67ea0 
…ky (#5848)

Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
@sidsingh-nvidia
Inference: Extend default cuda-graph coverage to 512 tokens (#5797)
740c16e
@OlegSudakov @YangFei1990
Fix for sequence-level aux MoE loss being dependent on batch size (#5798
e3fe550 
)

Signed-off-by: Oleg Sudakov <osudakov@nvidia.com>
Signed-off-by: Oleg Sudakov <oleg.sudakov@outlook.com>
Co-authored-by: Fei Wu <33940270+YangFei1990@users.noreply.github.com>
@wujingyue
Allow parameterless FSDP root modules (#5711)
61f3114 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@jstjohn
Fix issue where parameter groups with different min/max LRs get overr…
27e312c 
…idden at checkpoint load time (#4705)

Signed-off-by: John St John <jstjohn@nvidia.com>
Signed-off-by: John St. John <jstjohn@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.