Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
359 Open 2,339 Closed
359 Open 2,339 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Allow GPU work exclusive ownership of asyncio loop complexity: medium
#4295 opened Apr 14, 2026 by tdene Contributor Loading…
5 tasks
Core 0.16
1
[fix] fix optimizer community-request Final Review PR is in the "final review" stage
#4294 opened Apr 14, 2026 by pavelgein Loading…
1 of 5 tasks
2
[Dev] Refactor CUDA graph configuration: separate inference granularity from training scope
#4293 opened Apr 14, 2026 by buptzyb Contributor • Draft
5 tasks
11
Refactor CUDA graph configuration: separate inference granularity from training scope
#4292 opened Apr 14, 2026 by buptzyb Contributor • Draft
5 tasks
1
chore: nightly sync main into dev (14_04_2026) complexity: high
#4291 opened Apr 14, 2026 by svcnvidia-nemo-ci Loading… Core 0.16
10
cp: NVFP4 native weights for DDP (4005) into core_r0.17.0 cherry-pick Run CICD
#4290 opened Apr 14, 2026 by ko3n1g Contributor Loading… Core 0.16
2
[Copy to main] TE fused grouped mlp with grouped bias and delayed wgrad
#4288 opened Apr 14, 2026 by svcnvidia-nemo-ci • Draft
5 tasks
2
Cuda graph fix
#4285 opened Apr 13, 2026 by i-riyad Contributor • Draft
5 tasks
2
Fix typo in PR4133. Approved All necessary approvals have been made bug Something isn't working complexity: low
#4277 opened Apr 13, 2026 by cspades Member Loading…
5 tasks
Core 0.16
@cspades
7
Fix assertion logic in combined_1f1b_schedule_for_interleaved_pipelining community-request
#4276 opened Apr 13, 2026 by joapolarbear Loading…
1
ci: add workflow_dispatch support to cicd-main.yml
#4275 opened Apr 13, 2026 by ko3n1g Contributor • Draft
3 tasks
1
fix mfsdp unwrap stuck at MegatronFSDP complexity: low Final Review PR is in the "final review" stage module: megatron-fsdp
#4274 opened Apr 13, 2026 by wplf Member Loading… Core 0.16
5
fix mfsdp unwrap stuck at MegatronFSDP module: megatron-fsdp
#4273 opened Apr 13, 2026 by wplf Member Loading… Core 0.16
5
[Dev] Support delayed wgrad compute overlap with P2P backward
#4268 opened Apr 13, 2026 by Wohox Contributor • Draft
5 tasks
1
[Main] Fix TE version check for retain_pinned_cpu_buffers in cpu offload complexity: low Final Review PR is in the "final review" stage
#4267 opened Apr 13, 2026 by BestJuly Contributor Loading… Core 0.16
2
Get device correctly when module returns a dict instead of individual tensor Approved All necessary approvals have been made complexity: low
#4265 opened Apr 13, 2026 by shifangx Contributor Loading…
5 tasks
4
Factor RL-specific code out of training.py complexity: high
#4264 opened Apr 12, 2026 by tdene Contributor Loading…
5 tasks
Core 0.16
4
Call save_checkpoint_and_time() when saving checkpoint and compute elapsed duration for saving checkpoint before logging timer community-request
#4263 opened Apr 12, 2026 by awsankur Loading…
3 tasks
Core 0.16
4
Add TEFusedDenseMLP for Dense+Grouped GEMM fusion on SM100+
#4262 opened Apr 12, 2026 by sraman-rgb Loading…
4 of 5 tasks
Core 0.16
14
Enable CUDA graphs for MTP inference Run functional tests
#4260 opened Apr 11, 2026 by santhnm2 Contributor • Draft
5 tasks
Core 0.16
5
New allgathervdispatcher for inference and simplify old dispatcher. complexity: high
#4258 opened Apr 10, 2026 by sidsingh-nvidia Contributor • Draft
5 tasks
Core 0.16
2
Add training-side support for Rollout Routing Replay (R3) community-request needs-follow-up Issue needs follow-up
#4256 opened Apr 10, 2026 by meinie0826 Loading…
4 of 5 tasks
7
get rid of pickle
#4254 opened Apr 10, 2026 by dimapihtar Contributor • Draft
5 tasks
1
Allow fine-grained offloading with MC impl of full-CG.
#4253 opened Apr 10, 2026 by rapatel Contributor Loading…
5 tasks
Core 0.16
4
[fix] Use MSC for checking checkpoint existence community-request
#4251 opened Apr 10, 2026 by pavelgein Loading…
1 of 5 tasks
4
ProTip! Add no:assignee to see everything that’s not assigned.