Search results

Multi-GPU FP8 (accelerate.dispatch_model + DelayedScaling HYBRID) — illegal memory access on H200 sm_90

Status: Open.

#3124 In NVIDIA/TransformerEngine;

· roir opened on Jun 12, 2026

Vendor-neutral reference: NVFP4 vs OCP MXFP4 block-structure parameters (request for confirmation)

questionFurther information is requestedFurther information is requested

Status: Open.

#3105 In NVIDIA/TransformerEngine;

· gHashTag opened on Jun 8, 2026

test_comm_gemm_overlap.py::test_multi_layer_with_overlap_bf16 fails on A100

bugSomething isn't workingSomething isn't working

Status: Open.

#3097 In NVIDIA/TransformerEngine;

· francesco-bertolotti opened on Jun 5, 2026

Low-overhead stateless functional quantize/GEMM API (plain tensors in → out)

Status: Open.

#3087 In NVIDIA/TransformerEngine;

· cael-ling opened on Jun 5, 2026

Fused attention should distinguish bias input from dBias request

attention

Status: Open.

Enhancement

#3082 In NVIDIA/TransformerEngine;

· KshitijLakhani opened on Jun 4, 2026

NVFP4 default recipe (RHT + stochastic rounding) crashes on sm_120: fused kernel exceeds 101376-byte shared-memory opt-in cap

bugSomething isn't workingSomething isn't working

Status: Open.

#3062 In NVIDIA/TransformerEngine;

· Infatoshi opened on May 29, 2026

[Common] Move heavy kernel compilation to NVRTC

installation

Status: Open.

#3054 In NVIDIA/TransformerEngine;

· CarlosGomes98 opened on May 28, 2026

[JAX] score_mod attention to support "enforce_precompiled" flag in cuDNN graph deserialization

attention

jax

Status: Open.

#3046 In NVIDIA/TransformerEngine;

· jberchtold-nvidia opened on May 26, 2026

[PyTorch] Integrate cuDNN GQA + DSA backend into DotProductAttention

Status: Open.

#3028 In NVIDIA/TransformerEngine;

· nvMelissa opened on May 21, 2026

·  

2.18

[Common + PyTorch] Support Dispatch FP8

Status: Open.

#3026 In NVIDIA/TransformerEngine;

· phu0ngng opened on May 21, 2026

[JAX] Dispatch/Combine for BF16 Tensor

Status: Open.

#3025 In NVIDIA/TransformerEngine;

· phu0ngng opened on May 21, 2026

[PyTorch] Dispatch/Combine for BF16 tensor + Zero-Copy

Status: Open.

#3024 In NVIDIA/TransformerEngine;

· phu0ngng opened on May 21, 2026