arXiv 2024
Liger RMSNorm
Liger Kernel: Fused RMSNorm
Pin-Lun Hsu, Yun Dai, +8
Derive RMSNorm, trace fused rowwise normalization, inspect mixed-precision cast boundaries, and follow the input and shared-weight gradients in Liger Kernel.
Explore machine learning papers and reviews related to Triton. Find insights, analysis, and implementation details.
Liger RMSNorm
Pin-Lun Hsu, Yun Dai, +8
Derive RMSNorm, trace fused rowwise normalization, inspect mixed-precision cast boundaries, and follow the input and shared-weight gradients in Liger Kernel.
Liger SwiGLU
Pin-Lun Hsu, Yun Dai, +8
Trace Liger Kernel’s fused SiLU and multiply, derive both SwiGLU gradients, and separate saved activation memory from measured GPU performance.