arXiv 2024
Liger RMSNorm
Liger Kernel: Fused RMSNorm
Pin-Lun Hsu, Yun Dai, +8
Derive RMSNorm, trace fused rowwise normalization, inspect mixed-precision cast boundaries, and follow the input and shared-weight gradients in Liger Kernel.
Explore machine learning papers and reviews related to RMSNorm. Find insights, analysis, and implementation details.
Liger RMSNorm
Pin-Lun Hsu, Yun Dai, +8
Derive RMSNorm, trace fused rowwise normalization, inspect mixed-precision cast boundaries, and follow the input and shared-weight gradients in Liger Kernel.