CUDA Matrix Multiplication: From Naive to Near-cuBLAS
Step-by-step CUDA matrix multiplication optimization with 9 interactive visualizations. From naive kernels through shared memory tiling to near-cuBLAS speeds.
Tagged with
optimization
Explore technical articles related to optimization. Find in-depth analysis, tutorials, and insights.
4
Articles Found
Articles Related to optimization
Numerical Sensitivity: Why FP16 Breaks NAdam
Visual exploration of floating-point arithmetic and numerical stability. Learn why NAdam fails in FP16 and how machine epsilon affects deep learning.
Quantization Deep Dive: From FP32 to INT4
Master neural network quantization with interactive visualizations. Explore QAT, PTQ, GPTQ, AWQ, and SmoothQuant methods for efficient model deployment.
C++ Compilation Process: From Source Code to Object Files
How C++ compilers transform source code through preprocessing, parsing, optimization, and code generation. Interactive visualizations included.