25 min read
CUDA Matrix Multiplication Optimization: From Naive to Near-cuBLAS
Step-by-step CUDA matrix multiplication optimization with 9 interactive visualizations. From naive kernels through shared memory tiling to near-cuBLAS speeds.
Optimization
Explore technical articles related to Optimization. Find in-depth analysis, tutorials, and insights.
- Tagged with
- 4 articles
Articles Related to Optimization
25 min read
Numerical Sensitivity: Why FP16 Breaks NAdam
Visual exploration of floating-point arithmetic and numerical stability. Learn why NAdam fails in FP16 and how machine epsilon affects deep learning.
30 min read
Quantization Deep Dive: From FP32 to INT4
Master neural network quantization with interactive visualizations. Explore QAT, PTQ, GPTQ, AWQ, and SmoothQuant methods for efficient model deployment.
25 min read
C++ Compilation Process: From Source Code to Object Files
How C++ compilers transform source code through preprocessing, parsing, optimization, and code generation. Interactive visualizations included.