25 min read
CUDA Matrix Multiplication Optimization: From Naive to Near-cuBLAS
Step-by-step CUDA matrix multiplication optimization with 9 interactive visualizations. From naive kernels through shared memory tiling to near-cuBLAS speeds.
Performance
Explore technical articles related to Performance. Find in-depth analysis, tutorials, and insights.
- Tagged with
- 4 articles
Articles Related to Performance
25 min read
How TensorRT Works: NVIDIA Inference Optimization
Explore TensorRT optimization: layer fusion, INT8 quantization, kernel auto-tuning, and deployment strategies with 8+ interactive visualizations.
15 min read
Kernel Fusion in Deep Learning: How GPU Kernels Are Merged
Kernel fusion merges multiple neural network operations into a single GPU kernel to eliminate intermediate memory writes — this article explains how fusion works, why it helps deep learning workloads, and how TensorRT and torch.compile use it.
25 min read
CPython Internals: How Python Really Works Under the Hood
Deep dive into CPython internals: bytecode compilation, memory management, the GIL, object model, and garbage collection.