Object Queries in DETR
Follow spatial image features into DETR decoder slots, separating learned query embeddings, attention queries, changing content and object predictions.
Related
6 min read · beginner
Clear explanations of core machine learning concepts, from foundational ideas to advanced techniques. Understand attention mechanisms, transformers, skip connections, and more.
Follow spatial image features into DETR decoder slots, separating learned query embeddings, attention queries, changing content and object predictions.
6 min read · beginner
Explore how prompt token positions connect through causal self-attention, and why connectivity and attention weights do not establish causal influence.
5 min read
NVIDIA vs AMD for deep learning compared at both layers: the CUDA vs ROCm software moat, the microarchitecture (warp vs wavefront, SM vs CU, Tensor vs Matrix Cores), and the datacenter accelerators (H100/H200/B200 vs MI300X/MI325X).
10 min read · intermediate
How C++ object files are linked into executables. Learn symbol resolution, static vs dynamic linking, and linker optimization.
5 min read
XFS internals end-to-end: allocation groups for lock-free parallel metadata, B+ trees instead of bitmaps, extent-based allocation that scales to terabytes, and delayed allocation that turns scattered writes into contiguous extents.
10 min read
Trace a cached decode step, separate saved projections from growing attention work, and calculate KV-cache memory with explicit dimensions.
6 min read · intermediate