Image Patches and Patch Embeddings
Turn an image into a sequence: count patches, flatten pixels, apply a shared learned projection, and separate token count from embedding width.
Related
6 min read · beginner
Clear explanations of core machine learning concepts, from foundational ideas to advanced techniques. Understand attention mechanisms, transformers, skip connections, and more.
Turn an image into a sequence: count patches, flatten pixels, apply a shared learned projection, and separate token count from embedding width.
6 min read · beginner
Master prompt engineering for large language models: from basic composition to Chain-of-Thought, few-shot, and advanced techniques.
5 min read
How sched/backfill works — the algorithm that lets small jobs run in gaps while large jobs wait, why accurate time limits matter, and the key tuning parameters (bf_interval, bf_window, bf_max_job_test).
7 min read · intermediate
Follow Linux shared libraries from dependency lookup to PLT/GOT binding, then build a versioned library, load a plugin and debug runtime linking failures.
20 min read · intermediate
Master ZFS filesystem with pooled storage, RAID-Z, snapshots, and checksums. Learn enterprise-grade data integrity on Linux.
20 min read · intermediate
Follow the same Q, K and V through dense and tiled attention. See online softmax preserve the output while avoiding global score and probability matrices.
10 min read · advanced