Python Bytecode Compilation
Explore CPython bytecode compilation from source to .pyc files. Learn the dis module, PVM stack operations, and Python 3.11+ adaptive specialization.
No direct links0 refs
⚙️
Language & Framework Internals
How CPython, C++, and PyTorch work under the hood: bytecode, memory, linking, and concurrency.
31
Concepts
All Language & Framework Internals Concepts
PyTorch DataLoader Pipeline
PyTorch DataLoader deep dive — Dataset, Sampler, Workers, Collate internals, num_workers throughput profiling, memory analysis, serialization costs, production patterns (LMDB, WebDataset), and bottleneck diagnosis.
No direct links0 refs
C++ Stack vs Heap Memory: A Complete Guide
Deep dive into C++ memory allocation — stack frame internals, heap allocator mechanics, fragmentation, performance benchmarks, custom allocators, RAII, and debugging with AddressSanitizer and Valgrind.
No direct links0 refs
Python Memory Management
A practical mental model for CPython memory management: names and references, object headers, PyMalloc arenas, reference counting, reuse paths, and memory profiling.
No direct links0 refs
Python Global Interpreter Lock (GIL)
Understand CPython Global Interpreter Lock (GIL): thread switching, CPU vs I/O workloads, multiprocessing workarounds, and PEP 703 no-GIL future.
No direct links0 refs
Pinned Memory and DMA Transfers in PyTorch
Complete guide to PyTorch pin_memory — how DMA transfers work, when pinning helps vs hurts, NUMA effects, profiling with torch.profiler, num_workers interaction, and debugging slow data loading.
No direct links0 refs
C++ Symbol Resolution: How the Linker Connects Your Code
Complete guide to C++ symbol resolution — how linkers match references to definitions, name mangling, strong vs weak symbols, ODR, template instantiation, linking order, and debugging undefined reference errors.
No direct links0 refs
C++ Program Loading: From ELF to Running Process
How C++ programs are loaded — ELF segments, the _start to main() chain, dynamic linking with PLT/GOT, ASLR, real readelf/strace/proc maps output, and startup debugging.
No direct links0 refs
Python Object Model Internals
Learn how CPython implements PyObject, type objects, and the unified object model. Explore reference counting, memory layout, and Python internals.
No direct links0 refs
Python Garbage Collection
Understand CPython garbage collection: reference counting, generational GC for circular references, weak references, and gc module tuning strategies.
No direct links0 refs
Python Optimization Techniques
Learn a profiler-first Python optimization workflow: measure bottlenecks, choose the right lever, and verify performance changes.
No direct links0 refs
Python __slots__ Optimization
Learn when Python __slots__ reduces memory, how slot storage differs from __dict__, and the caveats for dataclasses and inheritance.
No direct links0 refs
Python Green Threads vs OS Threads
Complete guide to Python concurrency — OS threads, green threads (asyncio), the GIL, event loop internals, Python 3.13 free-threading, and production patterns.
No direct links0 refs
Python asyncio Event Loop
Deep dive into Python's asyncio library, understanding event loops, coroutines, tasks, and async/await patterns with interactive visualizations.
No direct links0 refs
Python Shared Memory
Master Python multiprocessing.shared_memory for zero-copy IPC. Learn synchronization, NumPy integration, and race condition prevention patterns.
No direct links0 refs
Thread Safety: Concurrent Programming Fundamentals
Complete C++ thread safety guide — race conditions with step-through simulation, mutexes, atomics, condition variables, deadlock detection, memory ordering, and Thread Sanitizer walkthrough.
No direct links0 refs
C++ AST & Parsing Explained
Explore how C++ code is parsed into an Abstract Syntax Tree (AST). Learn lexical analysis, tokenization, and syntax parsing for systems programming.
No direct links0 refs
C++ Compilation Overview
Understand the complete C++ compilation pipeline from source code to object files. Learn preprocessing, parsing, code generation, and optimization stages.
No direct links0 refs
C++ Dynamic Linking at Runtime
Deep dive into dynamic linking — GOT/PLT lazy resolution, shared library creation, SONAME versioning, RPATH/RUNPATH, dlopen plugin systems, LD_PRELOAD, and debugging with LD_DEBUG.
No direct links0 refs
C++ Linking Overview
How C++ object files are linked into executables. Learn symbol resolution, static vs dynamic linking, and linker optimization.
No direct links0 refs
Memory Management & RAII in C++
Learn Resource Acquisition Is Initialization (RAII) - the cornerstone of C++ memory management. Understand automatic resource cleanup and exception safety.
No direct links0 refs
Modern C++ Features (C++11 and Beyond)
Explore modern C++ features including auto, lambdas, ranges, and coroutines. Learn how C++11/14/17/20 transformed the language.
No direct links0 refs
Object-Oriented Programming in C++
Master C++ OOP concepts including inheritance, polymorphism, virtual functions, and modern object-oriented design principles with interactive examples.
No direct links0 refs
C++ Compiler Optimization
C++ compiler optimization lab notebook — compare optimization levels, inspect compiler rewrites, diagnose auto-vectorization, and build production verification commands.
No direct links0 refs
Pointers & References in C++
Master C++ pointers and references through interactive visualizations. Learn memory addressing, dereferencing, smart pointers, and avoid common pitfalls.
No direct links0 refs
C++ Preprocessor Directives
C++ preprocessor visualized: macros, header guards, conditional compilation, and #include directives explained interactively.
No direct links0 refs
Smart Pointers in Modern C++
Master C++11 smart pointers through interactive examples. Learn unique_ptr, shared_ptr, and weak_ptr with reference counting visualizations.
No direct links0 refs
Templates & STL in C++
Master C++ templates and the Standard Template Library. Learn generic programming, template metaprogramming, and STL containers and algorithms.
No direct links0 refs
DataParallel vs DistributedDataParallel
Compare PyTorch DataParallel vs DistributedDataParallel for multi-GPU training. Learn GIL limitations, NCCL AllReduce, and DDP best practices.
No direct links0 refs
Understanding num_workers
Deep dive into PyTorch DataLoader num_workers parameter: how parallel workers prefetch data, optimal configuration, and common pitfalls.
No direct links0 refs
C++ Virtual Tables & Inheritance
C++ virtual tables (vtables) explained. Learn virtual dispatch, single/multiple inheritance, RTTI, and object memory layout visually.
No direct links0 refs