MPK: A Compiler and Runtime for Mega-Kernelizing Tensor Programs
Xinhao Cheng, Zhihao Zhang, +19
Follow how MPK turns a model into one persistent GPU kernel by tracking dependencies between tasks on individual SMs, with a task-graph explorer, a cross-task pipelining timeline, and a runnable CPU model of its compiler stages.
