Explore machine learning papers and reviews related to Sequence Modeling. Find insights, analysis, and implementation details.
Aakash Lahoti, Kevin Y. Li, +6
Derive Mamba-3’s two-endpoint recurrence, data-dependent rotations and MIMO state writes, then examine its state-tracking, retrieval and inference evidence.
Albert Gu, Karan Goel, +1
From HiPPO memory to bilinear dynamics, equivalent recurrent and convolutional execution, and the DPLR kernel construction that makes S4 practical.
Jimmy T. H. Smith, Andrew Warrington, +1
Derive S5 from S4: shared MIMO state, diagonal dynamics, exact discretization, associative scans and HiPPO initialization, with interactive diagrams and executable Python.
Albert Gu, Tri Dao
Trace Mamba through input-dependent state updates, associative scanning, the complete block, persistent decode buffers and runnable CPU code.