ICLR 2023
S5: Simplified State Space Layers for Sequence Modeling
Jimmy T. H. Smith, Andrew Warrington, +1
Derive S5 from S4: shared MIMO state, diagonal dynamics, exact discretization, associative scans and HiPPO initialization, with interactive diagrams and executable Python.