NVIDIA and Princeton Introduce ReplaySSM to Accelerate Hybrid AI Model Decoding
NVIDIA and the Dao AI Lab at Princeton University released ReplaySSM, a technique that accelerates decoding in hybrid language models by caching recent inputs rather than storing the full state-space model (SSM) state at every […]
