AI Radar
Top stories
Importance 2 of 5Covered by 1 source

Weighted State Souping for Efficient Long-Context Retrieval

This paper was accepted at the Workshop on Personalized, Aligned, Long-term Memory for AI Systems (PALM) at NeurIPS 2026. State space models (SSMs) combine fast inference and fixed state size with competitive language-modeling performance. Recently, state souping has been proposed as a procedure whereby an SSM…