Kimi Delta Attention

KDA: the recurrent state notebook

A token updates a compact state, then moves on. The model remembers the useful signal without carrying every earlier token forward.

tokencurrent input
state 01compact notebook
next tokenthe stream continues
state update · 01
Token → state update → next tokenlive model