Selective signal flow

AttnRes: selective residual retrieval

The current layer can retrieve the earlier signals it needs instead of treating every residual as equally important.

earlier layerscurrent4791112Hover a line · brighter means more retrieved signal
Layer 12live model