Announcement_13
New preprint!
Why Shared Attention Vectors Fail: A Case for Outcome-Indexed Tuning. When attention is learned from summed gradients across several outcomes, a shared attention vector becomes unstable. I derive when this happens and propose an outcome-indexed architecture that fixes it. Read it on arXiv.