The Weight of Attention