Attention Mechanism

A routing system in neural networks that decides which parts of the input inform each output. Not just "looking at the right things" — it is the load-bearing structure of information flow in a transformer.