Attention Mechanism

A model component that weighs the relevance of different parts of an input while producing an output.