global attention

Language: en

📖 Definitions

  1. The state of being noticed, observed, or focused upon by the entire world or the international community.; A mechanism in neural networks, particularly Transformers, where every element in an input sequence attends to every other element.

💬 Examples

  1. In the high-stakes arena of international football, two diminutive island nations are capturing global attention.

  2. The Transformer model uses global attention to process long sequences effectively.