Single-head attention

Single-head attention

A physics and math diagram titled Single-head attention, related to attention mechanism. It works well in machine learning figures, teaching materials and conference posters that explain transformer. Free SVG download under MIT. Credit: Janosh Diagrams.

Format: SVG (editable vector). License: MIT. Courtesy: Janosh Diagrams. Free to download and copy, no sign-in needed.

Keywords: JanoshDiagrams, MIT, diagram, mathematics, machine learning, attention mechanism, attention is all you need, transformer, Single-head attention, single-head-attention

Related machine learning illustrations

• 2d Convolution
• Atomistic GPU Batching
• Autoencoder
• Aviary Logo
• Ball Tree
• Convolutional Autoencoder
• Dropout
• Four Vs of Data
• GNN Node Aggregation
• Graph Attention Layer
• Graph Convolution
• In-Flight Auto-Batcher