Self-attention
♛ PRO Part of the Machine Learning pack · 40 icons
- Every Pro pack, plus future ones
- Icon editor and recolour
- Molecules, Proteins, Gel Builder and Well Plate exports
- Use in papers, talks and commercial work
$49 one-time (₹2,999 in India) · lifetime access · no subscription
Pro keeps the free library free.
Self-attention: each token attends to every other token, with different attention heads learning different patterns
Self-attention illustration showing each token attends to every other token, with different attention heads learning different patterns. Handy for explaining transformer in machine learning presentations, theses, posters and course notes. Editable SVG from the Machine Learning Pro pack, with grouped layers you can recolor.
Format: SVG (editable vector). License: Sciicons Pro license. Courtesy: Sciicons. Part of the Machine Learning pack.
Keywords: Machine Learning Pack, Sciicons Pro, self-attention, attention heads, multi-head attention, tokens, transformer, attention weights, machine learning, artificial intelligence, ai, deep learning, data science