Trinity S³AI
Attention: how a word decides which other words to read
Two heads of attention over three positions: each row is how much one query reads each key. Switch on the causal mask and a position can no longer read the future.
Trinity S³AI
Two heads of attention over three positions: each row is how much one query reads each key. Switch on the causal mask and a position can no longer read the future.