#attention

Rascunho de traducao automatica (Portuguese) for "Transformer": A neural network architecture introduced in 2017 ("Attention Is All You Need") that underlies virtually all modern language models. Transformers use self-attention mechanisms to process entire sequences in parallel, capturing long-range dependencies that earlier recurrent architectures struggled with.

“Exemplo em rascunho: Every major LLM from GPT to Claude is built on the transformer architecture.”