Transformer
[/trænsˈfɔːrmər/]
Definitions
Brouillon de traduction automatique (French) for "Transformer": A neural network architecture introduced in 2017 ("Attention Is All You Need") that underlies virtually all modern language models. Transformers use self-attention mechanisms to process entire sequences in parallel, capturing long-range dependencies that earlier recurrent architectures struggled with.
“Exemple en brouillon: Every major LLM from GPT to Claude is built on the transformer architecture.”
Related Terms
- Neural NetworkAI & Technology
Brouillon de traduction automatique (French) for "Neural Network": A computational model loosely inspired by biological neurons, consisting of interconnected layers of mathematical...
- Diffusion ModelAI & Technology
Brouillon de traduction automatique (French) for "Diffusion Model": A class of generative AI model that learns to create images, audio, or video by reversing a noise-adding process...
- RAGAI & Technology
Brouillon de traduction automatique (French) for "RAG": Retrieval-Augmented Generation - An AI architecture pattern that combines a language model with external knowledge retrieval...
- AgenticAI & Technology
Brouillon de traduction automatique (French) for "Agentic": Describing AI systems capable of autonomous action, planning, and decision-making. An agentic AI can break down tasks, u...
- AI AlignmentAI & Technology
Brouillon de traduction automatique (French) for "AI Alignment": The research field focused on ensuring that AI systems pursue goals that match human values and intentions. A misal...
- Chain of ThoughtAI & Technology
Brouillon de traduction automatique (French) for "Chain of Thought": A prompting technique where a language model is encouraged or required to show its step-by-step reasoning befor...