Fine-Tuning
[/faɪn ˈtjuːnɪŋ/]
Definitions
The process of further training a pre-trained model on a smaller, task-specific dataset to adapt its behavior for a particular domain or style. Fine-tuning updates the model's weights to make it perform better on specific tasks without training from scratch.
“We fine-tuned the base model on our legal contracts corpus so it could draft clauses in the right style.”
Related Terms
- Synthetic DataAI & Technology
Artificially generated data that mimics the statistical properties of real-world data, used for training or testing AI models. Synthetic data can be created by generative models, r...
- AgenticAI & Technology
Describing AI systems capable of autonomous action, planning, and decision-making. An agentic AI can break down tasks, use tools, and work toward goals with minimal human intervent...
- Chain of ThoughtAI & Technology
A prompting technique where a language model is encouraged or required to show its step-by-step reasoning before providing a final answer. Chain-of-thought prompting significantly ...
- Context WindowAI & Technology
The maximum amount of text (measured in tokens) that a language model can process and "remember" in a single interaction. Information outside the context window is inaccessible to ...
- EmbeddingsAI & Technology
Dense numerical vector representations of words, sentences, or other data that capture semantic meaning. Similar concepts have similar embeddings (nearby in vector space), allowing...
- Few-ShotAI & Technology
A prompting approach where a small number of input-output examples are included in the context to guide model behavior on a new task. Few-shot prompting helps models understand the...