pre-training
UK[ˌpriːˈtreɪnɪŋ]US[ˌpriːˈtreɪnɪŋ]
n
The process of training a machine learning model on a large, general dataset before further training on a more specific task.
adj
Relating to or involving such a process.
Morpheme Breakdown
pre
training
pre
before
training
instruction
Etymology
The word 'pretraining' is a modern compound formed within the specialized field of artificial intelligence. It combines the Latin-derived prefix 'pre-', meaning "before," with the English noun 'training', which itself originates from the Old French 'trainer' (to drag, draw, pull) and ultimately the Latin 'trahere' (to pull, draw). The logic is transparently literal: 'pre-training' refers to an initial, foundational phase of instruction that occurs before the main, task-specific training. This compound elegantly applies the classical concept of preparatory action to the contemporary process of conditioning a computational model on broad data, establishing a base of general knowledge prior to specialized refinement.
Analysis
Structure: pre (before) + training (instruction)
- pre: A prefix of Latin origin (from Latin 'prae'), meaning "before" in terms of time, place, order, or importance. It functions as a modifying prefix.
- training: A noun of English origin, derived from the verb 'train'. Its core sense is "the action of teaching a person or animal a particular skill or type of behavior." In this compound, it functions as the core concept being modified.
Examples
The model's performance improved significantly after extensive pretraining on a vast text corpus.
We used a pretraining phase to teach the network basic visual features.
The pretraining weights serve as a useful starting point for various downstream tasks.