Context vectors are mathematical representations used in natural language processing to capture the meaning of words based on the surrounding text. They enable models to understand word semantics dynamically, improving tasks like translation, sentiment analysis, and information retrieval.