Language models are computational models that predict the probability of a sequence of words, enabling machines to understand and generate human language. They are foundational in natural language processing tasks such as translation, sentiment analysis, and text generation, and have evolved with advancements in deep learning architectures like transformers.