A transition matrix is a square matrix used to describe the transitions of a Markov chain, with each element representing the probability of moving from one state to another. It is fundamental in modeling stochastic processes where future states depend only on the current state, not on the sequence of events that preceded it.