Convergence in distribution, also known as weak convergence, occurs when the cumulative distribution functions of a sequence of random variables converge to the cumulative distribution function of a random variable at all continuity points of the limit distribution. It is a fundamental concept in probability theory, particularly in the context of the Central Limit Theorem and statistical inference, as it allows for the approximation of complex distributions by simpler ones as the sample size increases.