Probability distributions describe how the values of a random variable are distributed, providing a mathematical function that assigns probabilities to each possible outcome. They are essential in statistics and data analysis for modeling uncertainty and making predictions about future events or data patterns.