Discrete distributions describe the probability of outcomes in a finite or countably infinite sample space, where each outcome has a non-zero probability of occurring. They are essential in modeling scenarios where outcomes are distinct and separate, such as the number of heads in coin tosses or the number of defects in a batch of products.