Collectively exhaustive events are a set of outcomes in a sample space that cover all possible scenarios, ensuring that at least one of the events must occur. This concept is crucial in probability theory for ensuring comprehensive analysis and accurate calculation of probabilities in any given experiment or situation.