A probability simplex is a geometric representation of a probability distribution over a finite set of outcomes, where each point within the simplex corresponds to a possible distribution. It is a subset of a Euclidean space defined by the conditions that the coordinates are non-negative and sum to one, reflecting the properties of probabilities.