Bayesian statistics is a statistical paradigm that updates the probability for a hypothesis as more evidence or information becomes available, using Bayes' theorem as its foundation. It contrasts with frequentist statistics by incorporating prior knowledge or beliefs, expressed as a prior distribution, into the analysis to produce a posterior distribution that reflects both the prior information and the new data.