A CPU burst refers to a period during which a process is actively using the CPU, performing computations without waiting for input/output operations. Understanding CPU bursts is crucial for optimizing CPU scheduling and improving system performance by minimizing wait times and maximizing throughput.