Memory fragmentation occurs when free memory is split into small, non-contiguous blocks, leading to inefficient memory allocation and potentially causing a system to run out of usable memory despite having enough total free space. This can degrade system performance and is a common issue in systems with dynamic memory allocation, such as operating systems and database management systems.