Memory overhead refers to the additional memory resources required by a computer program beyond the actual memory needed to store the program's data. It arises from factors such as data structure alignment, memory management, and the overhead introduced by operating systems and runtime environments to facilitate efficient program execution.