The One Definition Rule (ODR) in C++ mandates that each entity (such as a class, function, or variable) must have exactly one definition across all translation units in a program, ensuring consistency and preventing conflicting definitions. Violating the ODR can lead to undefined behavior, making it critical to manage headers and source files carefully in large projects.