Underdamping occurs in a dynamic system when the damping is insufficient to prevent oscillations, leading to a response that overshoots and oscillates before settling to equilibrium. This behavior is characterized by a damping ratio less than one, resulting in a system that returns to stability more slowly than critically damped systems.