Queue underflow occurs when an attempt is made to dequeue an element from an empty queue, resulting in an error or exception. It is a critical condition to handle in data structures to ensure robust and error-free software operations.