A residual graph represents the leftover capacities in a flow network after determining the current flow of each edge, allowing for the construction and augmentation of alternative paths to maximize network flow. It plays a crucial role in algorithms like the Ford-Fulkerson method, facilitating adjustments to routes and capacities until optimal flow is achieved.