Connected components in a graph are subgraphs where any two vertices are connected to each other by paths, and which are connected to no additional vertices in the supergraph. Identifying connected components is crucial for understanding the structure of a graph, enabling tasks like network analysis, image segmentation, and clustering in data science.