A compact set in a topological space is one where every open cover has a finite subcover, which implies that the set is both closed and bounded in Euclidean spaces. This property is crucial in analysis and topology because it ensures that continuous functions defined on compact sets are bounded and attain their extrema.