Symmetric sets are mathematical sets that remain unchanged when their elements are permuted according to a specific symmetry operation, such as reflection or rotation. They are crucial in understanding invariance in mathematical structures and have applications in fields like geometry, algebra, and physics.