Function invariance refers to the property of a function where its output remains unchanged under certain transformations of its input. This concept is crucial in fields like machine learning and mathematics, where understanding invariance can lead to more robust models and deeper insights into the structure of problems.