A gravity anomaly represents the difference between the observed gravity at a location and the theoretically predicted gravity, accounting for the Earth's shape and rotation. It is crucial for understanding the Earth's internal structure, including variations in density and the distribution of mass beneath the surface.