The exterior angle of a polygon is formed between one side of the polygon and the extension of an adjacent side, and the sum of the exterior angles of any polygon is always 360 degrees. This property is crucial in understanding polygonal shapes and is used in various fields such as architecture, engineering, and computer graphics for designing and analyzing structures.