Switch port modes determine how a switch port handles traffic, defining whether it operates in access mode for a single VLAN or trunk mode for multiple VLANs. Proper configuration of switch port modes is crucial for network segmentation, security, and efficient traffic management in a VLAN-based network environment.