Finite systems refer to systems with a limited number of states or components, often analyzed in fields like physics, computer science, and mathematics to understand behaviors and constraints. They are crucial for modeling real-world phenomena where resources or elements are inherently restricted, allowing for precise predictions and optimizations.