Numerical systems are structured methods for representing numbers, which provide the foundation for arithmetic operations and computational algorithms. They vary across cultures and history, with the most prevalent being the decimal system, although binary, octal, and hexadecimal systems are crucial in computing contexts.