Floating-point arithmetic is a method of representing real numbers in a way that can support a wide range of values by using a fixed number of digits. It is essential for scientific computations but can introduce rounding errors and precision issues due to its finite representation of numbers.