Upper and lower bounds are used in mathematics and computer science to define the limits within which a particular value or function can exist, providing constraints that help in optimization and analysis. These concepts are crucial in fields like algorithm analysis, where they help determine the efficiency and feasibility of algorithms by setting limits on their performance or resource usage.