Efficiency in computation refers to optimizing algorithms and processes to minimize resource usage, such as time and memory, while achieving the desired output. It is crucial for improving performance, reducing costs, and enabling scalable solutions in both software and hardware systems.