Storage hierarchy is a structured arrangement of storage solutions in a computing system, organized by speed, cost, and capacity, to optimize performance and efficiency. It balances the trade-offs between fast, expensive storage and slower, cost-effective storage to meet the needs of different applications and data types.