The average rate of change of a function over an interval is the difference in the function's values at the endpoints of the interval divided by the difference in the endpoints themselves. It provides a measure of how much the function's output changes per unit change in input over that interval, analogous to the concept of slope for linear functions.