A change of basis matrix is used to convert the coordinates of a vector from one basis to another within a vector space, facilitating transformations between different coordinate systems. It is constructed by arranging the new basis vectors as columns, and its inverse can be used to revert to the original basis.