Infinite solutions occur in mathematical systems when there are more variables than independent equations, or when the equations are dependent, resulting in a solution set that forms a continuum. This typically happens in linear algebra with systems of linear equations, where the solution space is a line, plane, or higher-dimensional subspace within the vector space.