Gauss-Jordan Elimination is an algorithm used to solve systems of linear equations by transforming the matrix into its reduced row echelon form. This method extends Gaussian elimination and involves row operations to achieve a diagonal matrix with leading coefficients of one, simplifying the solution of linear systems.