An orthogonal matrix is a square matrix whose rows and columns are orthogonal unit vectors, meaning it preserves the dot product and hence the length of vectors upon transformation. This property implies that the inverse of an orthogonal matrix is its transpose, making computations involving orthogonal matrices particularly efficient and stable in numerical analysis.