Grid Search is a hyperparameter optimization technique that systematically builds and evaluates a model for every combination of algorithm parameters specified in a grid. It is computationally expensive but guarantees finding the optimal parameter set within the defined search space.