A parse tree is a hierarchical structure that represents the syntactic structure of a string according to a formal grammar. It is used in computing to analyze the syntax of programming languages and natural languages, ensuring that the input conforms to the rules defined by the grammar.