Multi-valued functions are functions that can return multiple values for a given input, often occurring in complex analysis and involving branch cuts to define single-valued branches. They challenge the traditional definition of a function, which typically associates each input with exactly one output, and require careful handling to ensure mathematical consistency.