CUDA (Compute Unified Device Architecture) is a parallel computing platform and application programming interface (API) model created by NVIDIA, allowing developers to use a CUDA-enabled graphics processing unit (GPU) for general purpose processing. It revolutionizes computational tasks by enabling significant performance improvements in fields such as scientific computing, machine learning, and image processing.