Infinitesimals are quantities that are infinitely small and approach zero but are not zero, playing a crucial role in calculus and mathematical analysis. They provide a foundation for understanding derivatives and integrals by allowing the examination of changes and areas at an infinitely small scale.