An IP datagram is a fundamental unit of data transfer in the Internet Protocol (IP), encapsulating data with necessary header information for routing and delivery across networks. It is designed to be connectionless and allows for data to be sent independently of any established path, relying on routers to forward the datagram based on its destination IP address.