The foramen ovale is an opening in the septum between the right and left atria of the fetal heart, allowing blood to bypass the non-functioning fetal lungs. It typically closes soon after birth, becoming the fossa ovalis, but if it remains open, it can lead to a condition known as patent foramen ovale (PFO).