Characteristic X-rays are emitted when an inner-shell electron in an atom is ejected and an electron from a higher energy level fills the vacancy, releasing energy in the form of X-ray photons. These X-rays have specific energies unique to each element, making them useful for identifying elemental composition in various materials through techniques like X-ray fluorescence spectroscopy.