People who shouldn't use bergamot essential oil topically include anyone heading into direct sunlight or UV rays, as cold-pressed bergamot is naturally phototoxic. It is also commonly avoided by young children, pregnant women, and those with sensitive skin.