Answer: Sodium is so reactive that it catches fire in air, so it is kept under kerosene to keep air and moisture away.
Sodium reacts vigorously with the oxygen and moisture of air, and even with carbon dioxide, giving out a lot of heat; this heat may set the metal on fire. Kerosene does not react with sodium and its layer cuts off contact with air and water vapour, so the metal remains safe.