Why do we store very reactive metals such as potassium and sodium in oil?

What kind of oil is it?

Because those reactive metals are SO reactive that they will react with oxygen of the air to form the oxide meaning that you no longer have the metal available. What kind of oil? Any kind to keep the air/oxygen away from it. I have even seen it stored under kerosene although I don't recommend that.