Drilling for oil is also expensive and leaves you with nothing again the moment you have burnt it.

Yes, but more importantly (imho, and ignoring, y'know, fucking up the environment): every drop of oil produced just delays the transition to renewables, and the longer it's left the more painful it will be.