We would get bombarded by cosmic radiation, whether it be form our own sun or other sources of radiation. Water would quickly evaporate and turn into giant storms that would form disasters unknown to mankind, plants would have all shrivelled up and died, winds would have blown with cataclysmic speed (equal to the power of several hydrogen bombs) causing the hot storms to move rapidly while most of the earth's surface and man built structures would have been swept away and get decimated. Eventually turning cold and settling down as the Earth becomes Venus 2.0.
TL;DR: You either die quickly or horribly.
What if there was no such thing as plants?