I have shared an item with the Public, but the different download options are not available.

The Settings for the item does allow the data to be exported in different formats:

If the user does sign into their ArcGIS Online account the different download options become available. This doesn't seem like the way the download options on the item details page of a publicly shared item should work and seems like a bug.