The "Menu" widget allows for icon only:
This is great, because it looks nice:
But without Alt Text, it is pure mystery-meat-navigation, which isn't a good thing.
For example, take the image widget which does allow Alt Text. When you hover, you get this popup:
