Edited because I found my solution:
I'm trying to create a simple website with an embedded ArcGIS online map and scroll wheel zooming doesn't work. To test this out I created a very simple html file that contains only the arcgisonline iframe but it does not work as I would like. What am I missing?
Based on this thread adding the following parameter at the end of my map source URL fixed it for me: