When I select my map from ArcGis Online, the layer only shows when zoomed in really close, when I zoom out the layer does not show
This sounds like the reference layer has a visibility range set in in ArcGIS Online. If you are the owner of the layer, you can change this on the layer item page´s visualization tab.
