I don't believe there is a way to remove this button. It's built into Map Viewer and is kind of standard unfortunately.
Like Jon says, that is embedded functionality so there's no user setting to remove it. One alternative would be to use one of the Instant App templates which load popup content into a side column adjacent to the map rather than as a popup in the map.