It looks like the 4.23 release of arcgis/core changed something that broke release builds using react.
I created a repo that demonstrates the error here https://github.com/melgish/map-issue
The map renders fine while in development mode, but when built for release, the map frame renders, but it never pulls any tiles.
If I downgrade to 4.22.2 and rebuild, everything works as expected.