We have quite a lot of customers who use ExB in an "offline" (meaning internal protected network) scenario. Usually we set up a self-hosted CDN and point the ExB to it, which is documented. But using ESM instead of CDN would actually be pretty great, as it could just be installed with the packages we need to install anyway for the Dev Edition.
Loading only necessary modules would have further implications for the JIMU framework, but the main reason for this idea is not to bring down the size of the application. The main reason is to get rid of CORS and other networking issues and server requirements for the installation of the self-hosted CDN JSAPI.