This is just normal behaviour. While your dataset may be small and nothing to worry about, just imagine what would happen if ArcGIS would load a 100M records layer of 25GB file size stored in an enterprise geodatabase over your organization's network of 100Mbps... You would be waiting for at least 25000/(100/8)=2000 seconds, so close to 30 minutes / half an hour, before your attribute table would appear. And that assumes you will get the full 100Mbps, which you probably rarely will. So pulling all records from a large database table is not something you want to customarily do.
... View more