Maybe I'm butchering the Seinfeld reference, but holy schneikes, it's version 3.4, approximately 13 years since the inception of ArcGIS Pro.
QGIS has no issues removing lock files after removing the shapefile from a map, and it's not even their data model.
It's debilitating, ESRI for the love of god, figure out how to remove lock files when the file is removed from a map.
Have an emergency meeting, lock down the development team for a Saturday, and patch this already.
Dang Dude.