H. Alex Huskey, pretty much exactly what you described happens once per release, most recently in October 2019 for the Pro 2.5 release that will be publicly available early 2020. We call the process Holistic Testing, as you look at not just one area of the software but usage across all the functional areas necessary to get your job done.
Roughly 25 individuals from primarily the U.S., across every industry, join us at Esri development headquarters in Redlands, CA for a week of testing your workflows with your data in a new software release, and reporting problems you find directly with the development teams. It is hands-on full days of testing and talking between you and the dev teams, and extremely useful for us to see the work you are doing and any struggles you are having. It's the closest you can get to the zoo animals, outside of the User Conference showcase floor
If you want more information about participation send me an email at dflater@esri.com.