As far as I know, Pro clones the default env so that you don't accidentally break the things Pro needs to function properly.
Are you just using the Python that came with Pro (Program Files/ArcGIS/Pro/bin/Python), or do you have it installed elsewhere?
In my opinion, if you'd really like to get into conda and different python envs, you should look into something like Anaconda. It makes it easier to set up different python envs that are separate from the Pro installation.
- Josh Carlson
Kendall County GIS