There are multiple things going on here.
Natalie Robbins correctly identified she had a custom Python toolbox in the system toolbox directory, and that ENVI toolbox likely didn't have the correct libraries to work with the updated ArcGIS Pro 2.5 Python environment. Installing 3rd party toolboxes into your system toolbox directory can have these negative effects when moving between Pro versions.
William Mayr had you previously cloned and made a custom Python environment? Environments need to be repaired or re-cloned when updating versions of ArcGIS Pro. The Intelligence Tools PYT toolbox is not the problem, that just happens to be the first Python functionality that the application is trying to load, as the system loads all the system toolboxes alphabetically (that is alphabetically the first toolbox in the system toolbox directory built with Python). Removing that PYT will just make the next one in the system toolbox directory fail. You have an underlying Python environment problem that must be remedied to proceed. You may want to contact tech support if none of this Python environment stuff that I mentioned applies to you