When I remove a join from a feature class, the attribute table fields are refreshed to display only the fields in the feature class but the attribute dialog window should also refresh so that the joined fields no longer display in this window.
The work-around for this is to remove the join, save and close the project, reopen the project, re-select the feature(s), and reopen the attribute window.