I am not sure whether it's a bug or not, as I am pretty confident that you can query against non-domain values bypassing clause mode and using SQL.
Let's wait for some ESRI dev to tell us if it is on purpose or not, it seems to me that it might be a design decision to list all and only valid domain values in the clause editor, while I agree that it might be confusing especially coming from ArcMap.