Good question.
It doesn't seem to have ever been a problem for me, but I wax/seal so often that I never have a durability problem anyway.
Many wash products do seem to leave something on the paint. The finish often sheets water, feels slicker, looks more glossy.
If I'm doing a full detail using a paint cleaner, I feel confidant that it is no problem. When doing just a wash and wax, it doesn't seem to be a problem for me, but I really can't say for sure.