We pull them right back on when play restarts.
The only requirement is that they leave the field (if play was stopped for them, unless they are a keeper).
I've seen players waved right back on and I've seen refs make them wait. If it isn't in the laws, I don't see what the 4th official doesn't just send them back on when ready.