What is supposed to happen is the player who knocked over the pieces sets the pieces up again (with any hand) on their own time. That's fair enough.