Loudly tell that guy to pick up key and try it on the door.
Despite your bellowing, the man casually opens the door and leaves.