You and your keys need to be on the same side of the door.