You must not try to get back to the Wish House after you get your key; the bearer of that key will wander forever in the forest. Instead, you have a hole behind of the area; go inside and store your key in the box. Go back to the forest and go all the way to the Wish House. There is another hole; go through it to retrieve the key; go back and use it on the nearest locked door.