After clicking the go to skull island button on multiple occasionally I have arrived at outside of Avery's court (either I warp into a wall, or into the skyway, once at such great distance from the island I couldn't even see it) and unable to move.This presents an annoying problem since it means I have to wait a minute before I can do anything. Then if I intended to return to the place I warped from I have to click the go back then wait another minute and try again since clicking go to the fountain erases my shortcut back.
I found this to happen only when the realm I was in was crowded.