Thoughts
Oh yeah for the record I think that if you get out the door on level 4 you can leave the dungeon without going back to level 1.
Edit (Dec 2): Pearl got behind the door a day before I posted this lol. I still think it maybe possible to get out from level 4 directly but it's more complicated than just opening the big door.