You are supposed to.
This has been so since the change over a decade ago. You should’ve been there when it was extremely rampant that tanks and healers just refused to do the dungeons and held the dungeon hostage to get kicked only to requeue into the same one/party again and again or threatened to stay until the rest left, bizarre!
They did recently change it to include even mid-dungeon leaving on community request.