Dungeon items are supposed to be removed after leaving the dungeon but if you put it in your offhand it won't get removed.
