ItemUpdater does dupe item when it's in the players offhand

When you update an item's ItemUpdater Version setting in the item's config like so:

Item:
  Id: WOODEN_SWORD
  Display: '&6Item'
  ItemUpdater:
    Version: 1
    PreserveStatRatio: true

->

Item:
  Id: WOODEN_SWORD
  Display: '&6Item2'
  ItemUpdater:
    Version: 2
    PreserveStatRatio: true

And you log out while holding the item in the offhand (before doing the change Verison 1 -> 2):

After you have updated the version in the config, you will get another (duped!) item in your inventory, and the item in the offhand will NOT get removed. You can do this as many times as you hold the item in the offhand:

Please fix this, by also removing the old item from the offhand!