Do not try to completely remove the battery from the headset. It is still attached by the cable connector in the top right of the battery recess.

While removing the battery, keep it as close to the recess as possible to prevent straining the cables.

Pull on the tab at the top of the battery to dislodge it from the recess.