Are you referring to the Bounty debuff or the Assassin debuff? Because you can’t be tracked with an Assassin debuff. As for both, you lose them after either switching the warmode off or relogging. If neither works, then it’s indeed a bug and I suggest contacting a GM about it.