I completely removed all addons, still the same issue.
However, I did try to rename the WTF and Cache folders (WTFOld, CacheOld) and now seems back to normal.
Dunno if that fixed it or if it’s just a coincidende.
UPDATE: Nevermind, after changing areas the latency appeared again, from los 30s to 700ms. So renaming the folders and entirely removing all addons dind’t work either.