Totally, it is only really a problem if you want to spend significant time in a western high tax country. Most of the world - even if they on paper have worldwide taxation with some sort of criteria for being tax resident - operates with de facto territorial taxation.
In Subsaharan Africa, typically almost half of government income comes from import and export duties, and the rest is tax on large companies, and on tangible stuff like property and small businesses that have︀ a premise, and a bit of VAT and income tax on the formal sector. And︁ then you have a large informal sector, and no such thing as a personal tax︂ return, and absolutely no de facto taxation on anything outside the country.
Was just talking︃ to a friend with a formal job in a subsaharan African country with on paper︄ worldwide taxation. So I was asking, doesnt it suck to pay so much tax. He︅ was like "oh yeah, but I only take the minimum salary here to get residence,︆ and the rest is paid in Mauritius, and I dont live in Mauritius so there︇ is no tax there."