It does make sense, though you will have trouble finding a bank for offshore companies. As long as you pay your taxes you should be fine.
But keep something in mind: since your customers are most likely from a high-tax-county as well, they might have problems with your offshore invoices...