I think the answer is more complex as, for example, if you were a Nevis company operating in the US, or servicing US customers, you'd be exposed to lawsuits in the US courts, and they're pretty good at reaching your assets.
It is possible to get bank accounts for Caribbean companies, but it is...