The general answer to this can be:
Where conditions are ideal for your business to begin with least amount of difficulties, and where it will be able to prosper in an all-round way.
For a small businessman who cannot afford to live in that location physically, but wishes to open a business entity as per the requirement of a business need, and to enter important contracts, to receive legal and tax benefits, privacy and protection of assets, which would become advantageous to the person and his business. It could mean opening your offshore business easily, where you can get an official address, where all the legal requirements can be fulfilled easily, where you can be able to open a bank account, and possibly through the online means.
Of course, there are many various offshore destinations fit for any business to register and begin operations -- either remotely or by being there physically. As far as I know, Belize is one of the best offshore locations, although it has its own downfalls for an internet businessman. So are these locations: Nevis, and British Virgin islands. It is said that those 3 places are the best to incorporate an offshore company for an internet entrepreneur.
The US has some states, best in my opinion being Delaware, where you can easily open an offshore company (LLC) with comparative ease for an average internet entrepreneur. The G20 nations can be considered for overall seriously bigger offshore projects -- but that's a different issue all together.