Have look to IRD : A Simple Guide on The Territorial Source Principle of Taxation in order to understand taxation in HK.
To make it simple, if you have a private office, employees, clients, suppliers, etc. located in HK, for sure the IRD will consider you have to pay profit tax.