You don't have to report overseas bank accounts or assets, but you do have to report worldwide income. If you transfer money that has already been taxed out of NZ, you don't need to tell NZ where it is. If that money now earns interest, then you do have to report it.
The AEOI will tell NZ that...