That's the idea, yes. Pay absolute minimum you can for the certificate. You can technically avoid paying a salary and just pay the minimum social tax.
Otherwise, you need to pay social tax in Slovenia, which is relatively high.
In the EU if you have social insurance in one country, you are anyway covered across the whole EU.