For those looking, the fix for us was not to use the Provisioning Toolkit to license the suite, but to compile a license file with the Creative Cloud Packager
Creative Cloud Help | Create license file
Tip though, When I started CreativeCloudPackager from /Applications/Utilities/Adobe Application Manager/CCP this option was not available, I had to go a couple of folders deeper to /Applications/Utilities/Adobe Application Manager/CCP/toolkit/CCPLauncher and run that version of CreativeCloudPackager
