cmake: give different build directories for the submodules
Trying to make CMake pass with all warnings as errors on the CI