Protect against some invalid uses of the manifest
There has been two recent breakages of master CI. Both were related to the lack of support for monorepo. This MR does not fix the underlying issue (which would take more than one MR) but instead it prevents future accidental breakages similar to the ones that happened. (Other breakages might be possible.)