Fix building against an installed lib2geom

Previously this was only working against the submodule, but packagers usually want to use system-wide installed libraries.