SSO Sign up forbidden

When using the SSO and disabling "Enable registration of new users" it returns "New signups are fobidden" I don't want normal user signups, but support the sign up via SSO