If some collaborators are not part of your organisation and therefore cannot be authenticated by your identity provider, they can still login with email/password and you can still add them to your Algolia applications.
Single sign on and application permissions are two independent features. If using SSO is a strong requirement, you may want to consider adding your external collaborators to your IDP with a different email domain. Algolia supports multiple email domains on the same IDP.