Custom services can be added using the form under Add New Service in the Features section of the dashboard.
Features -> Single Sign on -> Add New Service -> Custom Service
When you reach the Custom Service page you will be presented with a form that you need to fill out to add a custom service.