From the Domain Rewrite home page do the following:
- Open the Project.
- Click on 'Setup'.
- Click on 'Email Address Rewritting'.
- Select 'No, maybe later'.
- Click on 'Next' > 'Next' > 'Skip Discovery'.
After this, it should be possible to remove rules and connectors from the tenant.