Perform the following in order to configure the test:
1. Right-click on the test | Edit
2. Test Settings | Manage Notifications | bottom pane: Notification Groups | Select group | edit | clear the 'Send unlimited notifications for an alarm' check box | Enter the 'Maximum number of notifications to send per alarm'
In order to have monitoring as close as possible to real time set the test to run every 1 or 2 mins. Then set them to send only errors and by specifying the above setting of sending only limited notifications per alarm number of email alerts will be set to the minimum as required.