Workaround 1
In Archive Manager reduce the number of mailboxes that the connection account has access to.
Workaround 2
Assuming "Forms based Authentication" is being used.
Use the DEFAULT\Admin account when connecting to your Archive Manager instance.
When using that account it does not need to go through and check all the permissions for each mailbox and should load a lot faster.
Workaround 3
Assuming "Forms based Authentication" is being used.
1. Create a new account in Archive Manager with access to a fewer number of Mailboxes.
2. Log on to Archive Manager as an admin and go to Administration | Logins
3. Select "Click Here to Add a Login"
4. Fill out the information and choose "Add".
5. Select "Mailboxes" and assign this new user only the mailboxes which are required.
6. Add a new source Archive Manager source storage, use "Forms Authentication" and use the user name and password of the new account.