How to manage ‘FixShortcuts’ process for large EV archives (4301121)

Overview

Stage 2 command FixShortcuts with option ‘Use EWS for Processing’ selected may fail or even the whole Shortcut Process module may crash due to OutOfMemoryExceptions error.
This issue may occur in case FixShortcuts command is executed on large EV archives with the count of items 500,000 and higher.
Examples of error messages in Shortcut Process module log file on trace:

2015-09-09 15:34:21Z|1175| 45|ERROR| CallService|[test.user@doamin.com]: Exception during call to Exchange Service. System.String InternalSubString(Int32, Int32)
Exception of type 'System.OutOfMemoryException' was thrown.
at QUADROtech.ExchangeWebServices.Connection.EWSExecutor.CallService(Action`2 actionToExecute, String smtpAddress)
at ArchiveShuttle.Module.ShortcutPostprocessModule40.EWS.FixShortcutProcessor.ProcessItems(IEWSExecutor executor, String smtpMailbox, IEnumerable`1 shortcutItems)
at ArchiveShuttle.Module.ShortcutPostprocessModule40.EWS.ShortcutCoreCheckResultProcessor.ProcessSearchResult(IEWSExecutor ewsExecutor, ISearchContainer container, ISearchCollectionResult`1 searchResult, ICancelationToken cancelationToken)

ProcessSearchResult|Transmitting [697] shortcut results to Core and waiting for answer
276364: 2015-09-09 15:31:47Z|1175| 80| INFO|                               ProcessSearchResult|Got answer from Core. We need to process [697] items out of [697]
276365: 2015-09-09 15:31:47Z|1175| 80|TRACE|                               ProcessSearchResult|[test.user@domain.com] Processing items in chunk of size [100]
276421: 2015-09-09 15:31:48Z|1175| 68|TRACE|                               ProcessSearchResult|Procesing search only (no processing) for [test.user@doamin.com]
276422: 2015-09-09 15:31:48Z|1175| 68| INFO|                               ProcessSearchResult|Transmitting [5] shortcut results to Core and waiting for answer
276431: 2015-09-09 15:31:48Z|1175| 63| INFO|                               ProcessSearchResult|Got answer from Core. We need to process [5] items out of [5]
276432: 2015-09-09 15:31:48Z|1175| 63|TRACE|                               ProcessSearchResult|[test.user@domain.com] Processing items in chunk of size [5]
276748:    at ArchiveShuttle.Module.ShortcutPostprocessModule40.EWS.ShortcutCoreCheckResultProcessor.ProcessSearchResult(IEWSExecutor ewsExecutor, ISearchContainer container, ISearchCollectionResult`1 searchResult,
ICancelationToken cancelationToken)
276762: 2015-09-09 15:34:22Z|1175| 45| WARN|                               ProcessSearchResult|[test.user@domain.com]Unable to process shortcut items [Reason: Exception of type 'System.OutOfMemoryException' was thrown.].
276764: 2015-09-09 15:34:22Z|1175| 45|TRACE|                               ProcessSearchResult|[test.user@domain.com] Processing items in chunk of size [100]
276872: 2015-09-09 15:34:24Z|1175| 72|TRACE|                               ProcessSearchResult|Procesing search only (no processing) for [test.user@domain.com]
276873: 2015-09-09 15:34:24Z|1175| 72| INFO|                               ProcessSearchResult|Transmitting [202] shortcut results to Core and waiting for answer
276888: 2015-09-09 15:34:24Z|1175| 45| INFO|                               ProcessSearchResult|Got answer from Core. We need to process [202] items out of [202]
276889: 2015-09-09 15:34:24Z|1175| 45|TRACE|                               ProcessSearchResult|[test.user@domain.com] Processing items in chunk of size [100]

Solution

Following is recommended in order to solve the issue:

1. Check if the hardware on the server where Shortcut Process module is installed meets recommended requirements.
2. Check if 32-bit or 64-bit Shortcut Process module is installed. Better performance may be achieved by using 64-bit version.
3. Set Shortcut Process Parallelism, Shortcut Process Item Parallelism and Shortcut deletion maximum batch count to 1 on Shortcut Process Module System Configuration screen.