-
Title
WaitForImportFinished command may show failed -
Description
WaitForImportFinished command may show failed -
Resolution
Issue
After enabling Stage 2 for a container mapping it may quickly go through to the command WaitForImportFinished, and show it as Failed.
Solution
This isn’t actually a failure. What is happening is that items still need to be ingested into the target, but have failed during the Stage 1 process. These items will be retried up to the default maximum of 10 times – this number includes the number of times that the item was retried whilst the mapping was in Stage 1. For example, if the container mapping had 3 failed items, each of which was already tried 5 times, then the WaitForImportFinished command will retry those 3 failed items a further 4 times before moving on in the workflow. In addition, the workflow can only then proceed to the next command if the failed item threshold is one item more than the number of failed items.
This is shown in the example below:
11:07:35
First time round checking the routing[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ Execute] Got 1 container mappings to check
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ HasAllItemsRoutedExportedImported] Routing items for mapping: 22
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ GetSqlCommandForFilters] Sql Command:
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ GetSqlCommandForFilters] Sql Parameters:
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddRoutings] SQL Command: IF OBJECT_ID('tempdb..#TempTable') IS NOT NULL DROP TABLE #TempTable;SELECT TOP 5000 Item.ItemId, 22 as ContainerMappingId INTO #TempTable FROM Item LEFT JOIN ItemRouting ON Item.ItemId = ItemRouting.ItemId AND ContainerMappingId = 22 WHERE ContainerId = 'e576d2a4-aa0c-4b01-bc8d-8461fe945c2c' AND ItemRouting.ItemId IS NULL AND DeletedDateUtc IS NULL
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddRoutings] SQL Command: INSERT INTO ItemRouting (ItemRouting.ItemId, ItemRouting.ContainerMappingId) SELECT * FROM #TempTable
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddPSTRoutings] Adding Routings for PST for Container Mapping Id: 22
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddPSTRoutings] Inside while loop.
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddPSTRoutings] Before foreach
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddPSTRoutings] Before AddRoutingForPST execution.
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddRoutingsForPST] Adding PST Routings for MappingId: 22 | RolloverBytes: 21474836480 | subContainerStatisticsCount: 1
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddRoutingsForPST] Before SQL execution.
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddRoutingsForPST] We have [0] Items to be routed.
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AddPSTRoutings] Finished PST Routing for [22]
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ HasAllItemsRoutedExportedImported] Checking if all items have been exported/imported
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AllExportedAndImported] Mapping [22] has [1] items to import.
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ AllExportedAndImported] Mapping ID: 22 | All Exported & Imported: False
[2014-02-05 11:07:35Z] [ 5624] [ 52] [TRACE] [ Execute] Mapping 22 All Items Exported/Imported: False
^^^ All Items Exported/Import: False means that we still have items to retry.
Then added Failed Item Threshold: 2 via the Administrative Interface (Existing Container Mappings screen)
To speed up the process the ItemRoutingErrorCount was changed to 9
Waiting for 1 hour. By default, each item that has failed will be retried every 60 minutes.[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ GetReadyContainerMappingsByCommandId] Got 1 containers.
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ GetReadyContainerMappingsByCommandId] Returning 1 containers.
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ Execute] Got 1 container mappings to check
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ HasAllItemsRoutedExportedImported] Routing items for mapping: 22
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ GetSqlCommandForFilters] Sql Command:
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ GetSqlCommandForFilters] Sql Parameters:
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddRoutings] SQL Command: IF OBJECT_ID('tempdb..#TempTable') IS NOT NULL DROP TABLE #TempTable;SELECT TOP 5000 Item.ItemId, 22 as ContainerMappingId INTO #TempTable FROM Item LEFT JOIN ItemRouting ON Item.ItemId = ItemRouting.ItemId AND ContainerMappingId = 22 WHERE ContainerId = 'e576d2a4-aa0c-4b01-bc8d-8461fe945c2c' AND ItemRouting.ItemId IS NULL AND DeletedDateUtc IS NULL
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddRoutings] SQL Command: INSERT INTO ItemRouting (ItemRouting.ItemId, ItemRouting.ContainerMappingId) SELECT * FROM #TempTable
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddPSTRoutings] Adding Routings for PST for Container Mapping Id: 22
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddPSTRoutings] Inside while loop.
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddPSTRoutings] Before foreach
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddPSTRoutings] Before AddRoutingForPST execution.
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddRoutingsForPST] Adding PST Routings for MappingId: 22 | RolloverBytes: 21474836480 | subContainerStatisticsCount: 1
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddRoutingsForPST] Before SQL execution.
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddRoutingsForPST] We have [0] Items to be routed.
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AddPSTRoutings] Finished PST Routing for [22]
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ HasAllItemsRoutedExportedImported] Checking if all items have been exported/imported
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AllExportedAndImported] Mapping [22] has [0] items to import.
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ AllExportedAndImported] Mapping ID: 22 | All Exported & Imported: True
[2014-02-05 12:07:37Z] [ 5624] [ 13] [TRACE] [ Execute] Mapping 22 All Items Exported/Imported: True
[2014-02-05 12:07:47Z] [ 5624] [ 31] [TRACE] [CreateArchiveShuttle.Core.WebServices.ArchiveShuttle] Initialized new ArchiveShuttle WebService Client on fe80::742f:fe91:7e7c:6341%12
And the workflow moved on to the next command.