After an initial migration is run, an incremental copy (also known as a delta migration) will copy any new and updated data from the source to the target.
Incremental copying is not supported if using Native Web Service (NWS) connection on the target. This is in part due to the inability to correctly preserve the item IDs. If trying an incremental copy, with the NWS connection on the target, there is a possibility that some of the data on the target side will be corrupted.
There are three different methods to run an incremental copy from Metalogix Content Matrix:
·Incremental Copy Mode - Update Existing Objects option on the Migration Mode tab
The incremental copying option enables migrations that can preserve and update objects on the target of the migration. This mode is used when you just want to make sure nothing on the target gets overwritten. Only new objects that do not yet exist on the target are copied.
EXCEPTION: For lists and libraries with versioning enabled, any new versions that have been created since the initial migration will be copied to the target.
When this option is selected there are two options that are toggled. The first is the Preserve Item IDs option is enabled. The second is that the workflow copy options are turned off. This is because Incremental copies cannot be run on workflows.
·The Custom Copy option on the Migration Mode tab
The custom copy option allows you to run incremental copies for selected content. This option allows you to configure a mix of the Overwrite and the Incremental modes, meaning that incremental copies can be performed on select content in a migration, while allowing other content to be overwritten.
IMPORTANT: Preserving IDs on items/folders in Lists
When running an incremental copy the Preserve IDs on items/folders in Lists option must have been enabled in the original copy. This is so Metalogix Content Matrix can reference the item ID when looking to see if the items already exists on the target side. If this option was not selected, the incremental copy for SharePoint lists can return some strange results. Generally, in cases where this option was not selected, an incremental copy will create some duplicate content on the target for items it thinks are not in the list, even though they may be (but use a different item ID). The other possible consequence is that some data may be missing, because Metalogix Content Matrix may think that some data exists on the target, even though it may not (but the IDs may be in use). For more information on incremental copying and preserving IDs for SharePoint list items please see Preserving SharePoint List IDs with a CSOM Connection Type .
The preservation of Document ID/s is not an issue for incremental copying of SharePoint documents. Incremental copying for documents is referenced by the folder path/filename of the document instead of the item ID. Metalogix Content Matrix will look for the URL path of the document, and if found, will then compare the modified date between the original target document and the source document to see if any modifications have been made to the file. If any modifications are found, as compared to the target, these will be migrated to the target. If no file was found when looking back to the source/target URL path, then that document/folder will be added.
To perform an incremental copy using Migration mode:
2.On the Migration Mode tab, select Incremental copy.
When this option is selected:
§the Preserve Item IDs option is enabled, and
§the Workflow Copy Options is disabled. (Incremental copies cannot be run on workflows.)
REMINDER: When running an incremental copy the Preserve IDs on items/folders in Lists option must be enabled so that Metalogix Content Matrix can determine if the item already exists or if it has been updated. (When copying documents the folder path and document name are used instead.)
To perform an incremental migration job from an existing job:
1.In the Jobs List, select the job(s) for which you want to perform an incremental migration. (Use [Ctr] click to select multiple jobs.)
2.Right-click and choose Create incremental job.
NOTE: The new job will use the same name as the initial job with " Incrementally" appended to the end of the name
You can view the progress of a migration tab in real-time via interactive log files. The logs are fully searchable, and are based on SQL Compact Edition (SQL CE) file types. The log files are tied into Job files (.LST), and these files are limited to 4GB in size.
To view an interactive log:
After starting an action, click Details>> in the progress dialog box.
NOTE: All logging in Metalogix Content Matrix is done through jobs. If a job list is deleted from the Jobs List, all logging for those actions will also be deleted. There is no backup for the job lists, unless the job is manually saved to another location. Once a job list is deleted, all logging for the actions within that job list are gone. Metalogix Content Matrix will automatically hold any job lists created through any copy or compare actions, in the Job Lists section, and these job lists can only be deleted through the appropriate Delete commands. The job lists can also be manually selected and saved through the Job list section.
There are two types of jobs in Metalogix Content Matrix:
A job list is a collection of job items. A Job list is created for each copy or compare action that is made. Any "Copy" action/job that is in the Job List section can be used as the base of an incremental copy job. Job items can be viewed in the Log Viewer, by opening a job list. There are three basic ways to open a job list to access the Log Viewer:
·Double-click on a job list.
·Select a job list, then in the Job List section of the toolbar click View Log.
·Select a job, right-click, and choose View log.
Job items are job files, or logging, for individual items within the scope of an action. For example, if a SharePoint site is copied, there would be a job item for adding each list and each item in that list, and one job item for adding or creating each site or sub-site. If a SharePoint list with five documents is copied, then there would be a job item for adding/creating the list, and then one job item for adding each of the documents.
Job items are job files, or logging, for individual items within the scope of an action. For example, if a SharePoint site is copied, there would be a job item for adding each list and each item in that list, and one job item for adding or creating each site or sub-site. If a SharePoint list with fie documents is copied, then there would be a job item for adding/creating the list, and then one job item for adding each of the documents.
From the Log Viewer you can select and view any job items that exists within that job list.
NOTE: Some actions in Metalogix Content Matrix have the ability to run with Verbose Logging. This option will increase the size of the log file.
To view Log Item Details:
1.From the Log Viewer, select the item whose details you want to view.
2.Use one of the following options:
§Double-click on the item.
§Right-click and choose View Job Item.
§If the job is currently running, click Details>>.
The Job Details dialog contains the following information:
·Operation - The last operation performed on the item.
·Status The status of the item. If a compare action is being performed then this could be: completed, different, or missing.
·Item Name - For items, the Item ID. For documents, the Filename.
·Time Started The time the action for the item was started.
·Time Finished The time the action for the item was finished.
·Bytes Copied The bytes (B) that were copied in the action. This will be displayed in KB in some cases.
·Source - The Source URL for the item.
·Target - Target URL for the item.
·Information - Provides an informational message about the item, such as. This section will provide a description for any different and/or missing attributes/metadata for an item.
·Details View - Any errors that were encountered with the item when an action was performed.
·Content Comparer tab - Any differences between Source and Target content (from a compare action). You can display this information in either a Grid View, which displays a metadata property grid for the item, or as a Text View, which displays a XML text format of the item. This option is most useful if Verbose Logging has been checked
You can also:
·Use [Copy] to copy all of the item information and details (including the Details tab) into the systems clipboard. You can then paste the information when it can then be pasted to another location. When pasted the information will look similar to that of the actual Log Item Details dialog. This can be used for easy copy/pasting of an items migration log details.
·Use [Prev] and [Next] buttons to move to the previous or next item on the list (if applicable).