Chat now with support
Chat with Support

Metalogix Content Matrix 8.8 - SharePoint Edition User Guide

Introduction Entering the License Key Content Matrix Console End User Interface Enabling Advanced Mode Connecting to SharePoint Preparing for a Migration How Content Matrix Handles Various SharePoint Components Initiating a Migration Configuring Copying Options Saving or Running a Migration Action Copying SharePoint Objects as a Separate Action Self-Service Migration Incremental Migration Log Files Using PowerShell with Content Matrix
Configuring PowerShell for Use with Content Matrix
Registering Metalogix Command DLL Files Adding PowerShell Snap-Ins for the Application Framework Content Matrix PowerShell Commandlet List
Metalogix.System.Commands Metalogix.SharePoint.Commands Metalogix.Jobs.Reporting.Commands Metalogix.SharePoint.Migration.Commands
Modifying Content Matrix Configuration and Settings Configuring Content Matrix for Distributed and Self-Service Migration Frequently Asked Questions
DB_Owner Permission Migrating with the Fabulous 40 Templates Item Count Discrepancies Keyboard Shortcuts License Key Troubleshooting Determining the Status of a Migration Running in the Background MySite and User Profile Migration Issues Optimal Setup for Best Performance Using Proxies, Load Balancing or Alternate Access Mappings Troubleshooting the Extensions Web Service Installing the Extensions Web Service on Specific Systems Extensions Web Service Installation Files Using Older Versions of the Extensions Web Service Preserving IDs when Migrating a Custom List as a Folder Migrating JavaScript Migrating Site Variations Migrating with SharePoint 2010/2013/2016 Document IDs Changing a Job Configuration for Multiple Files SharePoint 2003 Version Migration Limitations SharePoint 2013 and 2016 Site Collection Creation Issue Job List Database fails to Load After Upgrade Customized Wiki Page Web Part Zones Not Being Migrated Preserving SharePoint List Item IDs with a CSOM Connection Type Retrying Failed Document Copies to O365 CSOM Connections Migrating Content When the Source Custom List Template is Missing Are SharePoint Online Migrations Throttled? What to Expect when Migrating with StoragePoint on the Target Migration Error Message 'There was an Error Reading from the Pipe: The Pipe has been Ended (109, 0xd6)' How do I Remove Items from My Azure Blob Storage Account? Azure Batches Getting Stuck Supported Nintex Actions for SPO Migration "Insufficient Credentials" Message Connecting to Modern Team Site Using Web Browser Authentication Error Making a Browser-Based Connection with PowerShell Console Open
About Us

Incremental Migration

After an initial migration is run, an incremental copy (also known as a delta migration) will copy any new and updated data from the source to the target.

Connection icon

Incremental copying is not supported if using Native Web Service (NWS) connection on the target. This is in part due to the inability to correctly preserve the item IDs. If trying an incremental copy, with the NWS connection on the target, there is a possibility that some of the data on the target side will be corrupted.

There are three different methods to run an incremental copy from Metalogix Content Matrix:

·Incremental Copy Mode - Update Existing Objects option on the Migration Mode tab

The incremental copying option enables migrations that can preserve and update objects on the target of the migration. This mode is used when you just want to make sure nothing on the target gets overwritten.  Only new objects that do not yet exist on the target are copied.

EXCEPTION:  For lists and libraries with versioning enabled, any new versions that have been created since the initial migration will be copied to the target.

When this option is selected there are two options that are toggled. The first is the Preserve Item IDs option is enabled. The second is that the workflow copy options are turned off. This is because Incremental copies cannot be run on workflows.

·The Custom Copy option on the Migration Mode tab

The custom copy option allows you to run incremental copies for selected content. This option allows you to configure a mix of the Overwrite and the Incremental modes, meaning that incremental copies can be performed on select content in a migration, while allowing other content to be overwritten.

·The creation of an incremental job based on a previously run job

IMPORTANT:  Preserving IDs on items/folders in Lists

When running an incremental copy the Preserve IDs on items/folders in Lists option must have been enabled in the original copy. This is so Metalogix Content Matrix can reference the item ID when looking to see if the items already exists on the target side. If this option was not selected, the incremental copy for SharePoint lists can return some strange results. Generally, in cases where this option was not selected, an incremental copy will create some duplicate content on the target for items it thinks are not in the list, even though they may be (but use a different item ID). The other possible consequence is that some data may be missing, because Metalogix Content Matrix may think that some data exists on the target, even though it may not (but the IDs may be in use). For more information on incremental copying and preserving IDs for SharePoint list items please see Preserving SharePoint List IDs with a CSOM Connection Type .

The preservation of Document ID/s is not an issue for incremental copying of SharePoint documents. Incremental copying for documents is referenced by the folder path/filename of the document instead of the item ID. Metalogix Content Matrix will look for the URL path of the document, and if found, will then compare the modified date between the original target document and the source document to see if any modifications have been made to the file. If any modifications are found, as compared to the target, these will be migrated to the target. If no file was found when looking back to the source/target URL path, then that document/folder will be added.

To perform an incremental copy using Migration mode:

1.Initiate a migration.

2.On the Migration Mode tab, select Incremental copy.

When this option is selected:

§the Preserve Item IDs option is enabled, and

§the Workflow Copy Options is disabled.  (Incremental copies cannot be run on workflows.)

Creating an Incremental Migration from an Existing Job

REMINDER:  When running an incremental copy the Preserve IDs on items/folders in Lists option must be enabled so that Metalogix Content Matrix can determine if the item already exists  or if it has been updated. (When copying documents the folder path and document name are used instead.)

To perform an incremental migration job from an existing job:

1.In the Jobs List, select the job(s) for which you want to perform an incremental migration.  (Use [Ctr] click to select multiple jobs.)

2.Right-click and choose Create incremental job.

Create Incremental Job

NOTE: The new job will use the same name as the initial job with " Incrementally" appended to the end of the name

Log Files

You can view the progress of a migration tab in real-time via interactive log files. The logs are fully searchable, and are based on SQL Compact Edition (SQL CE) file types. The log files are tied into Job files (.LST), and these files are limited to 4GB in size.

To view an interactive log:

After starting an action, click Details>> in the progress dialog box.

NOTE:  All logging in Metalogix Content Matrix is done through jobs. If a job list is deleted from the Jobs List, all logging for those actions will also be deleted. There is no backup for the job lists, unless the job is manually saved to another location. Once a job list is deleted, all logging for the actions within that job list are gone. Metalogix Content Matrix will automatically hold any job lists created through any copy or compare actions, in the Job Lists section, and these job lists can only be deleted through the appropriate Delete commands. The job lists can also be manually selected and saved through the Job list section.

There are two types of jobs in Metalogix Content Matrix:

A job list is a collection of job items. A Job list is created for each copy or compare action that is made. Any "Copy" action/job that is in the Job List section can be used as the base of an incremental copy job. Job items can be viewed in the Log Viewer, by opening a job list. There are three basic ways to open a job list to access the Log Viewer:

·Double-click on a job list.

·Select a job list, then in the Job List section of the toolbar click View Log.

·Select a job, right-click, and choose View log.

Job items are job files, or logging, for individual items within the scope of an action. For example, if a SharePoint site is copied, there would be a job item for adding each list and each item in that list, and one job item for adding or creating each site or sub-site. If a SharePoint list with five documents is copied, then there would be a job item for adding/creating the list, and then one job item for adding each of the documents.

Log Viewer

Job items are job files, or logging, for individual items within the scope of an action. For example, if a SharePoint site is copied, there would be a job item for adding each list and each item in that list, and one job item for adding or creating each site or sub-site. If a SharePoint list with fie documents is copied, then there would be a job item for adding/creating the list, and then one job item for adding each of the documents.

From the Log Viewer you can select and view any job items that exists within that job list.

NOTE:  Some actions in Metalogix Content Matrix have the ability to run with Verbose Logging. This option will increase the size of the log file.

Log Item Details

To view Log Item Details:

1.From the Log Viewer, select the item whose details you want to view.

2.Use one of the following options:

§Double-click on the item.


§Right-click and choose View Job Item.


§If the job is currently running, click Details>>.


The Job Details dialog contains the following information:

·Operation - The last operation performed on the item.

·Status – The status of the item. If a compare action is being performed then this could be: completed, different, or missing.

·Item Name - For items, the Item ID. For documents, the Filename.

·Time Started – The time the action for the item was started.

·Time Finished – The time the action for the item was finished.

·Bytes Copied – The  bytes (B) that were copied in the action. This will be displayed in KB in some cases.

·Source - The Source URL for the item.

·Target - Target URL for the item.

·Information - Provides an informational message about the item, such as. This section will provide a description for any different and/or missing attributes/metadata for an item.

·Details View - Any errors that were encountered with the item when an action was performed.  

·Content Comparer tab - Any differences between Source and Target content (from a compare action). You can display this information in either a Grid View, which displays a metadata property grid for the item, or as a Text View, which displays a XML text format of the item.  This option is most useful if Verbose Logging has been checked

You can also:

·Use [Copy] to copy all of the item information and details (including the Details tab) into the system’s clipboard.  You can then paste the information when it can then be pasted to another location. When pasted the information will look similar to that of the actual Log Item Details dialog. This can be used for easy copy/pasting of an items migration log details.

·Use [Prev] and [Next] buttons to move to the previous or next item on the list (if applicable).

Related Documents