In Rapid Recovery 6.2.0 Windows Agent, a new changelog Bitmap was introduced. Upon upgrading an existing Rapid Recovery 6.1.x Windows Agent to 6.2.0 or newer, the changelog would be converted into a Bitmap.
Only the first 1 MB of changes tracked in the changelog are converted. The remaining (more recent) changes are truncated, causing missing data in new incremental backups. This results in incomplete volume file systems and a damaged recovery point chain.
This issue can result in file-level restore failures; the inability to browse a mount point; or virtual export machines failing to boot after a restore, with errors such as "INACCESSIBLE BOOT DEVICE" or restored machines booting straight into Windows Repair screen.
Likewise performing a Chkdsk on the filesystem of an affected mounted Recovery Point would indicate errors on the file system structure.
This issue can only affect Agent protected Windows machines, that have had the Agent upgraded from version 6.1.3 and older to 6.2.0, 6.2.1, and 6.3.0.
This issue has been identified as defect RR-109147. It occurs when the agent change log file on a volume is larger than 1 MB and the Rapid Recovery agent is upgraded from a version 6.1.3 or older to 6.2.0 or newer. Most agents that take regular backups and are rebooted immediately after upgrade will not experience this issue.
Below steps is applicable when upgrading 6.1.x to one of the affected Agent versions 6.2.0, 6.2.1 or 6.3:
If you are considering upgrading to one of the affected versions, we advise the following steps to avoid this issue:
If you follow these steps specifically we still recommend following the post-upgrade workaround steps to ensure the upgrade was successful and your recovery point chain is healthy.
If you have upgraded some agents to one of the affected versions, we recommend running the PowerShell script that we have attached to this KB on your Rapid Recovery Core server to test the validity of your recovery points and ensure there is no corruption in your recovery point chains.
This script has been designed to detect damaged recovery points caused by the agent upgrade defect RR-109147. Only NTFS partition types are supported by this script so REFS, EISA, and UEFI partitions will need to be checked manually. This script does not check:
Once the script has determined an agent needs to be checked it will mount up to 3 recovery points and run chkdsk on each volume within that mounted recovery point. The recovery points the script will mount in order are:
After the script completes it will output the results in the PowerShell window, but will also create file called DiskHealthReport.txt inside the report path. This report file contains entries for each agent, the results of the check for each volume within each recovery point that was checked. Please review the output and follow these recommendations based on the results:
To run the script:
Every time the script is executed, a new sub directory with a current timestamp as the name will be created next to the script. Each agent has its own folder in that sub directory. Reports are grouped by volume (each volume has its own folder for reports). The DiskHealthReport.txt report will also be located in this sub directory.
The following optional parameters are available to allow you to modify the behavior of the script: