Smart Disk stops during backups and will not restart (4046557)

Smart Disk stops during backups and will not restart.

Smart disk is on a CIFS share and being used via a UNC path

CIFS share is located on a Quantum DXI storage device

SmartDisk deduplication is disabled since Quantum DXI Dedupes data locally.

Disk Index, Chunk Index are stored on the CIFS share (Quantum DXI)

When we try to start SmartDisk and trace levels are set to ERROR (i.e. default setting) we see the following in the superserver trace file:

0 INDEXER -5321 1279015061225558 Disk Manager Index Unavailable
0 DD-SCHED -608 1279015064225558 Deduplication Engine unavailable


When we try to start SmartDisk and trace levels are set to LIBDEBUG we see the following in the superserver trace file:

6 DISKSTOR -467 1279278140564290 Scan file '\\?\UNC\brdxi_data\SmartDisk\diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000.tmp' found in Disk Manager index
6 ELEMENT -1598 1279278140579915 Found Data Element index entry at '\\?\UNC\brdxi_data\SmartDisk\diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000.tmp'
6 DISKSTOR -474 1279278140579915 Found Data Element Disk Manager index entry '\\?\UNC\brdxi_data\SmartDisk\diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000.tmp'


1 LOGAPI -141 1279278140579915 Log 7 diskmanager:resource_delete resource NVBU/server/BRBACKUP/segments/e051d20ad83f3f4c03400000182e000003000000

6 FILEMANP -594 1279278140579915 Calling FindFirstFileW '\\?\UNC\brdxi_data\SmartDisk\diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000'
0 SYS -350 1279278140579915 C:/cygwin/home/buildbot/buildslave/smartdisk-windows-x86_32/build/k6/diskmanager/source/superserver/diskindex

As before we are not looking for a file with the exact name as these just two files with the same names but one having a .tmp extension. Just substitute your file names for the ones in this example below.

CD to \diskmanager\index\NVBU\server\BRBACKUP\segments\ and you should see two files, e051d20ad83f3f4c03400000182e000003000000 of zero byte size and e051d20ad83f3f4c03400000182e000003000000.tmp that has above zero byte size.

Move to a safe location the following file:

\diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000.tmp

Copy to a safe location the following file:

\diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000

Copy back e051d20ad83f3f4c03400000182e000003000000.tmp but without the .tmp extension so that it overwrites the original \diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000

Start SmartDisk using the "..\smartdisk.bat start" or "../smartdisk.sh start" command and test with backup.


To stop this happening again the index needs to be moved to a local disk of the SmartDisk server.

Explanation:

The CIFS share had dropped at the time Smartdisk was trying to overwrite \diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000 with \diskmanager\index\NVBU\server\BRBACKUP\segments\e051d20ad83f3f4c03400000182e000003000000.tmp and the write was never completed.