NetVault Database backups hang when backing the Reports Database and some reports fail to execute.
The log shows the General Reports files are backed up successfully, but the backup always hangs when reaching the Reports Database part.
The NetVault log does not mention which Reports Database table the backup hangs on, as described in Solution 78665:
https://support.quest.com/Search/SolutionDetail.aspx?id=SOL78665
The NetVault log shows:
Information 2012/07/10 07:00:36 725 Data Plugin NVSERV Finished backup of general reports files
Job Message 2012/07/10 07:00:36 725 Data Plugin NVSERV Backup reports database
Error 2012/07/10 08:47:11 725 Jobs NVSERV Fatal error: Aborted by user
Trace on the nvdbplugin do not show which Report Database component is causing the problem, instead they show that no response is received
when requesting the reports database tables names before backup:
1 DBBACKUP:6500 45 0 104624 Add index entry for 'Reports Database' of nodetype '1010009' from 19722471 to 19722470
3 LOGGING :6500 14 0 104624 'Backup reports database'
4 MESSAGE :6500 72 0 104624 Send message RDB_GET_TABLE_NAMES_REQUEST_MSG (4505) from 1:729 (0x0x2d9) to 1:10 (0x0xa)
4 MSGWAIT :6500 17 0 104624 MsgWaitMultipleMessagesWithTimeout(0012F8AC, 00000000, RDB_GET_TABLE_NAMES_REPLY_MSG, 00000000) level 0
4 NET :6500 37 0 104624 Wait for data (no timeout)
Restoring just the "General Reports Files" node from a previous successful NVDB backup does not help,
even if the Restore option "Blank reports database tables before restore" is selected.
The Reports Database is mainly comprised of 7 Tables found under "../netvault/reports/dbmgr/tables".
driveevents, driveperformance, events, jobfiletallies, mediacapacities, mediarequests and mediatransfers.
These tables are used to store statistical data produced by backups, media usage and drive activities...
This information is crucial in order to produce historical reports.
Although needed for reporting, these are not required to operate NetVault and can be deleted as NetVault will recreate them when needed.
There could be several reasons for this issue:
- The Reports Database Manager process nvrepdbmgr could be too busy to reply or hung. As no timeout is established we will hang indefinitely.
- One or more of the Reports Database tables have become corrupt
- Finally the tables could simply be missing under the Reports Database folder (../netvault/reports/dbmgr/tables).
To resolve this issue:
- Stop NetVault
- Move the content of "../netvault/reports/dbmgr/tables" to another location outside of "../netvault/reports/"
- "../netvault/reports/dbmgr/tables" should now be empty
- Start NetVault
- Run a small backup (1 local file to a local device should be enough)
- Once the small backup has completed successfully, you will see that the removed tables will be recreated by NetVault under "../netvault/reports/dbmgr/tables"
- Now run the NVDB backup which should now complete successfully
Note that as these tables are used when producing historical reports, some reports could fail to run or could be missing data immediately after this procedure.
This is an expected behaviour and as jobs complete and media is being used, the tables will be updated with the necessary information to produce reports after that.
