Chat now with support
Chat with Support

Metalogix Archive Manager for Files 8.1.1 - HSM Install and Config Guide

Creating a MediaStore

 

In this section you will be shown how to create a MediaStore and how to configure it.

When running installation for the first time you need to create a MediaStore (or you must have one available) and configure it. Later, when running it again, you may modify an existing MediaStore, or delete it, or even connect to a remote computer if a MediaStore is placed there.

To create a MediaStore you basically need the following information: the UNC-path to a jukebox (AMASS, PEGASUS, or POINT) which is prepared for usage, and a second path if, for security reasons, you want the files to be archived also at some other location (i.e. under some other path as well).

 

RECOMMENDATION: The following lines describe the process for Jukebox, Hard disk, Network option. However, provided that you do not need directories with a specific size (e.g. 5 GB) and you have a Hard disk or RAID-system we recommend Simple Path store-type. This kind of store is faster and outperforms all other stores under the same circumstances (same hardware, same path) (see the following section “Simple Path MediaStore”).

 

Jukebox, Hard disk, Network Media Store

 

To create a Jukebox, Hard disk and Network MediaStore, do as follows:

1.In the Configuration tool on the HSM / Stores tab click the New Store button to open the MediaStore Administration wizard.

a-launch

NOTE: When there are already some stores created, buttons under the Stores list view can be used to administer them:

New Store – use to create a new store (as described further in this section); it is also possible to attach already created store – to do so, click the downward arrow and select Attach

Set up – setup store mirroring

Delete – deletes the selected store if no schema is assigned to it

Primary – displays only primary stores, i.e. stores that are not a mirror for any other store

Refresh – refreshes the list view

Manage – opens configuration wizard for the selected store; you can also start or stop created stores by selecting it and clicking the Manage down arrow / Manage service state

 

 

2.To configure the MediaStore, select the desired MediaStore type in the dropdown.

NOTE: We will describe the process for the Jukebox, Harddisk, Network option. However, if you have a harddisk or raid-system, and you do not need directories with a specific size (e.g 5 GB) always use Simple Path store-type (see “Simple Path MediaStore” section further in this manual).

Then enter a name for your new MediaStore in the Name of the new MediaStore text box. Click Next.

 

b-type

 

3.In the Storage Provider drop-down list select either Hard disk or UNC path (in the case that your store will be placed on a hard-disk drive or share) or the appropriate storage provider, i.e. the manufacturer of your jukebox software: Amass, Pegasus, or PoINT Jukebox Manager.

c-storage

 

4.Click on the browse button next to the Path of the MediaStore box choose a location of the desired MediaStore. Click OK.

NOTE: To create a new folder, use the Make new folder button. Enter the name for this new folder, e.g. HSM and click OK.

d-path

 

5.Should you wish to archive files simultaneously to some other location as well, select the Activate multiple saving check box. Use the Browse button, similarly as above, to specify a second path.

The files will be archived to this second location, too.

NOTE: The second path can be anything that is reachable by a drive-letter or a network share, something accessible with Windows Explorer.

In normal usage the first path is a slow MediaStore (e.g. Pegasus Jukebox), and the second path is a large SAN (e.g. local RAID or Harddisk). For fast access you should use SAN because it is much faster.

WARNING: If archiving to one path fails, file store operation will result in error.

e-multiple

6.In case that you activated multiple saving, click on the down arrow next to the Path of the fast file access path drop-down list and select the faster access path.
 

f-file access

 

7.In the Retention Time support drop-down box select the NetApp SnapLock option if you are using NetApp and want to use SnapLock to secure the compliancy with law regulations regarding archiving of electronic documents. (e.g. HIPAA, OFRS, COSO etc.)

In case you are using EMC Celerra and you wish to use retention times for your archived files, select EMC Celerra.

Click Next.

f-retention

 

8.In the case that you activated multiple saving the following window gets displayed. Here you may configure multi-storing.

The Multiple Saving section:

Should you select the From the medium with number check box, then you may choose from which numbered medium multiple saving was activated.

Should you select the For the last media check box, then you may enter a number which will specify up to which media multiple saving would be done.

The Media Switch section:

Should you select the Check and delete oldest medium which was saved multiple times check box the system will check for media which are no longer required to be stored on more than one location and deletes the redundant copies.

In the Action when switching media text box you may enter a command or a batch file that will be executed when switching between media.

In the Maximum time for the action (ms) text box specify a maximum time frame that you want to set for the action.

 

Then click Next.

 

g-multi saving

 

9.On the following page you need to configure media names. You also need to specify the total number of media in this MediaStore to be used by Archive Manager product.

In the Create folder names using down-drop box select whether HSM folders names should be created in lowercase only, uppercase only or standard.

If you select the Create file and folder-names using 8.3 convention check box then the file-name will be truncated to 8 characters and extension to 3 characters, provided that the underlying system doesn’t support long filenames.

To specify a prefix for the desired MediaStore use the MediaPrefix text box. You may enter 2 alphanumerical characters. Those characters will be located in front of each of the media along with the respective media number. In our example we chose LS as the media-prefix (as local store), so the name of one of the media would be LS000001.

In the Number of the first medium text box you may specify a number that will be assigned to the first medium.

In the Number of media that can be administered by HSM text box you need to specify the number of media to be administered by Archive Manager. For instance, if there are 20 media in a Jukebox, then enter 20.

In the Number of current media to write on (CurrentWriteMediaID) text box you may specify the number of the medium that will be used as the first one for archiving.

 

Click Next.

 

h-media

 

 

10.On the following page you may specify whether to create a directory for each day.

It is recommended to select the Create a sub directory for each day check-box to create a directory for each day (an optimal condition). Subdirectories are being created with the path 000001, 000002, and so on. This is necessary for performance reasons, the more files a directory contains the longer the search for a file can take.

By selecting the Limit the number of files in directory to check-box you may even limit the number of files per directory. Simply enter the appropriate data in the text field.

Select the Flush files immediately after writing check box. Normally, all file-systems support flushing of files. Disable the option only if you have problems with storing files.

Click Next.

 

i-subdirectory

 

11.On this page you need to specify further settings for the used medium, as well as the total size of the medium.

To set a storage space not to be used on a medium, enter the desired value in the Space on a media that should not be used text box. This value is defined in MB.

Besides, you may set a value which refers to a warning message. As soon as free storage space is lower than the value specified in the Issue a warning if the size of the free space on the current medium is lower than the entered value and the next medium to write on is not ready text box, you would get a warning message. This value is also in MB. When this value is reached the availability of a new medium is being checked. This value should comply with the approximate average daily amount of MB to archive, so that new medium can be searched in a timely manner.

In the Total size of media in MB text box you need to enter the total size of a medium.

Then click Next.

 

j-space

 

12.HSM needs to know when to start a new medium, as there is maximum medium size set. For this purpose it needs to recalculate the used space periodically. On this page you may choose how often the free space on a medium should be calculated. It can be set in accordance with the number of files, or file size, or simply in seconds. As soon as any of those values are met, the remaining storage space is recalculated.

To periodically recalculate the free space on the medium, simply enter a desired time span in the Interval text box.

To recalculate the free space on a medium depending on the number of files that have been archived since the most recent calculation, simply enter the desired value in the Number of archived files text box.

To recalculate the free space on a medium depending on the archived volume since the most recent calculation, simply enter the desired value in the Total size of the archived files text box. This value should be given in MB.

If the user does not want to allow the HSM to recalculate the used space periodically (because it might be time-consuming operation), he can specify a file where the value of the used space on a medium will be saved. The file is updated each time a file is stored on the medium. Here he can decide whether to use a single file for this purpose for all media in the store – Use a single file check box - or create a separate file for each media – Use a file for each media check box.

Click Next.

 

k-calculation

 

13.On this page you need to specify where the MediaStore should connect to.

Click the Add button to specify the HSM server.

In the pop-up dialog set the Server type to “HSM Server” and enter the Server name.

 

k-PAMservers2

 

The HSM Service contacts the MediaStore you specified in periodical intervals. Specify this interval in the Connection interval between the MediaStore and the HSM Server in seconds text box.

Click Next.

 

14.In the following dialog the Relative Speed of the store text box represents the relative speed of this store compared to other stores.

If HSM should copy files into the cache when reading from this store, check Use HSM Cache for read operations.

If this media should be read-only, check Write Protection check box. (only supported for “Jukebox, Harddisk, Network” and “Simple Path”).

If the Re-create service for this media store is checked, the store will be running in the background as a separate service. This option means that the MediaStore Administration Wizard should re-register the service for the administrated store. It is useful if the store service was deleted and the user wants to re-create it.

Click Finish.

 

l-finish

 

15.You will be asked to restart the service to apply the changes. To restart, click Yes.

n-running

 

16.Click on the Finish button to close the window.

17.Back in the Configuration tool the store you have created will be displayed in the Stores list view.

o-mediaStore

 

NOTE: Should the store display “State – Stopped” it needs to be started. To start a store, click Manage down arrow /Manage service state. Locate the desired store in the list and click Start.

 

NOTE: Should you be using several MediaStores, you need to repeat all steps as described in this section for each one of them.

Simple Path MediaStore

 

In this section will guide you through the process of creating Simple Path MediaStore. Should you have created your store already, (e.g. as described in the previous chapter) continue with the “Specifying a Schema” part of the manual.

 

When creating a MediaStore as described in the previous part “Creating a MediaStore” you can choose from several location for saving of archived files. We have described the process for Jukebox, Hard disk, Network option. However, provided that you do not need directories with a specific size (e.g. 5 GB) and you have a Hard disk or RAID-system we recommend Simple Path store-type.

 

This kind of store is faster and outperforms all other stores under the same circumstances (same hardware, same path).

Description:

·It does not do size checking

·It writes files on any UNC path (e.g. Harddisk, Network-Share)

·Files are stored in subdirectories (there are no “medias” with a specific size)
<RootPath>\<Year>\<Month>\<Day>\<Hour>\<counter>\Filename.txt
e.g. e.g. D:\HsmStore\2007\04\26\18\000\ 4_000000f4.tif

 

NOTE: If you need to access a share you have to allow the computer account (Local System) to access a share or run PamHsmTSv with a special user.

 

To create a MediaStore – Simple Path type, do as follows:

1.In the Configuration tool on the HSM / Stores tab click the New Store button to open the MediaStore Administration wizard.

NOTE: By default Configuration tool can be found under C:\ Program Files (x86) \ Common Files \ PAM \ PAMConfig.

a-launch

 

2.To configure the MediaStore, select the Simple Path option in the dropdown.

Then enter a name for your new MediaStore in the Name of the new MediaStore text box. Click Next.

b-simple path

 

3.Click on the browse button next to the Path of the MediaStore box to enter the appropriate path to your MediaStore.

NOTE: To create a new folder, use the Make New Folder button. Enter the name for this new folder, e.g. Store and click OK.

c-path

 

If your MediaStore is a network share, you can specify which User (with its Password) should access the share. You have to specify the user if:

·your share is not accessible by the user which runs the HSM services;

·you need a different user for each store;

·you want to create more “Simple Stores” accessing network shares; In that situation consider the user’s access permission to the store paths

 

NOTE: The specified user does not need to be a known local user.

d-user

 

4.Should you wish to archive files simultaneously to some other location as well, select the Activate multiple saving check box. Use the browse button, similarly as above, to specify a second path.

The files will be archived to this second location, too.

NOTE: The second path can be anything that is reachable by a drive-letter or a network share, something accessible with Windows Explorer.

e-multiple2

5.In the Retention time support drop-down box select the NetApp SnapLock option if you are using NetApp and want to use SnapLock to secure the compliancy with law regulations regarding archiving of electronic documents. (e.g. HIPAA, OFRS, COSO etc.)

In case you are using EMC Celerra and you wish to use its retention times for your archived files, select EMC Celerra.

NOTE: In case you are using multiple saving and retention time support both must be stores supporting the same retention type.

f-retention

 

6.If you are storing to SAM-FS (a kind of NAS - Network Attached Storage) check the During write, wait until the “archive” attribute was removed check box. With this feature activated you have configured the SAM-FS to remove the “archive” attribute after the file was copied into a safe location (e.g. after it was copied to a tape drive). If you have finished, click Next.

g-checkBox

 

7.In the following dialog the Relative speed of Store text box represents the relative speed of this store compared to other stores.

If HSM should copy files into the cache when reading from this store, check Use HSM Cache for read operation.

If this media should be read-only, check Write Protection check box (only supported for “Jukebox, Harddisk, Network” and “Simple Path”).

Click Finish.

h-speed

 

8.You will be asked to restart the service to apply the changes. To restart, click Yes.

n-running

NOTE: Should you be using several MediaStores, you need to repeat all steps as described in this section for each of them.

Specifying a Schema

 

Having a store ready is not enough. We need a schema, which is basically the path to the MediaStore. This schema needs to be registered in the HSM database.

 

Therefore, in this phase we will specify a schema and will assign the MediaStore having been created in the previous section to this schema. As mentioned previously, you may create as many schemas as you wish. For each schema you need to choose a store where the files will be archived.

 

To specify a schema, do as follows:

1.In the Configuration tool, on the Stores tab click the Create button.

a-create

 

NOTE: When there are already some schemas created, buttons under the Schemas list view can be used to administer them:

Edit – change the selected schema settings

Delete – delete the selected schema

Test – test the selected schema functionality

Refresh – refresh the list view

 

2.In the HSM Schema window enter the following information:

In the Store drop-down list select the appropriate store.

In the Schema name text box enter a name for your schema, e.g. schemaOne.

When selecting the Enforce Store check box, you enable duplicate archiving. For example: you archive a file in scheme 1 (using Store A) and them archive it again in scheme 2 (using store B). The file is recognized as duplicate but is written to both stores.

In the Encryption drop-down list select the appropriate encryption.

In the Task drop-down list select the task you want to assign to the schema. The task will run during the archiving of a file, e.g. copying the file to another media store. (Tasks are created on the Tasks tab.)

NOTE: Tasks with delete operation are not listed in drop-down list.

 

b-new

 

If you select the Compression option then compression will be applied at archiving.

It is possible to set exceptions for the files you do not want to compress. List the desired extensions in the Exclude files text box. Please use semicolon “;” to separate individual extensions and include dot “.” in the extension.

In the Packer dropdown box you can select a packer if any is created on the Packer tab. Packers are joining multiple files stored in HSM into large ZIP archives. It is better to have several large files than a plenty of small ones – the disk space utilization is more efficient in this case, because it helps to avoid internal disk fragmentation.

NOTE: It’s not possible to have packer and task selected at once. If you need to use packer together with some other task operations, a packer operation can be defined directly as a task operation.

Click OK.

 

3.After clicking OK you will be asked to restart the HSM Base Operation service. Click OK. Then the schema appears in the Schemas list view.

Do not click Close yet. It is good to check at this point whether archiving functions.

d-list

 

4.To check if archiving functions, click the Test button. The HSM Test dialog pops-up where archive, retrieve and delete operations should be tested.

e-test

 

5.Click Archive. In the pop-up Archive dialog select the Target schema you want to test. No further configuration is necessary. However, it is possible to set Retention time for the test file:

·Fixed value

·Infinite

·Indefinite (i.e. the retention time is not set specifically but can be defined later)

You can also choose to use generated test files or use a specific test file (user generated, e.g. for testing big file archiving) or choose other testing options:

Make each file unique – new unique string is generated after each test archiving

Use invalid checksum – test checksum verification

Archive empty file – check to test empty file archiving

Force compression – check to compress test files

Force no compression – check for no compression even if the compression is enabled

Enable logging – check to log test operation

 

Then click Archive to check whether archiving functions properly.

 

e-test2

 

6.After successful archiving click OK, then Close.

e-test3

 

7.Click on the Retrieve button to check, whether retrieving functions properly. Click OK to close the Result window for each file identifier.

e-test4

 

8.If everything works, close the Test window. Close also the Configuration tool.

Once the HSM is installed and configured as described above, you may proceed with manual installation of Archive Manager.

Besides the settings above which are necessary for correct deployment of HSM, several additional configuration options are available in Configuration tool. Additional configuration is optional but it can enhance HSM performance and provide administrator with diagnostic, encryption, pack and async task possibilities. Detailed instructions on how to manage additional options can be found in the next section “Optional Configuration”.

Related Documents