- Using HSM

# Using HSM

Contents

After configuring the Copytool Agent node and adding Copytool to that agent, you can use HSM to manage file archiving, free-up file system storage, and improve overall file system performance.

1. | To use HSM, log into a regular Lustre client node as the system superuser. The node is a compute client node not managed by Intel(R) Manager for Lustre software.

2. | Issue lfs commands to initiate HSM actions (archive, restore, release, remove). For example: root@client1234 #: lfs hsm_archive /mnt/lustre/path/to/big_file

3. | After issuing this archive command, the superuser can monitor progress on the operation at the Intel® Manager for Lustre* GUI. To monitor progress, click Configuration and click HSM to open the HSM window and observe copytool archive progress.

4. | After the archive operation has completed, you can release command to remove the file from the Lustre file system and free up that space. For example: root@client1234 #: lfs hsm_release /mnt/lustre/path/to/big_file

After this command completes, the file’s data exists in the HSM archive, but the file has been moved off of Lustre main storage. You may notice that the available space in the lustre file system has increased (if the file is large enough and the file system small enough - otherwise the change won’t register in the graphs).

If you want the file to be copied back to the file system, issue an lfs restore command (below). Or simply wait for the next read attempt of that file by a client, and an implicit restore will return the file back to the file system.

Following are lfs hsm commands:

• | lfs hsm_archive /mnt/lustre/<path>/<filename> - Copies the file to the archive.

• | lfs hsm_release /mnt/lustre/<path>/<filename> - Removes the file from the Lustre file system; does not affect the archived file.

• | lfs hsm_restore /mnt/lustre/<path>/<filename> - Restores the archived file back to the Lustre file system. This is an asynchronous, non-blocking restore. A client's request to access an archived file will also restore the file back the Lustre file system if is has been released; this will be a synchronous and blocking restore.

• | lfs hsm_cancel /mnt/lustre/<path>/<filename> - Cancels an lfs_hsm command that is underway.

Displaying information about a current lfs_hsm request

To view the progress of HSM copytool activities, click Configuration and click HSM to open the HSM window and observe copytool progress. See Monitor HSM Copytool activities for more information.

The command lctl get_param mdt.*.hsm. also requests returns information about the currently executing HSM request.