Promoting a TCT-enabled fileset to an AFM to cloud object storage fileset in the manual update mode
After TCT is enabled on a fileset, promote this fileset to an AFM to cloud object storage fileset in the manual update (MU) mode.
-
Identify a TCT-enabled fileset that needs to be promoted to an AFM to cloud object storage in
the MU mode. Ensure that this fileset is in a good state and in-sync with the cloud tiering.
# mmlsfileset fs1 tctfset1 -L
- Collect the end point
URL.
Ensure that the URL is the same when configuring the TCT on a fileset.# mmcloudgateway cloudStorageAccessPoint list|grep url
A sample output is as follows:url : http://s3.amazonaws.com
- Register an access key and a secret key for a bucket, which was defined as a data
container while configuring the TCT tiering. Keys can be added to AFM issuing the following
command:
Here, the keys assigned to a cloud bucket must be the same as specified in the mmcloudgateway data-container command.# mmafmcoskeys bkt1:s3.amazonaws.com set akey skey
- Stop the migration activities during the promotion.
- Promote the TCT-enabled fileset to an AFM to cloud object storage fileset in the MU mode.
# mmafmcosconfig fs1 tctfset1 --endpoint https://s3.amazonaws.com --object-fs --bucket bkt1 --directory-object --acls --convert --xattr --mode mu
- After the TCT-enabled independent fileset is converted to an AFM to
cloud object storage fileset in the MU mode, issue the following
command:
A list of generated files, which AFM needs to promote, is displayed.# mmafmcosctl fs1 tctfset1 /gpfs/fs1/tctfset1 checkTCT
List of files tiered using the TCT for the fileset tctfset1 - /gpfs/fs1/tctfset1/.mcstore/.mceaEnabledFiles.list.mceaFiles.3290537.
- Perform a lookup on the generated tiered files by issuing the following
command. The TCT style object information is replaced with the AFM style objects information in the
bucket. Therefore, files are not recalled.
# cat /gpfs/fs1/tctfset1/.mcstore/.mceaEnabledFiles.list.mceaFiles.3290537 |xargs ls >/dev/null
- When the fileset state becomes Active, ensure that the AFM
attributes are enabled on both cache and cloud tier and the TCT attributes are removed from each
file.
A sample output is as follows:# mmafmctl fs1 getstate -j tctfset1
Fileset Name Fileset Target Cache State Gateway Node Queue Length Queue numExec ------------ -------------- ------------- ------------ ------------ ------------- tctfset1 http://s3.amazonaws.com:80/bkt1 Active afm-rhel91-1 0 23
- Validate AFM attributes of the cache
fileset.
A sample output is as follows:# mmlsattr -L -d /gpfs/fs1/tctfset1/file1
file name: /gpfs/fs1/tct3/fl1.txt
- Verify that all TCT information from the cloud tiering is replaced by AFM attributes by
querying the bucket. After the promotion, the following objects must be listed:
[2023-10-11 12:42:40 PDT] 1.0MiB file1 [2023-10-11 12:42:41 PDT] 1.0MiB file2 [2023-10-11 12:42:42 PDT] 1.0MiB file3 [2023-10-11 12:42:42 PDT] 1.0MiB file4 [2023-10-18 22:06:15 PDT] 0B .afm/ [2023-10-18 22:06:15 PDT] 0B dir1/ [2023-10-18 22:06:15 PDT] 0B dir2/ [2023-10-18 22:06:15 PDT] 0B dir3/ [2023-10-18 22:06:15 PDT] 0B dir4/
- After all operations are finished, issue the following command to list remaining file, if
any. For more information, see Step 6.
# mmafmcosctl fs1 tctfset1 /gpfs/fs1/tctfset1 checkTCT
If any file is found, perform the lookup operation again. For more information, see Step 7.# cat /gpfs/fs1/tctfset1/.mcstore/.mceaEnabledFiles.list.mceaFiles.3290537 |xargs ls > /dev/null
- Verify that state of the AFM fileset is shown as Active.
- After all data is validated on both cache and cloud, move the .mcstore directory in the fileset path. This directory can be deleted later.
- After you corroborate the successful migration from TCT to AFM, you must disable TCT by following the procedure detailed in the Permanently uninstall Cloud services and clean up the environment section.
Perform all AFM operations such as upload or download as required.