IBM Cloud Storage Solutions for I - Multi-thread and Multi-part Upload

PTF SI76887 introduces 2 new data areas to control the upload configuration used by ICC when you upload to S3 resources like IBM COS and Amazon AWS Storage. The data areas specify the number of threads used and the individual part size. When you store data to Google Cloud Storage, or FTP, multiple threads are not supported.

- QICC/QICCTHRDCT – thread count. Indicates the number of threads to use. If not present, defaults to 1.
- QICC/QICCPRTSZ – part size in bytes. Size of an individual part on upload. Must be at least 5MB. Defaults to 100MB. Must not exceed 2GB.

After you apply this PTF, perform the following steps to use these new data areas:

Create the Data areas
   Number of threads
  -   CRTDTAARA DTAARA(QICC/QICCTHRDCT) TYPE(*DEC) LEN(2) VALUE(2)
   Part Size
  -   CRTDTAARA DTAARA(QICC/QICCPRTSZ) TYPE(*DEC) LEN(12) VALUE(100000000)

To activate the ICC support to use these data areas, change the ICC job to allow multiple threads.
  - CHGJOBD JOBD(QICC/QICCJOBD) ALWMLTTHD(*YES)

You can adjust the thread count and part size by changing the value for the data areas:
 Number of threads
   -  CHGDTAARA DTAARA(QICC/QICCTHRDCT *ALL) VALUE(4)
Part Size
   -  CHGDTAARA DTAARA(QICC/QICCPRTSZ *ALL) VALUE(100000001)

Use the following commands to display the current values:
   Number of threads
     - DSPDTAARA DTAARA(QICC/QICCTHRDCT)
   Part Size
     -  DSPDTAARA DTAARA(QICC/QICCPRTSZ)

The maximum number of S3 parts allowed per upload is 10,000. Ensure that QICCPRTSZ is large enough in relation to the total size of data that is to be transferred.

The maximum file size in bytes that can be transferred is 10,000 times QICCPRTSZ.

Note: While there is no maximum for the number of threads per upload, IBM recommends starting with a lower number and increasing it incrementally until an acceptable transfer time is achieved. The higher the thread count number, the more resources are used and if too high, can cause unpredictable results including transfer failures. IBM recommends starting with 2 threads and increasing to 10 additional transfer performance if required