Validated storage sizes for all microservices and dependency services

This topic describes how to specify storage sizes for all storage types in Guardium® Insights.

Extra small production (values-xsmall) validated storage sizes

Table 1. Extra small production (values-xsmall) validated storage sizes
Dependencies Size/Replicas Resources (CPU/RAM) Storage/Storage size storageClassName
Db2® (dependency-db2) 1
  • CPU: "6"
  • Memory: "48Gi"
  • For meta: "1000Gi"
  • For data: "5000Gi"
  • For meta: - ReadWriteMany
  • For data: - ReadWriteOnce
MongoDB (dependency-mongodb) 2  
  • For data-volume: 100Gi
  • For logs-volume:100Gi
  • For data-volume: - ReadWriteOnce
  • For logs-volume:- ReadWriteOnce
Kafka (dependency-kafka)
  • For Kafka replicas: 2
  • For Zookeeper replicas: 2
  
  • For Kafka: 100Gi
  • For Zookeeper: 20Gi
  • For Kafka: - ReadWriteOnce
  • For Zookeeper: - ReadWriteOnce

Small production (values-small) validated storage sizes

Table 2. Small production (values-small) validated storage sizes
Dependencies Size/Replicas Resources (CPU/RAM) Storage/Storage size storageClassName
Db2 (dependency-db2) 2
  • CPU: "6"
  • Memory: "48Gi"
  • For meta: "1000Gi"
  • For data: "5000Gi"
  • For meta: - ReadWriteMany
  • For data: - ReadWriteOnce
MongoDB (dependency-mongodb) 3  
  • For data-volume: 250Gi
  • For logs-volume:250Gi
  • For data-volume: - ReadWriteOnce
  • For logs-volume:- ReadWriteOnce
Kafka (dependency-kafka)
  • For Kafka replicas: 3
  • For Zookeeper replicas: 3
  
  • For Kafka: 250Gi
  • For Zookeeper: 20Gi
  • For Kafka: - ReadWriteOnce
  • For Zookeeper: - ReadWriteOnce

Medium production (values-med) validated storage sizes

Table 3. Medium production (values-med) validated storage sizes
Dependencies Size/Replicas Resources (CPU/RAM) Storage/Storage size storageClassName
Db2 (dependency-db2) 3
  • CPU: "10"
  • Memory: "120Gi"
  • For meta: "5000Gi"
  • For data: "5000Gi"
  • For meta: - ReadWriteMany
  • For data: - ReadWriteOnce
MongoDB (dependency-mongodb) 4  
  • For data-volume: 500Gi
  • For logs-volume:500Gi
  • For data-volume: - ReadWriteOnce
  • For logs-volume:- ReadWriteOnce
Kafka (dependency-kafka)
  • For Kafka replicas: 6
  • For Zookeeper replicas: 3
  
  • For Kafka: 250Gi
  • For Zookeeper: 30Gi
  • For Kafka: - ReadWriteOnce
  • For Zookeeper: - ReadWriteOnce

Large production (values-large) validated storage sizes

Table 4. Large production (values-large) validated storage sizes
Dependencies Size/Replicas Resources (CPU/RAM) Storage/Storage size storageClassName
Db2 (dependency-db2) 3
  • CPU: "20"
  • Memory: "248Gi"
  • For meta: "5000Gi"
  • For data: "5000Gi"
  • For meta: - ReadWriteMany
  • For data: - ReadWriteOnce
MongoDB (dependency-mongodb) 5  
  • For data-volume: 500Gi
  • For logs-volume:500Gi
  • For data-volume: - ReadWriteOnce
  • For logs-volume:- ReadWriteOnce
Kafka (dependency-kafka)
  • For Kafka replicas: 9
  • For Zookeeper replicas: 3
  
  • For Kafka: 250Gi
  • For Zookeeper: 50Gi
  • For Kafka: - ReadWriteOnce
  • For Zookeeper: - ReadWriteOnce

Custom resource (CR) file with storage settings

apiVersion: gi.ds.isc.ibm.com/v1
kind: GuardiumInsights
metadata:
  #name: This must be 10 or less characters
  name: gi-sample
  #Provide the name of the namespace in which you want to install the CR.
  namespace: NAMESPACE #staging
spec:
  version: 3.1.4
  license:
    accept: true
    licenseType: "L-GBLK-CDVHGZ"
  connections:
    insightsEnv:
      FEATURE_STAP_STREAMING: "false"
  guardiumInsightsGlobal:
    image:
      insightsPullSecret: ibm-entitlement-key
      repository: cp.icr.io/cp/ibm-guardium-insights
    size: values-xsmall  |  values-small  |  values-med  |  values-large
    insights:
      ingress:
        hostName: HOST_NAME #example - namespace.apps.cluster_name.us-south.containers.appdomain.cloud
        domainName: DOMAIN_NAME #example - apps.cluster_name.us-south.containers.appdomain.cloud
      ics:
        namespace: ibm-common-services
        registry: common-service
    #storageClassName: Must be a ReadWriteMany StorageClass
    storageClassName: STORAGE_CLASS_RWX
  dependency-db2:
  db2:
    size: 1 | 2 | 3 | 3         ==>(values-xsmall  |  values-small  |  values-med  |  values-large) 
    resources:
      requests:
        cpu: "6" | "6" | "10" | "20"        ==>(values-xsmall  |  values-small  |  values-med  |  values-large) 
        memory: "48Gi" | "48Gi" | "120Gi" | "248Gi"    ==>(values-xsmall  |  values-small  |  values-med  |  values-large) 
      limits:
        cpu: "6" | "6" | "10" | "20"        ==>(values-xsmall  |  values-small  |  values-med  |  values-large) 
        memory: "48Gi" | "48Gi" | "120Gi" | "248Gi"    ==>(values-xsmall  |  values-small  |  values-med  |  values-large) 
    storage:
    - name: meta
      spec:
        accessModes:
        - ReadWriteMany
        resources:
          requests:
            storage: "1000Gi" | "1000Gi" | "5000Gi" | "5000Gi"       ==>(values-xsmall  |  values-small  |  values-med  |  values-large)
      type: create
    - name: data
      spec:
        accessModes:
        - ReadWriteOnce
        resources:
          requests:
            storage: "5000Gi" | "5000Gi" | "5000Gi" | "5000Gi"       ==>(values-xsmall  |  values-small  |  values-med  |  values-large)
      type: template
  dependency-kafka:
    kafka:
      storage:
        type: persistent-claim
        size: 100Gi | 250Gi | 250Gi | 250Gi       ==>(values-xsmall  |  values-small  |  values-med  |  values-large)
        class: "STORAGE_CLASS_RWO"
    zookeeper:
      storage:
        type: persistent-claim
        size: 20Gi | 20Gi | 30Gi | 50Gi       ==>(values-xsmall  |  values-small  |  values-med  |  values-large)
        class: "STORAGE_CLASS_RWO"
dependency-mongodb:
  size: 2 | 3 | 4 | 5     ==>(values-xsmall  |  values-small  |  values-med  |  values-large)
  storage:
  - metadata:
      name: data-volume
    spec:
      resources:
        requests:
          storage: 100Gi | 250Gi | 500Gi | 500Gi       ==>(values-xsmall  |  values-small  |  values-med  |  values-large)
      storageClassName: "STORAGE_CLASS_RWO"
  - metadata:
      name: logs-volume
    spec:
      resources:
        requests:
          storage: 100Gi | 250Gi | 500Gi | 500Gi       ==>(values-xsmall  |  values-small  |  values-med  |  values-large)
     storageClassName: "STORAGE_CLASS_RWO"
  mini-snif:
    persistentVolumesClaims:
      mini-snif-shared:
        storageClassName: "STORAGE_CLASS_RWX"
  universal-connector-manager:
    persistentVolumesClaims:
      universal-connector-manager-shared:
        storageClassName: "STORAGE_CLASS_RWX"
  ticketing:
    persistentVolumesClaims:
      ticketing-keystore:
        storageClassName: "STORAGE_CLASS_RWX"