Hadoop Scale Storage Architecture

IBM Spectrum® Scale allows Hadoop applications to access centralized storage or local storage data. All Hadoop nodes can access the storage as a GPFS™ client. You can share a cluster between Hadoop and any other application.

IBM Spectrum Scale has the following supported storage modes that Hadoop can access:

• Centralized Storage Mode:
  • IBM Elastic Storage® Server
  • IBM® Erasure Code Edition
  • Shared Storage (SAN-based storage)
• Local Storage Mode:
  • File Placement Optimizer