Torsten Steinbach

Cloud February 21, 2023

IBM’s Metastore aaS: There Is No Lake without Metadata

5 min read - Exploring the expanded capability in IBM Cloud to build and manage cloud data lakes on IBM Cloud Object Storage. In particular, it explains the role of table metadata and how the IBM Cloud Data Engine service delivers this important component…

Cloud February 18, 2022

How to Manage Terabytes of Cloud Data with Ray Commands

8 min read - A demonstration of how to leverage the Ray compute framework to perform typical daily operational tasks at cloud-scale on large volumes of data on object storage. The cloud takes on an increasingly essential role in mainstream daily IT operations, including…

Cloud July 8, 2021

Tutorial: Stream Landing from Event Streams Kafka Service to IBM Cloud Data Lake on Object Storage

11 min read - Event Streams is directly integrated with the SQL Query service — this tutorial shows you how to run a fully managed stream data ingestion from Kafka into Parquet on Cloud Object Storage. Machine-generated data, emerging in a real-time streaming fashion,…

Cloud June 29, 2021

Time Series Analytics for IBM Virtual Private Cloud (VPC) Flows Using Grafana

12 min read - Time series analytics using IBM SQL Query and visualization on the Grafana dashboard for data on IBM Cloud Object Storage is now available. IBM Cloud VPC is a public cloud offering that lets you establish your own private cloud-like computing…

Cloud June 24, 2021

Connecting to a Cloud Data Lake with IBM Cloud Pak for Data

6 min read - IBM Cloud Pak for Data now comes with an integrated connector to data lakes on IBM Cloud Object Storage. IBM Cloud provides a fully managed data lake platform for data stored on IBM Cloud Object Storage. The central service of…

Open source March 18, 2021

Dremio with IBM Cloud Data Lake

2 min read - IBM Cloud provides a cloud native data lake platform, which is unique in its commitment to a serverless consumption model.  You can ingest, store, prepare, optimize and analyze your data in a serverless manner that scales resources fully transparently and…

Announcements January 13, 2021

IBM Provides SQL Integration in Cloud Object Storage

< 1 min read - IBM just released a deeper integration of the IBM SQL Query in IBM Cloud Object Storage.  This provides an end-to-end serverless experience and consumption mode for data processing and analytics on cloud object storage. In the IBM Cloud Object Storage…

Cloud January 11, 2021

IBM SQL Query Now Available in India

< 1 min read - Today, we are announcing the launch of the IBM SQL Query service in IBM Cloud Chennai region.  IBM SQL Query is the basis for building serverless cloud data lakes by providing flexible and scalable data preparation and analytics for data…

Cloud October 23, 2020

A Serverless Attack on Ugly Log Archives

2 min read - A critical factor for smart business decisions is learning from the behaviour of your applications and users. The information that fuels such learning is available in the logs generated by your solution stack. Way too often, however, it is still…

Analytics September 30, 2020

A JDBC Driver for Infinite Data

< 1 min read - Today, we are announcing the General Availability of SQL Query’s JDBC Driver. This allows you to take advantage of the power of serverless analytics and data transformation with the effectively limitless storage capacity of IBM Cloud Object Storage. Through the…

Announcements January 13, 2020

Secure Credential Brokering in Analytic Jobs on Cloud Data Sources

3 min read - A quick overview of a new secure mechanism in IBM Cloud SQL Query to pass credentials for accessing, processing, and analyzing data service securely via SQL statements.  The gold standard The best practice for allowing your analytic jobs to access…

Data Science October 21, 2019

Automate Serverless Data Pipelines for Your Data Warehouse or Data Lakes

4 min read - IBM Cloud SQL Query now supports automating the transport and transformation of data from IBM Cloud Object Storage to Db2 on Cloud. Building with flexible, scalable, cloud native services is fun, right? You know what isn’t fun though? Capturing, storing,…