flex.data

With the enormous growth of data being generated and collected by businesses every day we are also seeing a similar growth in number and diversity of people (data engineers, data scientists, business analysts, etc.) interacting with the collected data trying to gain insights, take business decisions and ultimately generate value. These people are leveraging an ever-growing set of tools, technologies and methodologies (ad hoc queries, ETL, ELT, machine learning, artificial intelligence, generative AI, etc.) to collect, process and analyze data in public and private data centers (hybrid cloud) spread globally across different geographies and jurisdictions.

Within the flex.data project we are focusing on developing technologies that make it easier for users to deal with the complexity of processing their data in these complex scenarios by helping them compose the right technology, execution and deployment plan optimizing for cost, performance and compliance.

Some of our work is already available for customers to use in IBM products such as IBM DataStage, IBM ELT Pushdown Express, IBM Analytics Engine and watsonx.data.