What Was Missed at This Year's Gartner D&A Conference?

Hi Data Pros, This year’s Gartner D&A Summit in Orlando was an event brimming with insightful discussions on topics such as AI readiness, as well as new trends like Data Fabric and Data Observability.

At the event, I managed to grab Yael Ben Arie, CEO of Octopai, a leader in Metadata Management and Data Lineage Solutions.

​You can watch our interview here​

Here is some of the feedback Yael gave me at the event:

“While the sessions were enlightening, I couldn't help but notice a significant topic that seemed to be overlooked in achieving success with these complex data initiatives: formally, the complexity of managing intricate data systems that underline data initiatives.

I am certain that the cornerstones that are paramount for data initiatives to succeed are:

​

1. The ongoing need for Data Cleansing and the importance of fighting Data Obesity (pardon the pun) - The use of usage statistics and operational metadata to archive redundant sources and products. To achieve this, data teams need to set data cleansing weekly/monthly routines.

2. The use of a centralized Knowledge Graph as the basis for metadata management and Data Fabric. Metadata needs to reside in a central place, in one solution with all the dependencies between them.

3. Adopting data management best practices in real life - By adopting continuous integration and validation methodologies within the data teams to achieve high data quality, data teams can ensure full impact analysis and tests before any changes are made.

4. Data Governance is for governing, not for daily data management. Data teams need workspaces that will enable them to run faster with full trust in their changes and will mind their challenges.

5. Let the technology work for you! Don’t settle on solutions that require your team to work or rely on external resources. The new generation of data solutions is fully automated and will generate insight and full visualization instantly. Plus, they will stay up to date and give you a live view of your data. Choose solutions that will free you from your routine work and will allow you to free your time for innovation.

Without a holistic repository, visualization, and understanding of your data and its sources through a comprehensive knowledge graph, your ventures into these sophisticated data projects might not reach their full potential. At Octopai, we speak to customers implementing data projects every day. They reiterate that the need for Data Lineage makes success prescient.”

This realization underscored the importance of data lineage and the implementation of a unified knowledge graph in our work. Tackling procedures like Data Cleansing and reducing Data Obesity begins with these foundational processes, which are crucial for navigating the complexities of today's data environments.“

I think Yael has a valid point and I am thrilled to hear Octopai help organizations bring visibility and trust to their data.

​

Best,

Ravit Jain

Founder & Host of The Ravit Show