Unveiling the 2024 State of Data + AI Report

Hi Data Pros,

We are thrilled to present the latest insights from Databricks' 2024 State of Data + AI report. This comprehensive study sheds light on the current landscape of data intelligence and how organizations are leveraging AI to transform their operations.

Generative AI is revolutionizing how companies innovate, enhance creativity, and boost productivity. I found the charts on GenAI interesting, especially the breakdowns by industry. Check them below!

Key Insights:

AI in Production: Companies are now deploying more AI models in real-world applications, moving from experimentation to production. The efficiency in putting models into production has tripled, with a significant rise in Natural Language Processing (NLP) applications.
​

Customization of LLMs and the Rise of Vector Databases

Organizations are increasingly focusing on customizing Large Language Models (LLMs) using their proprietary data through Retrieval Augmented Generation (RAG). This approach has led to a 377% year-over-year growth in vector database usage.

Key Highlights:

Rapid Adoption of Open Source Models: 76% of companies using LLMs opt for open-source models alongside proprietary ones. Meta Llama 3, within four weeks of its launch, accounted for 39% of all open-source model usage.

Unified Governance and Serverless Model Serving

Unified data and AI governance are critical for organizations to maintain trust and compliance in their AI initiatives. Databricks Unity Catalog is at the forefront, with Financial Services leading its adoption.

Highlights:​
​

Serverless Adoption: Financial Services and Healthcare & Life Sciences have seen significant growth in serverless model serving, enabling real-time ML applications such as personalized recommendations and fraud detection.

Conclusion: The State of Data + AI report highlights the transformative impact of data intelligence platforms in democratizing AI across organizations. As companies continue to innovate, those who effectively harness data and AI will lead the way

For more detailed insights, download the full report here.​

​
Best,

Ravit Jain

Founder & Host of The Ravit Show