Articles from Source: Databricks-Blog

An AI-First Approach to Data Engineering with Lakeflow and Agent Bricks

2026-02-24 20:14
Data engineers are embracing AI to enhance data processing. The article discusses how Lakeflow and Agent Bricks integrate AI into every step of the ETL pipeline, streamlining workflows and improving efficiency. This AI-first approach aims to tackle key challenges in data engineering. Discover how these tools are shaping the future of data management! ๐ŸŒ๐Ÿค–๐Ÿ“Š #DataEngineering #AI #ETL #Automation #Lakeflow
Source: Databricks Blog

Spark Declarative Pipelines: Why Data Engineering Needs to Become End-to-End Declarative

2026-02-23 21:40
Data engineering teams face increasing demands for high-quality data delivered quickly. The article discusses the importance of adopting end-to-end declarative pipelines to address these challenges. This approach can streamline processes and enhance efficiency in data management. Embracing declarative methodologies may be key to meeting the evolving needs of data engineering. #DataEngineering #DeclarativePipelines #DataManagement #Efficiency #TechTrends
Source: Databricks Blog

Announcing General Availability of Zerobus Ingest, part of Lakeflow Connect

2026-02-23 16:00
๐Ÿš€ Exciting news! Zerobus Ingest is now generally available as part of Lakeflow Connect. Organizations can now stream over 10 GB/sec to their lakehouse in under 5 seconds, eliminating infrastructure overhead. This advancement aims to enhance real-time operational intelligence. Learn more about how this innovation can help your organization! ๐ŸŒ #Zerobus #LakeflowConnect #DataStreaming #Innovation #RealTimeData
Source: Databricks Blog

From AI projects to an operational capability

2026-02-19 23:00
As organizations advance from pilot AI projects to full operational capabilities, a shift in focus is necessary. The article discusses how the key to success lies in architecture rather than mere experimentation. This architectural approach is crucial for effectively integrating AI into business functions. Understanding this transition can pave the way for more impactful AI applications. ๐Ÿค–๐Ÿ“Š #AI #BusinessStrategy #Innovation #DataDriven #TechTrends
Source: Databricks Blog

Use Genie Everywhere with Enterprise OAuth

2026-02-19 18:50
Unlocking data access just got easier! ๐Ÿ”‘ The article discusses the integration of Enterprise OAuth with Genie, enhancing secure and seamless access to insights for users. This advancement aims to democratize data and improve usability across platforms. Stay informed on how this technology can transform your data experience! ๐Ÿ“Šโœจ #DataAccess #EnterpriseOAuth #TechInnovation #Genie #SecureInsights
Source: Databricks Blog

Flexible Node Types Are Now Generally Available

2026-02-18 22:30
๐Ÿš€ Flexible Node Types are now available! This update aims to enhance cluster launch reliability and help lower compute costs. Automatic instance fallback is introduced to address challenges in securing specific compute capacity, especially during peak traffic. Stay informed on how these changes can benefit your operations! #CloudComputing #TechUpdates #NodeTypes #ComputeCapacity #ITInnovation
Source: Databricks Blog

Predictive Optimization at Scale: A Year of Innovation and Whatโ€™s Next

2026-02-18 20:00
๐Ÿš€ Exciting updates in predictive optimization are here! A recent article highlights advancements in lakehouse technology, focusing on faster queries and reduced storage costs. Automation is enhancing the management of Unity Catalog tables, leading to greater efficiency. Stay tuned for more innovations in data management! #DataOptimization #Lakehouse #Innovation #Automation #TechTrends
Source: Databricks Blog

Custom Agents now available on Databricks

2026-02-18 16:04
๐Ÿš€ Exciting news for Databricks users! Custom Agents, previously known as Agent Framework, are now available. This new feature allows users to build and deploy AI agents quickly and efficiently as serverless production apps. Enhance your workflow with your preferred tools while maintaining governance. #Databricks #AI #CustomAgents #TechUpdate #Serverless
Source: Databricks Blog

Business Analytics: Essential Tools, Techniques and Skills for Data-Driven Success

2026-02-17 19:52
Unlocking the potential of business analytics is crucial for organizations aiming for data-driven success. ๐Ÿ“Š This article outlines essential tools and techniques, including data visualization and statistical analysis, that empower businesses to make informed decisions. Additionally, it highlights the key skills needed for professionals in this field, ensuring effective interpretation of data. #BusinessAnalytics #DataDriven #DataStrategy #AnalyticsTools #ProfessionalDevelopment
Source: Databricks Blog

The Marketing Cloud and Adstra deliver identity resolution through Databricks Clean Rooms for secure, privacy-first marketing data collaboration

2026-02-17 18:50
The Marketing Cloud and Adstra are enhancing identity resolution using Databricks Clean Rooms. This collaboration aims to provide secure, privacy-focused marketing data solutions. Marketers can now leverage data-driven strategies that prioritize consumer privacy and trust. This approach addresses the growing need for responsible data utilization in marketing. ๐Ÿ”’๐Ÿ“Š๐Ÿค #MarketingCloud #DataPrivacy #IdentityResolution #Adstra #DigitalMarketing
Source: Databricks Blog

Best Practices for High QPS Model Serving on Databricks

2026-02-17 18:15
Unlock the potential of real-time machine learning with best practices for high QPS model serving on Databricks. This article outlines strategies to meet customer expectations for instant responses in applications like recommendations. Explore how to enhance performance and efficiency within the Lakehouse environment. #MachineLearning #Databricks #AI #RealTimeData #BestPractices ๐Ÿ“Š๐Ÿ’ก๐Ÿ”
Source: Databricks Blog

How Databricks System Tables Help Data Engineers Achieve Advanced Observability

2026-02-17 16:59
Struggling with data pipeline issues at 3 AM? Databricks System Tables offer a solution! These tables provide data engineers with centralized visibility, simplifying the tracking of pipeline health. This leads to more reliable workloads and effective management of data operations. Discover how to operationalize insights and maintain your data's integrity. ๐Ÿ“Š๐Ÿ” #DataEngineering #Databricks #DataObservability #DataPipelines #TechSolutions
Source: Databricks Blog

Ship Enterprise Apps Faster with Databricks AppKit and Replit

2026-02-17 16:00
๐Ÿš€ Databricks Apps is designed to help businesses build and deploy applications securely and efficiently. ๐Ÿ’ป The integration of Databricks AppKit with Replit aims to improve the developer experience, enabling faster app delivery. This combination allows teams to create production-grade applications quickly and effectively. #Databricks #AppDevelopment #Innovation #Replit #TechTrends
Source: Databricks Blog

Getting the Full Picture: Unifying Databricks and Cloud Infrastructure Costs

2026-02-12 22:00
Discover how to effectively manage total cost of ownership (TCO) on Databricks. ๐Ÿงฎ The article highlights the importance of unifying Databricks and cloud infrastructure costs. It emphasizes the need for automated cost dashboards that meet the needs of FinOps and Platform teams. Learn how to enhance your AI and data investment strategies. ๐Ÿ“Š #Databricks #CloudCosts #FinOps #DataManagement #AI
Source: Databricks Blog

AI/BI Genie, Foundational Model API, and Databricks Assistant Now Generally Available in AWS GovCloud

2026-02-12 07:00
๐Ÿš€ Exciting news for government agencies! The AI/BI Genie, Foundational Model API, and Databricks Assistant are now available in AWS GovCloud. These tools are designed to support organizations with strict compliance needs, enhancing their capabilities with generative AI. This release aims to empower the government community by streamlining processes and improving access to advanced technologies. #GovTech #AWS #AI #Compliance #Innovation
Source: Databricks Blog

The Collaboration Advantage: How Modern Retailers and CPG Brands Win Together

2026-02-12 00:45
In the article "The Collaboration Advantage," modern retailers and CPG brands are highlighted for their shift towards real-time intelligence. Leading executives are breaking down data silos to enhance decision-making in merchandising, supply chain, and market strategies. This collaboration is key to navigating challenges and improving overall efficiency. #RetailInnovation #CPG #DataIntelligence #Collaboration #SupplyChain ๐Ÿ›’๐Ÿ“Š๐Ÿค
Source: Databricks Blog

Whatโ€™s New in AI/BI - February 2026 Roundup

2026-02-11 20:21
๐Ÿš€ Exciting developments in AI/BI for February 2026! This month, Databricks has introduced new features in Databricks One, Dashboards, and Genie. The focus remains on enhancing agentic analytics capabilities, aiming to deliver more intelligent insights. Stay updated on the latest innovations in the field! #AI #BusinessIntelligence #Databricks #Analytics #Innovation
Source: Databricks Blog

Building Whatโ€™s Next. Together. Introducing the Brickbuilder Partner Network for the Agentic AI Era

2026-02-11 19:30
๐Ÿš€ Exciting developments are on the horizon with the introduction of the Brickbuilder Partner Network! This initiative aims to support Consulting & SI partners, ISVs, and data providers in accelerating growth. It focuses on rewarding consumption and enabling partners to build and scale agentic AI solutions on the Databricks Data Intelligence Platform. Stay tuned for more updates! #AI #DataIntelligence #Partnerships #Innovation #Technology
Source: Databricks Blog

Structured vs unstructured data

2026-02-11 14:34
Understanding data types is essential for organizations today. Structured data is highly organized and easily searchable, often found in databases. In contrast, unstructured data lacks a predefined format, including text, images, and videos, making it more challenging to analyze. Both types are crucial for informed decision-making and strategy development. ๐Ÿ“Š๐Ÿ’ป #DataStrategy #StructuredData #UnstructuredData #BusinessIntelligence #DataAnalysis
Source: Databricks Blog

How AI Is Transforming Data Analytics

2026-02-11 13:24
AI is reshaping the landscape of data analytics. Organizations are adopting AI tools to enhance their data processing capabilities, leading to more accurate insights. These technologies streamline data management and enable predictive analytics, helping businesses make informed decisions faster. The integration of AI is not just a trend; it's a fundamental shift in how data is utilized. ๐Ÿ“Š๐Ÿค– #DataAnalytics #AI #BusinessIntelligence #TechTrends #Innovation
Source: Databricks Blog

Modernize your Data Engineering Platform with Lakeflow on Azure Databricks

2026-02-10 19:54
Transform your data engineering with Lakeflow on Azure Databricks! ๐ŸŒ This platform offers a unified solution for ingesting, transforming, and orchestrating workloads seamlessly. It integrates built-in security and governance for better management. Experience flexible user interfaces and efficient troubleshooting through native observability. Plus, keep costs manageable while maximizing performance. #DataEngineering #AzureDatabricks #Lakeflow #TechInnovation #DataManagement
Source: Databricks Blog

Agent Bricks Supervisor Agent is Now GA: Orchestrate Enterprise Agents

2026-02-10 17:00
๐Ÿš€ Exciting news for enterprises! The Agent Bricks Supervisor Agent is now generally available. This new tool enables organizations to enhance their agent development for applications like financial analysis and customer service. With this advancement, companies can better orchestrate their enterprise agents to improve efficiency and performance. #AgentBricks #EnterpriseSolutions #AI #CustomerService #Innovation
Source: Databricks Blog

How to improve patient outcomes with next best actions using a Composable CDP on Databricks

2026-02-10 09:36
Enhancing patient outcomes is a key goal in healthcare. The article discusses the challenges of data-driven healthcare journeys and introduces the Composable Customer Data Platform (CDP) on Databricks as a solution. This platform helps organizations decouple data from outreach, facilitating smarter, HIPAA-compliant interactions. It also explores use cases for implementing next best actions in patient engagement. ๐Ÿ“Š๐Ÿ’ก๐Ÿฅ #HealthcareInnovation #PatientOutcomes #DataDriven #ComposableCDP #Databricks
Source: Databricks Blog

Introducing the new Databricks Partner Program and Well-Architected Framework for ISVs and Data Providers

2026-02-10 00:00
๐Ÿ“ข Exciting news from Databricks! The company has launched a new Partner Program and a Well-Architected Framework aimed specifically at Independent Software Vendors (ISVs) and data providers. This initiative is designed to enhance collaboration and support for over 20,000 customers, including more than 60% of the Fortune 500. Learn more about how this program can benefit your business! ๐ŸŒŸ #Databricks #Partnership #ISVs #DataProviders #Innovation
Source: Databricks Blog

Why Apache Spark Real-Time Mode Is A Game Changer for Ad Attribution

2026-02-09 19:15
Apache Sparkโ„ข Structured Streaming Real-Time Mode is set to transform ad attribution processes. With this new feature, users can achieve sub-second latency, streamlining operations significantly. It allows for the development of stateful ad attribution pipelines without the need for complex infrastructure. This advancement could enhance efficiency in data streaming. ๐Ÿ“Š๐Ÿš€ #ApacheSpark #DataStreaming #AdAttribution #TechInnovation #RealTimeData
Source: Databricks Blog

SAP and Salesforce Data Integration for Supplier Analytics on Databricks

2026-02-07 00:30
Unlock the power of supplier analytics by integrating SAP and Salesforce on Databricks. Utilize SAP Business Data Cloud Connect and Lakeflow Connect to unify your CRM and ERP data seamlessly. This integration can enhance your supplier insights and decision-making processes. Stay ahead in data management! ๐Ÿ“Š๐Ÿ”— #DataIntegration #SupplierAnalytics #SAP #Salesforce #Databricks
Source: Databricks Blog

How to Build Production-Ready Genie Spaces, and Build Trust Along the Way

2026-02-06 23:10
Building production-ready Genie Spaces involves a detailed process from creation to optimization. The article discusses the importance of accuracy through benchmark evaluation and systematic optimization in self-service analytics. It emphasizes the need for trust in the Genie feature of Databricks. Learn how to enhance your analytics experience effectively. ๐Ÿ“Š๐Ÿ” #DataAnalytics #GenieSpaces #Databricks #Optimization #TrustInData
Source: Databricks Blog

Databricks Named a Leader in the IDC MarketScape: Worldwide Unified AI Governance Platforms 2025-2026 Vendor Assessment

2026-02-06 15:49
๐Ÿš€ Exciting news! Databricks has been recognized as a Leader in the IDC MarketScape for Worldwide Unified AI Governance Platforms for 2025-2026. This assessment highlights Databricks' strong position in the market, showcasing its innovative solutions in AI governance. Stay tuned for more updates on their continued success! #Databricks #AIGovernance #IDCMarketScape #TechNews #Innovation
Source: Databricks Blog

Tutorial: 3 Free Databricks Analytics Projects You Can Do In An Afternoon

2026-02-05 19:00
๐Ÿš€ Looking to boost your analytics skills? Check out this tutorial featuring three free Databricks projects you can complete in just one afternoon. These hands-on projects are designed for the Databricks Free Edition and include everything you need: data, dashboards, and AI insights. Perfect for enhancing your portfolio or preparing for interviews! Get started and showcase your capabilities! ๐Ÿ“Šโœจ #DataAnalytics #Databricks #PortfolioProjects #AIInsights #CareerGrowth
Source: Databricks Blog

From Data to Dialogue: A Best Practices Guide for Building High-Performing Genie Spaces

2026-02-05 07:15
Unlock the potential of self-service analytics with the latest guide on building high-performing Genie Spaces. The article outlines best practices for fostering environments that encourage data-driven dialogue within organizations. By integrating AI-powered tools, teams can enhance their decision-making capabilities. Learn how to empower everyone to leverage data effectively! ๐Ÿ“Šโœจ #DataAnalytics #GenieSpaces #BusinessIntelligence #AI #BestPractices
Source: Databricks Blog

The Top 10 Best Practices for AI/BI Dashboards Performance Optimization (Part 1)

2026-02-04 22:40
๐Ÿš€ Optimizing AI/BI dashboards is crucial for performance. The article outlines that performance issues often arise from multiple factors rather than just one. It offers best practices to enhance dashboard efficiency, ensuring smoother data visualization and improved user experience. Stay tuned for more insights in Part 2! #AIDashboards #BIPerformance #DataVisualization #Optimization #BestPractices
Source: Databricks Blog

The Top 10 Best Practices for AI/BI Dashboards Performance Optimization (Part 2)

2026-02-04 22:40
Optimize your Databricks AI/BI dashboards for better performance! ๐Ÿ“Š In the second part of this series, the article highlights essential practices to ensure your dashboards run efficiently. Key strategies include refining data queries, utilizing caching effectively, and ensuring optimal visualization techniques. Implementing these practices can significantly enhance user experience and dashboard responsiveness. #AIDashboard #DataVisualization #PerformanceOptimization #Databricks...
Source: Databricks Blog

Unlocking the Future of Energy with Smart Meter Innovation

2026-02-04 21:10
Southern Company is transforming the energy sector by utilizing smart meter innovation. Through AI-powered analytics and advanced meter intelligence, they are converting data from 4.6 million smart meters into real-time insights. This enhances grid resilience and adds value for customers. Stay updated on the future of energy! โšก๐Ÿ”Œ #SmartMeters #EnergyInnovation #AI #GridResilience #SouthernCompany
Source: Databricks Blog

Data Quality Monitoring at scale with Agentic AI

2026-02-04 16:10
๐ŸŒ Organizations increasingly face challenges in maintaining data quality as they develop more data and AI products. Agentic AI offers a solution, built on Unity Catalog, to monitor data quality effectively at scale. It helps in early issue detection and quick resolution, enhancing overall data management. Stay ahead in data quality with innovative tools! #DataQuality #AI #AgenticAI #UnityCatalog #DataManagement
Source: Databricks Blog

How enterprises are preparing for agentic AI

2026-02-04 15:30
Enterprises are transitioning from basic generative AI to developing autonomous, goal-driven systems. This shift involves understanding how to prepare for agentic AI, focusing on readiness and implementation strategies. Organizations are exploring the implications of these advanced systems on their operations. Stay informed about the evolving landscape of AI! ๐Ÿค–๐Ÿ’ผ #AI #AgenticAI #BusinessStrategy #Innovation
Source: Databricks Blog

Accelerating Drug Discovery: From FASTA Files to GenAI Insights on Databricks

2026-02-04 09:30
Accelerating drug discovery is crucial due to its slow and costly nature. ๐Ÿ’Š The article discusses an end-to-end pipeline that integrates data engineering, protein language models, and Generative AI on the Databricks platform. This approach aims to streamline the drug development process, making it more efficient. Learn how technology is transforming research and development in pharmaceuticals! ๐Ÿ’ป๐Ÿ”ฌ #DrugDiscovery #GenAI #Databricks #Pharmaceuticals #Innovation
Source: Databricks Blog

Data Integration

2026-02-03 19:00
Data integration is the process of combining data from various sources to provide a unified view. This approach helps organizations improve decision-making and streamline operations. Key benefits include enhanced data accuracy, increased efficiency, and better insights for strategic planning. Understanding data integration is crucial in today's data-driven environment. ๐Ÿ“Š๐Ÿ”— #DataIntegration #BusinessIntelligence #DataManagement #Analytics
Source: Databricks Blog

Delta Lake Explained: Boost Data Reliability in Cloud Storage

2026-02-03 18:50
Delta Lake enhances data reliability in cloud storage for organizations. It addresses challenges like data consistency and reliability, enabling better data management. By providing ACID transaction support, Delta Lake ensures that data is always accurate and accessible, improving analytics and operational efficiency. Explore how this technology can transform your data strategies! ๐Ÿ“Šโ˜๏ธ๐Ÿ” #DeltaLake #DataManagement #CloudStorage #DataReliability #DataAnalytics
Source: Databricks Blog

What is Data Engineering?

2026-02-03 18:40
Data engineering involves designing, building, and maintaining systems for managing data. Key components include core concepts, the data engineering lifecycle, and various data storage solutions. The article also contrasts data engineering with related disciplines and explains its importance for organizations. Modern approaches to data engineering are also highlighted. ๐Ÿ“Š๐Ÿ”ง #DataEngineering #DataManagement #TechTrends
Source: Databricks Blog