In 2025, Sifflet introduced several key updates including Databricks Workflows integration for end-to-end pipeline visibility, an upgraded data lineage experience, and conditional monitors with advanced logic. These features support better telemetry instrumentation, real-time metrics tracking, and improved analytics pipeline observability for large-scale enterprises.

Data lineage tracking provides transparency into how data moves and transforms across systems. In hybrid architectures, it helps enforce governance by showing where data comes from, who owns it, and how changes impact downstream consumers, making compliance and audit logging much easier.

Yes, we're excited to share that a native Airbyte connector is in the works! This will make it even easier to integrate and monitor Airbyte pipelines within our observability platform. Stay tuned as we continue to enhance our capabilities around data lineage, automated root cause analysis, and pipeline resilience.

Field-level lineage gives you a detailed view into how individual data fields move and transform through your pipelines. This level of granularity is super helpful for root cause analysis and understanding the impact of changes. A platform with strong data lineage tracking helps teams troubleshoot faster and maintain high data quality.

Sifflet uses AI-powered incident grouping to automatically consolidate related monitor failures into a single incident. By leveraging data lineage tracking and contextual analysis, teams can identify root causes faster and focus on what matters. This approach significantly reduces alert fatigue and improves trust in monitoring systems.

Absolutely! MCP allows LLMs to remember past interactions and call diagnostic tools, which is a game-changer for data pipeline monitoring. It supports multi-turn conversations and structured tool use, making incident response faster and more contextual. This means less time spent digging through logs and more time resolving issues efficiently.

The MCP (Model Context Protocol) Server is a new interface that lets you interact with Sifflet directly from your development environment. It's designed to make data observability more seamless by allowing you to query assets, review incidents, and trace data lineage without leaving your IDE or notebook. This helps streamline your workflow and gives you real-time visibility into pipeline health and data quality.

Data observability plays a crucial role in a DaaP strategy by ensuring that data is accurate, fresh, and trustworthy. With tools like Sifflet, businesses can monitor data pipelines in real time, detect anomalies, and perform root cause analysis to maintain high data quality. This helps build reliable data products that users can trust.