You can find the Sifflet team at Booth Y640 during Big Data LDN on September 18-19. Stop by to learn more about our data observability platform and how we’re helping organizations like the BBC and Penguin Random House improve their data reliability.

In 2025, Sifflet introduced several key updates including Databricks Workflows integration for end-to-end pipeline visibility, an upgraded data lineage experience, and conditional monitors with advanced logic. These features support better telemetry instrumentation, real-time metrics tracking, and improved analytics pipeline observability for large-scale enterprises.

The ability to define joins directly in the monitor setup interface means you can now monitor relationships across datasets without writing custom SQL. This is crucial for data quality monitoring because many issues arise from inconsistencies between related tables. Now, you can catch those problems early and ensure better data reliability across your pipelines.

Monte Carlo shines when you're working with a modern cloud stack and need fast, low-effort data observability. Its ML-driven anomaly detection and metadata-focused monitoring make it easy to catch data issues without writing custom rules. If your team wants to improve dashboard reliability quickly, Monte Carlo is a strong option.

A great distinction! Storage platforms hold your actual data, while a data catalog helps you understand what that data means. Sifflet connects both, so when we detect an anomaly, the catalog tells you what business process is affected and who should be notified. It’s how we turn raw telemetry into actionable insights for better incident response automation and SLA compliance.

Absolutely! We know that data patterns can shift during holidays or unique business dates. That’s why Sifflet now lets you exclude these dates from alerts by selecting from common calendars or customizing your own. This helps reduce alert fatigue and improves the accuracy of anomaly detection across your data pipelines.

Real-time metrics are essential for proactive data pipeline monitoring. Sifflet’s observability tools provide real-time alerts and anomaly detection, helping teams quickly identify and resolve issues before they impact downstream systems or violate SLA compliance.

Combining data catalogs with data observability tools creates a holistic approach to managing data assets. While catalogs help users discover and understand data, observability tools ensure that data is accurate, timely, and reliable. This integration supports better decision-making, improves data reliability, and strengthens overall data governance.