We’ve rolled out several powerful updates to help you monitor data quality more effectively. One highlight is our new referential integrity monitor, which ensures logical consistency between tables, like verifying that every order has a valid customer ID. We’ve also enhanced our Data Quality as Code framework, making it easier to scale monitor creation with templates and for-loops.

Aligning data observability with business goals transforms data from a technical asset into a strategic one. By setting clear KPIs and linking data quality monitoring to business impact, teams can make smarter decisions, improve SLA compliance, and drive real value from their data investments.

Data lineage adds context to data observability by linking alerts to their root cause. For example, if a metric suddenly drops, lineage helps trace it back to a delayed ingestion or schema change. This speeds up incident resolution and strengthens anomaly detection. Platforms like Sifflet combine lineage with real-time metrics and data freshness checks to provide a complete view of pipeline health.

SQL Table Tracer uses Antlr4 and a unified grammar with semantic predicates to support multiple SQL dialects like Snowflake, Redshift, and PostgreSQL. This ensures accurate data lineage tracking across diverse systems without needing separate parsers for each dialect.

We're excited to use this funding to accelerate product innovation, expand our North American presence, and grow our team. Our focus will be on enhancing AI-powered capabilities, improving data pipeline monitoring, and helping customers maintain data reliability at scale.

Apache Spark and dbt are powerful tools for managing different aspects of data transformation. Spark is great for large-scale, distributed processing, especially when working with complex transformations and high data volumes. dbt, on the other hand, brings software engineering best practices to SQL-based transformations, making it ideal for analytics engineering. Both tools benefit from integration with observability platforms to ensure transformation pipelines run smoothly and reliably.

For Adaptavist, observability culture means going beyond tools. It's about clear ownership of alerts, integrating data quality monitoring into sprints, and giving stakeholders ways to provide feedback directly in dashboards. They even track observability metrics to continuously improve their own observability practices.

Great question! In static mode, Sifflet checks whether data has arrived during a specific time slot and alerts you if it hasn’t. In dynamic mode, our system learns your data arrival patterns over time and only sends alerts when something truly unexpected happens. This helps reduce alert fatigue while maintaining high standards for data quality monitoring.