A Simpler, Smarter Way to Manage Your Data Sources in Sifflet

Managing data sources is one of those tasks that seems simple on paper but quickly becomes a headache in practice. Multiple schemas, half-synced connections, cryptic failure logs… and suddenly you’re spending hours troubleshooting instead of delivering insights.

We’ve been there. That’s why we’ve reimagined how source management works in Sifflet—from the ground up.

Why this matters

• For data leaders: A clearer, more accurate map of your data landscape means better governance and easier onboarding for your teams.
• For engineers: Less context switching, faster troubleshooting, and fewer “why is this schema broken again?” moments.
• For everyone else: More reliable integrations = fresher data in the tools you actually use.

What’s new

• Environment-level sources
  Forget managing schema by schema. Your Snowflake account or BigQuery project now appears as a single consolidated source in Sifflet. Cleaner, simpler, and closer to how you actually think about your environment.
• Source details at your fingertips
  Clicking a source name now opens a rich details modal. See all schemas, their statuses, and drill into what matters—without hopping between screens.
• Granular metadata refresh
  Need to sync everything? One click. Just need a schema or two? Refresh those individually. Control is back in your hands.
• Smarter failure resolution
  No more digging through endless logs. Failed schemas are automatically listed in a “Failures” tab. From there, you can:
  • Rerun all failures with one button.
  • Open per-schema logs to pinpoint the root cause instantly.
• Official source merging
  Cleaning up duplicate sources? Merge them safely without losing monitors, assets, or history.

For API and Terraform users

We’ve introduced a new API endpoint for environment-level sources. It’s more powerful and future-proof. The legacy schema-level endpoint is deprecated, so we recommend updating your scripts and Terraform configs soon. Full details are in our API docs.

Why it’s a step forward

This redesign isn’t just a UI refresh. It’s about respecting your time. By aligning source management with how you actually operate, we’re cutting the busywork and giving you tools that get out of the way—so you can focus on the data itself.

Try it today

All existing sources have already been migrated, so you can start exploring the new experience right away.

Check out the documentation for details

‍