By clicking “Accept”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. View our Privacy Policy for more information.
Jun 20, 2024

Elevate Your Data Observability with Sifflet’s New Fivetran Integration

Post by
Mahdi Karabiben

At Sifflet, our mission has always been to empower data teams with comprehensive observability across their entire data stack. Today, we're excited to announce a significant milestone towards this goal - our new Fivetran integration, expanding Sifflet’s observability landscape into the data movement space.

By integrating Fivetran with Sifflet, you can gain unparalleled visibility into your data's end-to-end journey, ensuring that you’re equipped with the necessary context to swiftly pinpoint the root cause of data incidents.

Navigate end-to-end lineage, starting from where the data is generated

With today’s release, the Sifflet lineage graph no longer starts at the data platform level. Instead, you now have access to two types of nodes that represent your data’s journey before it even reaches the data platform:

  • Fivetran connector nodes: These clickable nodes represent your Fivetran connectors, allowing you to get all the useful information about a given connector with just one click. (More on these nodes below.)
  • Source asset nodes: For every Fivetran connector, Sifflet will create nodes for the source assets from which Fivetran extracts data, giving you complete visibility on your data’s journey. These nodes, which allow you to get a truly end-to-end lineage within Sifflet, represent one of the key differentiators of our Fivetran integration.
End-to-end lineage via the Fivetran integration

Swiftly detect connector issues

When using Fivetran to ingest data from various sources into your data platform, many things can go wrong, ranging from sync delays to connector-breaking errors. With this new integration, the accurate status of your Fivetran connectors will now be accessible in the Sifflet data catalog and via the Fivetran connector nodes in the lineage.

Thanks to the up-to-date connector status, you can proactively prevent data anomalies from cascading downstream and efficiently reduce the resolution time of data incidents.

Key metadata about Fivetran connectors via the catalog's assets list

Get a bird’s-eye view of your Fivetran connectors, no matter where you encounter them in the lineage

Whether you’re navigating the upstream lineage of your dashboard or looking for the owner of a data source, when you encounter a Fivetran connector node in the lineage, you can click on it for key metadata. This information includes the connector’s source and destination, its current status, sync frequency, and the timestamp of the latest sync. Accompanied by the Sifflet metadata that you’re accustomed to (owners, description, and last metadata refresh), this panel gives you, at a glance, all the necessary information about a given connector.

The Fivetran connector metadata panel

Getting Started with the Integration

To connect Fivetran to your Sifflet environment, you can refer to the dedicated documentation page. After following the simple setup guide, Fivetran assets will be accessible via the Sifflet lineage and data catalog.

If you want to see the integration in action and learn more about how Sifflet can empower you with comprehensive observability across your entire data stack, check out our documentation or reach out for a demo.

Related content