In April, Attunity announced that we had joined OPDi, a cross-vendor and practitioner group dedicated to the sharing of metadata for the purposes of trust and governance.
This week, at the Dataworks conference in San Jose, we announced the first wave of expansion of capabilities that prove our commitment to ODPi’s Metadata Manifesto:
- The maintenance of metadata must be automated
- Metadata management must become ubiquitous
- Metadata access must become open and remotely accessible
- Metadata should be used to drive the governance of data
- Wherever possible, discovery and maintenance of metadata has to be an integral part of all tools that access, change and move information
In particular, we are embracing #5 and shifting Attunity’s vision from a platform that just moves and integrates data to a platform that also delivers the information needed to understand and trust that data.
The new capabilities with Attunity Enterprise Manager (AEM) include:
Centralized Metadata Repository
Attunity is centralizing all the metadata derived across the different components of the platform, whether it be:
- Collected from Source systems,
- Defined as part of Attunity dataflow design,
- Derived from profiling data as it flows, or
- Generated from the execution of Attunity workflows,
On top of this we are providing a data “mini-catalog” to help users better understand, utilize and trust the data flowing through the data pipelines managed by the Attunity platform.
A new GUI within AEM makes it easy to search for, filter and explore the details of data tables and sets of data tables.
Lineage and Impact Analysis View
Within the Metadata Explorer we provide an interactive view of the full pipeline for any data set. From the lineage flow and drilling into the individual component you can answer key questions like these:
- Where did this data set come from?
- How was it changed along the way?
- Can I trust this data for the analysis I’m about to do?
- Who owns it?
- When was it last updated?
- How is this data set being used downstream?
- Who and what will be impacted if I change something?
The Attunity Metadata Repository, Explorer and Lineage Viewer only contain the metadata for the sources and tasks that Attunity touches. For true end-to-end lineage it needs to be combined with similar metadata generated by all of the tools that touch the data.
Initially, we are supporting publishing the metadata to Apache Atlas and Hortonworks DataPlane in order to enable tighter integration and technology alignment with Hortonworks Data Governance tools and processes.
In the future, we intend to extend support to publishing to any ODPi-compliant metadata repository/catalog as well as many other targeted Hadoop, cloud and governance catalogs.
To learn more:
- Read the Attunity Joins ODPi to Further Open Big Data Ecosystem blog article
- Watch the It’s the Final Countdown to GDPR. Are You Ready? Webinar
- Read the Attunity Enhances Data Governance Capabilities for On-Premises and Cloud Data Lakes press release