dhi.io/datahub-mae-consumer
DataHub MAE Consumer
The DataHub MAE Consumer is a Kafka consumer service that ingests MetadataChangeLog and PlatformEvent topics into DataHub's Elasticsearch search index and Neo4j graph store, keeping the search and lineage indices in sync with metadata changes produced by the DataHub GMS.
pushed 2 days ago
linux/amd64, linux/arm64
696.69 MB
for linux/amd64
1027
for linux/amd64
Active support
java, dockerize
Build Level 3
Tamper-evident proof of how and from what sources this image was built. Build Level 3 is the highest the SLSA build track defines.
CycloneDX SBOM + SPDX SBOM
A software bill of materials in both CycloneDX and SPDX formats so it drops straight into your existing tooling. Audit exactly what you're shipping.
A Vulnerability Exploitability exchange document, Docker's assessment of which CVEs actually affect this image and which don't apply, so you can focus on real risk instead of chasing false positives.
Available
A link to everything used to build the image, package source code, Git repos, and build files, so you can audit or reproduce the build and stay compliant with open source licenses.
Every known vulnerability in this image, shown in full rather than hidden. The VEX data flags which ones actually apply, so you can tell real exposure from noise before you ship.
Exactly what changed in this build, down to the package bumps and fixes behind the version you're pulling.
Verifies no keys, tokens, or credentials were accidentally baked into the image.
The image layers were scanned for known malware signatures before publishing.
About DataHub MAE Consumer
DataHub MAE Consumer (Metadata Audit Event Consumer) is the Kafka consumer service responsible for ingesting
MetadataChangeLog events into DataHub's search and graph indices. It subscribes to the MetadataChangeLog_Versioned_v1
and MetadataChangeLog_Timeseries_v1 topics produced by the DataHub GMS (General Metadata Service) and writes the
parsed events into Elasticsearch or OpenSearch for full-text search and, optionally, into Neo4j for graph-based lineage
traversal. When PE_CONSUMER_ENABLED=true, it also processes the PlatformEvent_v1 topic. The MAE Consumer is a Spring
Boot application built on OpenJDK 17 and is a required backend component of every DataHub deployment.
For more information about DataHub, visit https://datahub.com.
About Docker Hardened Images
Docker Hardened Images are built to meet the highest security and compliance standards. They provide a trusted foundation for containerized workloads by incorporating security best practices from the start.
Why use Docker Hardened Images?
These images are published with near-zero known CVEs, include signed provenance, and come with a complete Software Bill of Materials (SBOM) and VEX metadata. They're designed to secure your software supply chain while fitting seamlessly into existing Docker workflows.
Trademarks
DataHub™ is a trademark of the DataHub Project (https://github.com/datahub-project), maintained by Acryl Data, Inc. All rights in the mark are reserved to their respective owners. Any use by Docker is for referential purposes only and does not indicate sponsorship, endorsement, or affiliation.