Docker image of Hive metastore with OpenJDK 8 installed.
100K+
https://github.com/starburstdata/docker-images/tree/master/hive-metastore
Docker image of Hive metastore with OpenJDK 8 installed.
This is required step to use Hive Metastore docker-compose cluster.
Please generate Hive Metastore keytab file and principal. Place keytab file as hive-metastore.keytab
to the same directory where docker-compose.yml is stored.
export HIVE_METASTORE_KERBEROS_PRINCIPAL=...
Put a krb5.conf file to the same directory where docker-compose.yml is stored.
Generating Kerberos principal and keytab (notice that Hive Metastore node is named metastore in docker-compose cluster):
/usr/sbin/kadmin.local -q "addprinc -randkey hive-metastore/[email protected]"
/usr/sbin/kadmin.local -q "xst -norandkey -k /tmp/hive-metastore.keytab hive-metastore/metastore"
Then file hive-metastore.keytab was copied and below was exported:
export HIVE_METASTORE_KERBEROS_PRINCIPAL=hive-metastore/[email protected]
Then krb5.conf was used with following content:
[logging]
default = FILE:/var/log/krb5libs.log
[libdefaults]
default_realm = LABS.STARBURSTDATA.COM
dns_lookup_realm = false
dns_lookup_kdc = false
ticket_lifetime = 24h
renew_lifetime = 7d
forwardable = true
[realms]
LABS.STARBURSTDATA.COM = {
kdc = hadoop-master:88
admin_server = hadoop-master
}
export HIVE_METASTORE_JDBC_URL=jdbc:postgresql://postgres.docker.starburstdata.com/hivemetastore
export HIVE_METASTORE_DRIVER="org.postgresql.Driver"
export HIVE_METASTORE_USER=hivemetastore
export HIVE_METASTORE_PASSWORD=hivemetastore
docker-compose up metastore postgres
Notice that Postgres data is stored locally on host machine (outside of docker). In order to drop the data you need to:
docker-compose down --volumes
In order to access S3 from Hive Metastore (needed to create or drop tables with S3 data) please use:
export S3_ENDPOINT="???"
export S3_ACCESS_KEY="???"
export S3_SECRET_KEY="???"
export HIVE_METASTORE_JDBC_URL=...
export HIVE_METASTORE_DRIVER=...
export HIVE_METASTORE_USER=...
export HIVE_METASTORE_PASSWORD=...
docker-compose up metastore ...
docker-compose down
docker-compose down --volumes
By using this image, you accept the OpenJDK License Agreement for Java SE available here: https://openjdk.java.net/legal/gplv2+ce.html
Content type
Image
Digest
Size
775.5 MB
Last updated
over 7 years ago
docker pull starburstdata/hive-metastore