Before start, I need to say that I am new to the concept of Big Data and Apache Hive. When following this post to install Hive, I saw that they create another database called metastore. After installing and configuring successfully, I was able to perform some basic commands (create database, table, load data, etc) in Hive shell (by typing ./hive in Hive's bin folder).
When I check in mysql database, there appears 2 new databases: hive & metastore, and I believe metastore database is where the metadata of tables, databases are stored. However, it is not what I expected. Here is the result.
My question is if I have installed Hive successfully or not, and what is the purpose of those 2 databases?
P/s: I have searched for Hive metastore and there are 3 different modes, but I am not sure if that is my case in this situation.
Which metastore does Hive use?
205 Views Asked by GiangHoGoVap At
1
There are 1 best solutions below
Related Questions in HADOOP
- Can anyoone help me with this problem while trying to install hadoop on ubuntu?
- Hadoop No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster)
- Top-N using Python, MapReduce
- Spark Driver vs MapReduce Driver on YARN
- ERROR: org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "maprfs"
- can't write pyspark dataframe to parquet file on windows
- How to optimize writing to a large table in Hive/HDFS using Spark
- Can't replicate block xxx because the block file doesn't exist, or is not accessible
- HDFS too many bad blocks due to "Operation category WRITE is not supported in state standby" - Understanding why datanode can't find Active NameNode
- distcp throws java.io.IOException when copying files
- Hadoop MapReduce WordPairsCount produces inconsistent results
- If my data is not partitioned can that be why I’m getting maxResultSize error for my PySpark job?
- resource manager and nodemanager connectivity issues
- ERROR flume.SinkRunner: Unable to deliver event
- converting varchar(7) to decimal (7,5) in hive
Related Questions in HIVE
- Type Adapter for Offset in hive flutter
- HIVE Sql Date conversion
- How to set spark.executor.extraClassPath & spark.driver.extraClassPath in hive query without adding those in hive-site.xml
- Hive query on HUE shows different timestamp than programatically/on data
- descending order of data in hive using collect_set
- How to optimize writing to a large table in Hive/HDFS using Spark
- Spark SQL repartition before insert operation
- Alter datatype of complex type(array<struct>>) in hive
- SqlAlchemy connection to Hive using http thrift transport and basic auth
- Aggregate values into a new column while retaining the old column
- Is it possible to query MAPR hdfs/hive tables from Trino?
- Can we make a column having both partitioning and bucketing in hive?
- converting varchar(7) to decimal (7,5) in hive
- Extract all characters before numeric values in hive SQL
- Livy session to submit pyspark from HDFS
Related Questions in HIVE-METASTORE
- spark use the metastore with H2
- setup schema in databricks with location using service principal
- java.lang.NoSuchFieldError: HIVE_LOCAL_TIME_ZONE
- How do you add java libraries to the Apache Hive container?
- Flink with Iceberg Catalog and Hive Metastore: org.apache.hadoop.fs.s3a.S3AFileSystem not found
- Codhale metrics not coming in prometheus
- Problem Hive Metastore with Apache BigTop on Centos7
- How to set the owner of a hive metastore table when using java iceberg api to create the table?
- How can I configure Hive Metastore or Spark to respect owner ACL privileges in Spark SQL?
- Istio Envoy Proxy breaks Thrift Service - Hive Metastore
- Hive Metastore Standalone and Apache Ranger Integration
- Reading hive metastore table using `spark.read.format("hive").load(...)` returns "Hive data source can only be used with tables..."
- Spark creating empty hive tables
- Which metastore does Hive use?
- Apache Hive standalone metastore 4.0.0-beta-1 not working with older or Latest MariaDB versions
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
By default, Hive Metastore will use Apache Derby.
It's recommended you change this to be Postgres, Mysql, or Oracle.
The mysql command
CREATE database metastore;doesn't mean anything specific. The hive-site.xml sets the JDBC connection string where the metastore database is configured, and you can provide any name you want.Similar for
hive.Unclear what you expected in those databases for tables, but it's metadata, not actual HDFS records