Hive中怎樣創(chuàng)建內(nèi)部數(shù)據(jù)表和外部數(shù)據(jù)表？

數(shù)據(jù)表是存儲(chǔ)數(shù)據(jù)的基本單位，Hive數(shù)據(jù)表主要分為內(nèi)部表(又叫托管表)和外部表，以?xún)?nèi)部表和外部表為基礎(chǔ)可以創(chuàng)建分區(qū)表或分桶表，即內(nèi)/外部分區(qū)表或內(nèi)/外部分桶表。接下來(lái)，針對(duì)內(nèi)部表和外部表進(jìn)行詳細(xì)講解。

默認(rèn)情況下，內(nèi)部表和外部表的數(shù)據(jù)都存儲(chǔ)在Hive配置文件中參數(shù)hive.metastore.warehouse.dir指定的路徑。它們的區(qū)別在于刪除內(nèi)部表時(shí)，內(nèi)部表的元數(shù)據(jù)和數(shù)據(jù)會(huì)一同刪除;而刪除外部表時(shí)，只刪除外部表的元數(shù)據(jù)，不會(huì)刪除數(shù)據(jù)。外部表相對(duì)來(lái)說(shuō)更加安全，數(shù)據(jù)組織更加靈活并且方便共享源數(shù)據(jù)文件。

CREATE TABLE IF NOT EXISTS
hive_database.managed_table(
staff_id INT COMMENT "This is staffid",
staff_name STRING COMMENT "This is staffname",
salary FLOAT COMMENT "This is staff salary",
hobby ARRAY<STRING> CONMENT "This is staff hobby",
deduct(hps MAP<STRING, FLOAT> COMMENT "This is staff deduction",
address STRUCT<street:STRING,city:STRING> COMMENT "This is staff address"
)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ','
COLLECTION ITEMS TERMINATED BY
MAP KEYS TERMINMTED BY  ':'
LINES TERMINATED BY '\n'
STORED AS textfile
TBLPROPERTIES("comment"="This is a managed table");

上述命令中，指定ROW FORMAT DELIMITED子句使用Hive內(nèi)置的Serde，自定義字段(FIELDS)分隔符為“，”;自定義集合元素(COLLECTION ITEMS)的分隔符為“_”;自定義MAP(MAP KEYS)的鍵值對(duì)分隔符為“：”;自定義行(LINES)分隔符為\n。

(2)創(chuàng)建外部表external_table的命令如下。

CREATE TABLE IF NOT EXISTS
hive_database.managed_table(
staff_id INT COMMENT "This is staffid",
staff_name STRING COMMENT "This is staffname",
salary FLOAT COMMENT "This is staff salary",
hobby ARRAY<STRING> CONMENT "This is staff hobby",
deduct(hps MAP<STRING, FLOAT> COMMENT "This is staff deduction",
address STRUCT<street:STRING,city:STRING> COMMENT "This is staff address"
)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ','
COLLECTION ITEMS TERMINATED BY
MAP KEYS TERMINMTED BY  ':'
LINES TERMINATED BY '\n'
STORED AS textfile
TBLPROPERTIES("comment"="This is a managed table");

上述命令中，通過(guò)在CREATETABLE句式中指定EXTERNAL子句創(chuàng)建外部表。創(chuàng)建外部表時(shí)通常配合LOCATION子句指定數(shù)據(jù)的存儲(chǔ)位置，便于數(shù)據(jù)的維護(hù)與管理。