2019/2/28 星期四

cdh中hive創(chuàng)建表出現(xiàn)中文亂碼問(wèn)題

創(chuàng)新互聯(lián)是一家專(zhuān)注于網(wǎng)站設(shè)計(jì)、成都網(wǎng)站設(shè)計(jì)與策劃設(shè)計(jì),昌都網(wǎng)站建設(shè)哪家好?創(chuàng)新互聯(lián)做網(wǎng)站,專(zhuān)注于網(wǎng)站建設(shè)10多年,網(wǎng)設(shè)計(jì)領(lǐng)域的專(zhuān)業(yè)建站公司;建站業(yè)務(wù)涵蓋:昌都等地區(qū)。昌都做網(wǎng)站價(jià)格咨詢(xún):13518219792

0: jdbc:hive2://192.168.0.141:10000> create table movie(
. . . . . . . . . . . . . . . . . .> userID int comment '用戶(hù)ID',
. . . . . . . . . . . . . . . . . .> movieID int comment '電影ID',
. . . . . . . . . . . . . . . . . .> rating int comment '電影評(píng)分',
. . . . . . . . . . . . . . . . . .> timestamped bigint comment '評(píng)分時(shí)間戳',
. . . . . . . . . . . . . . . . . .> movieName string comment '電影名字', 
. . . . . . . . . . . . . . . . . .> movieType string comment '電影類(lèi)型', 
. . . . . . . . . . . . . . . . . .> sex string comment '性別', 
. . . . . . . . . . . . . . . . . .> age int comment '年齡', 
. . . . . . . . . . . . . . . . . .> occupation string comment '職業(yè)', 
. . . . . . . . . . . . . . . . . .> zipcode string comment '郵政編碼'
. . . . . . . . . . . . . . . . . .> ) comment '影評(píng)三表合一' 
. . . . . . . . . . . . . . . . . .> row format delimited fields terminated by ","
. . . . . . . . . . . . . . . . . .> ;

0: jdbc:hive2://192.168.0.141:10000> desc movie;
INFO : Compiling command(queryId=hive_20190228181919_b6eb4f8a-7d17-4437-b089-750bf2e81d0f): desc movie
INFO : Semantic Analysis Completed
INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:col_name, type:string, comment:from deserializer), FieldSchema(name:data_type, type:string, comment:from deserializer), FieldSchema(name:comment, type:string, comment:from deserializer)], properties:null)
INFO : Completed compiling command(queryId=hive_20190228181919_b6eb4f8a-7d17-4437-b089-750bf2e81d0f); Time taken: 0.036 seconds
INFO : Executing command(queryId=hive_20190228181919_b6eb4f8a-7d17-4437-b089-750bf2e81d0f): desc movie
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing command(queryId=hive_20190228181919_b6eb4f8a-7d17-4437-b089-750bf2e81d0f); Time taken: 0.016 seconds
INFO : OK
+--------------+------------+----------+--+
| col_name | data_type | comment |
+--------------+------------+----------+--+
| userid | int | ??ID |
| movieid | int | ??ID |
| rating | int | ???? |
| timestamped | bigint | ????? |
| moviename | string | ???? |
| movietype | string | ???? |
| sex | string | ?? |
| age | int | ?? |
| occupation | string | ?? |
| zipcode | string | ???? |
+--------------+------------+----------+--+

進(jìn)入MySQL
[root@NewCDH-0--141 ~]# mysql -uroot -p
Enter password:
mysql> show create database hive;
+----------+---------------------------------------------------------------+
| Database | Create Database |
+----------+---------------------------------------------------------------+
| hive | CREATE DATABASE hive /!40100 DEFAULT CHARACTER SET utf8 / |
+----------+---------------------------------------------------------------+
1 row in set (0.02 sec)
直接執(zhí)行下面的命令

mysql> use hive;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

mysql>  alter table COLUMNS_V2 modify column COMMENT varchar(256) character set utf8;
Query OK, 57 rows affected (0.20 sec)
Records: 57  Duplicates: 0  Warnings: 0

mysql> alter table TABLE_PARAMS modify column PARAM_VALUE varchar(4000) character set utf8;
Query OK, 58 rows affected (0.03 sec)
Records: 58  Duplicates: 0  Warnings: 0

mysql> alter table PARTITION_PARAMS  modify column PARAM_VALUE varchar(4000) character set utf8;
Query OK, 0 rows affected (0.03 sec)
Records: 0  Duplicates: 0  Warnings: 0

mysql> alter table PARTITION_KEYS  modify column PKEY_COMMENT varchar(4000) character set utf8;
Query OK, 0 rows affected (0.04 sec)
Records: 0  Duplicates: 0  Warnings: 0

mysql> alter table  INDEX_PARAMS  modify column PARAM_VALUE  varchar(4000) character set utf8;
Query OK, 0 rows affected (0.19 sec)
Records: 0  Duplicates: 0  Warnings: 0

然后需要重新創(chuàng)建表，之前的表還是亂碼

create table movie02(
userID int comment '用戶(hù)ID',
movieID int comment '電影ID',
rating int comment '電影評(píng)分',
timestamped bigint comment '評(píng)分時(shí)間戳',
movieName string comment '電影名字', 
movieType string comment '電影類(lèi)型', 
sex string comment '性別', 
age int comment '年齡', 
occupation string comment '職業(yè)', 
zipcode string comment '郵政編碼'
) comment '影評(píng)三表合一' 
row format delimited fields terminated by ",";

0: jdbc:hive2://192.168.0.141:10000> desc movie02;
+--------------+------------+----------+--+
| col_name | data_type | comment |
+--------------+------------+----------+--+
| userid | int | 用戶(hù)ID |
| movieid | int | 電影ID |
| rating | int | 電影評(píng)分 |
| timestamped | bigint | 評(píng)分時(shí)間戳 |
| moviename | string | 電影名字 |
| movietype | string | 電影類(lèi)型 |
| sex | string | 性別 |
| age | int | 年齡 |
| occupation | string | 職業(yè) |
| zipcode | string | 郵政編碼 |
+--------------+------------+----------+--+
0: jdbc:hive2://192.168.0.141:10000> show create table movie02;
+----------------------------------------------------+--+
| createtab_stmt |
+----------------------------------------------------+--+
| CREATE TABLE movie02( |
| userid int COMMENT '用戶(hù)ID', |
| movieid int COMMENT '電影ID', |
| rating int COMMENT '電影評(píng)分', |
| timestamped bigint COMMENT '評(píng)分時(shí)間戳', |
| moviename string COMMENT '電影名字', |
| movietype string COMMENT '電影類(lèi)型', |
| sex string COMMENT '性別', |
| age int COMMENT '年齡', |
| occupation string COMMENT '職業(yè)', |
| zipcode string COMMENT '郵政編碼') |
| COMMENT '影評(píng)三表合一' |
| ROW FORMAT SERDE |
| 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' |
| WITH SERDEPROPERTIES ( |
| 'field.delim'=',', |
| 'serialization.format'=',') |
| STORED AS INPUTFORMAT |
| 'org.apache.hadoop.mapred.TextInputFormat' |
| OUTPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat' |
| LOCATION |
| 'hdfs://nameservice1/user/hive/warehouse/movie02' |
| TBLPROPERTIES ( |
| 'transient_lastDdlTime'='1551350122') |
+----------------------------------------------------+--+
25 rows selected (0.167 seconds)
亂碼問(wèn)題解決了。

參考鏈接
https://www.cnblogs.com/qingyunzong/p/8724155.html
cdh hive 中文注釋亂碼解決方法(簡(jiǎn)單幾步)：https://blog.csdn.net/lingbo229/article/details/81324624

本文標(biāo)題：cdh中hive創(chuàng)建表出現(xiàn)中文亂碼問(wèn)題
本文路徑：http://www.rwnh.cn/article28/gpocjp.html

成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián)，為您提供外貿(mào)建站、全網(wǎng)營(yíng)銷(xiāo)推廣、用戶(hù)體驗(yàn)、企業(yè)建站、品牌網(wǎng)站設(shè)計(jì)、營(yíng)銷(xiāo)型網(wǎng)站建設(shè)

廣告

聲明：本網(wǎng)站發(fā)布的內(nèi)容（圖片、視頻和文字）以用戶(hù)投稿、用戶(hù)轉(zhuǎn)載內(nèi)容為主，如果涉及侵權(quán)請(qǐng)盡快告知，我們將會(huì)在第一時(shí)間刪除。文章觀點(diǎn)不代表本網(wǎng)站立場(chǎng)，如需處理請(qǐng)聯(lián)系客服。電話(huà)：028-86922220；郵箱：631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載，或轉(zhuǎn)載時(shí)需注明來(lái)源： 創(chuàng)新互聯(lián)