sqoop2和sqoop1有較大的區(qū)別。將整體的ETL過程分割成server和client兩部分執(zhí)行,sqoop2是交互式的操作。
公司主營業(yè)務(wù):成都網(wǎng)站設(shè)計、做網(wǎng)站、移動網(wǎng)站開發(fā)等業(yè)務(wù)。幫助企業(yè)客戶真正實現(xiàn)互聯(lián)網(wǎng)宣傳,提高企業(yè)的競爭能力。創(chuàng)新互聯(lián)建站是一支青春激揚、勤奮敬業(yè)、活力青春激揚、勤奮敬業(yè)、活力澎湃、和諧高效的團隊。公司秉承以“開放、自由、嚴謹、自律”為核心的企業(yè)文化,感謝他們對我們的高要求,感謝他們從不同領(lǐng)域給我們帶來的挑戰(zhàn),讓我們激情的團隊有機會用頭腦與智慧不斷的給客戶帶來驚喜。創(chuàng)新互聯(lián)建站推出南開免費做網(wǎng)站回饋大家。
解壓安裝
[hadoop@fa01 ~]$ tar -zxvf sqoop-1.99.7-bin-hadoop200.tar.gz -C ./
重命名
[hadoop@fa01 ~]$ mv sqoop-1.99.7-bin-hadoop200 sqoop-1.99.7
同時新建一個extra文件,放置MySQL的驅(qū)動文件(文件名隨意,配置文件相對應(yīng)上就可以)
[hadoop@fa01 sqoop-1.99.7]$ mkdir extra
[hadoop@fa01 ~]$ mv mysql-connector-java-5.1.5-bin.jar /home/hadoop/sqoop-1.99.7/extra/
配置環(huán)境變量。配置sqoop第三方j(luò)ar包引用變量
[hadoop@fa01 ~]$ vim .bash_profile
export SQOOP_HOME=/home/hadoop/sqoopsqoop-1.99.7
export SQOOP_SERVER_EXTRA_LIB=/home/hadoop/sqoop-1.99.7/extra
修改hadoop的core-site.xml文件,這里的hadoop為用戶名
[hadoop@fa01 ~]$ cd hadoop-2.6.0-cdh6.5.2/etc/hadoop
[hadoop@fa01 hadoop]$ vim core-site.xml
<property>
<name>hadoop.proxyuser.hadoop.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.hadoop.groups</name>
<value>*</value>
</property>
配置sqoop里的conf文件里面的# Hadoop configuration directory
[hadoop@fa01 ~]$ cd sqoop-1.99.7/conf/
[hadoop@fa01 conf]$ vim sqoop.properties
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/hadoop/hadoop-2.6.0-cdh6.5.2/etc/hadoop
檢查sqoop是否配置成功
[hadoop@fa01 bin]$ ./sqoop2-tool verify
Setting conf dir: /home/hadoop/sqoop-1.99.7/bin/../conf
Sqoop home directory: /home/hadoop/sqoop-1.99.7
Sqoop tool executor:
Version: 1.99.7
Revision:435d5e61b922a32d7bce567fe5fb1a9c0d9b1bbb
Compiled on Tue Jul 19 16:08:27 PDT 2016 by abefine
Running tool: class org.apache.sqoop.tools.tool.VerifyTool
2017-06-21 01:31:48,489 INFO [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.
2017-06-21 01:31:48,539 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread
Verification was successful.
Tool class org.apache.sqoop.tools.tool.VerifyTool has finished correctly.
啟動sqoop
[hadoop@fa01 bin]$ ./sqoop2-server start
Setting conf dir: /home/hadoop/sqoop-1.99.7/bin/../conf
Sqoop home directory: /home/hadoop/sqoop-1.99.7
Starting the Sqoop2 server...
2017-06-21 01:32:31,088 INFO [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.
2017-06-21 01:32:31,100 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread
Sqoop2 server started.
文章題目:安裝sqoop1.99.7
網(wǎng)址分享:http://www.rwnh.cn/article14/jieede.html
成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián),為您提供軟件開發(fā)、網(wǎng)站營銷、用戶體驗、標簽優(yōu)化、網(wǎng)站排名、關(guān)鍵詞優(yōu)化
聲明:本網(wǎng)站發(fā)布的內(nèi)容(圖片、視頻和文字)以用戶投稿、用戶轉(zhuǎn)載內(nèi)容為主,如果涉及侵權(quán)請盡快告知,我們將會在第一時間刪除。文章觀點不代表本網(wǎng)站立場,如需處理請聯(lián)系客服。電話:028-86922220;郵箱:631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載,或轉(zhuǎn)載時需注明來源: 創(chuàng)新互聯(lián)