1. 내려받을 sqoop 압축 파일을 탐색합니다.
1-1. 해당되는 버전의 디렉터리를 클릭합니다.
* 위에서는 1.99.7 버전으로 진행합니다.
* 위의 주소는 http://mirror.apache-kr.org/sqoop/ 와 같습니다.
1-2. sqoop-1.99.7-bin-hadoop200.tar.gz 파일에 우클릭하여 링크 주소 복사를 클릭합니다.
2. sqoop 압축 파일을 내려받습니다.
1 2 3 4 5 6 7 8 9 10 11 12 | $ wget http://mirror.apache-kr.org/sqoop/1.99.7/sqoop-1.99.7-bin-hadoop200.tar.gz --2017-11-13 13:43:49-- http://mirror.apache-kr.org/sqoop/1.99.7/sqoop-1.99.7-bin-hadoop200.tar.gz Resolving mirror.apache-kr.org (mirror.apache-kr.org)... 1.201.139.179 Connecting to mirror.apache-kr.org (mirror.apache-kr.org)|1.201.139.179|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 102436055 (98M) [application/x-gzip] Saving to: ‘sqoop-1.99.7-bin-hadoop200.tar.gz’ sqoop-1.99.7-bin-hadoop200.ta 100%[==============================================>] 97.69M 11.3MB/s in 9.3s 2017-11-13 13:43:58 (10.5 MB/s) - ‘sqoop-1.99.7-bin-hadoop200.tar.gz’ saved [102436055/102436055] | cs |
3. 내려받은 압축 파일을 확인합니다.
1 2 3 | $ ll |grep sqoop -rw-rw-r-- 1 user user 102436055 6월 20 20:56 sqoop-1.99.7-bin-hadoop200.tar.gz | cs |
4. 파일을 압축 해제합니다.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 | $ tar -xvzf ~/sqoop-1.99.7-bin-hadoop200.tar.gz sqoop-1.99.7-bin-hadoop200/bin/sqoop-sys.sh sqoop-1.99.7-bin-hadoop200/bin/sqoop.sh sqoop-1.99.7-bin-hadoop200/bin/sqoop2-server sqoop-1.99.7-bin-hadoop200/bin/sqoop2-shell sqoop-1.99.7-bin-hadoop200/bin/sqoop2-tool sqoop-1.99.7-bin-hadoop200/bin/ sqoop-1.99.7-bin-hadoop200/conf/ sqoop-1.99.7-bin-hadoop200/docs/ sqoop-1.99.7-bin-hadoop200/docs/.doctrees/ sqoop-1.99.7-bin-hadoop200/docs/.doctrees/admin/ sqoop-1.99.7-bin-hadoop200/docs/.doctrees/dev/ sqoop-1.99.7-bin-hadoop200/docs/.doctrees/security/ sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/ sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/connectors/ sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/examples/ sqoop-1.99.7-bin-hadoop200/docs/_sources/ sqoop-1.99.7-bin-hadoop200/docs/_sources/admin/ sqoop-1.99.7-bin-hadoop200/docs/_sources/dev/ sqoop-1.99.7-bin-hadoop200/docs/_sources/security/ sqoop-1.99.7-bin-hadoop200/docs/_sources/user/ sqoop-1.99.7-bin-hadoop200/docs/_sources/user/connectors/ sqoop-1.99.7-bin-hadoop200/docs/_sources/user/examples/ sqoop-1.99.7-bin-hadoop200/docs/_static/ sqoop-1.99.7-bin-hadoop200/docs/_static/css/ sqoop-1.99.7-bin-hadoop200/docs/_static/fonts/ sqoop-1.99.7-bin-hadoop200/docs/_static/js/ sqoop-1.99.7-bin-hadoop200/docs/admin/ sqoop-1.99.7-bin-hadoop200/docs/dev/ sqoop-1.99.7-bin-hadoop200/docs/security/ sqoop-1.99.7-bin-hadoop200/docs/target/ sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/ sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/ sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/parsers/ sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/parsers/rst/ sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/parsers/rst/include/ sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/writers/ sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/writers/s5_html/ sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/writers/s5_html/themes/ sqoop-1.99.7-bin-hadoop200/docs/user/ sqoop-1.99.7-bin-hadoop200/docs/user/connectors/ sqoop-1.99.7-bin-hadoop200/docs/user/examples/ sqoop-1.99.7-bin-hadoop200/server/ sqoop-1.99.7-bin-hadoop200/server/lib/ sqoop-1.99.7-bin-hadoop200/shell/ sqoop-1.99.7-bin-hadoop200/shell/lib/ sqoop-1.99.7-bin-hadoop200/tools/ sqoop-1.99.7-bin-hadoop200/tools/lib/ sqoop-1.99.7-bin-hadoop200/CHANGELOG.txt sqoop-1.99.7-bin-hadoop200/LICENSE.txt sqoop-1.99.7-bin-hadoop200/NOTICE.txt sqoop-1.99.7-bin-hadoop200/README.txt sqoop-1.99.7-bin-hadoop200/conf/sqoop.properties sqoop-1.99.7-bin-hadoop200/conf/sqoop_bootstrap.properties sqoop-1.99.7-bin-hadoop200/docs/.buildinfo sqoop-1.99.7-bin-hadoop200/docs/.doctrees/admin.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/admin/Installation.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/admin/Tools.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/admin/Upgrade.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/dev.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/dev/BuildingSqoop2.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/dev/ClientAPI.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/dev/ConnectorDevelopment.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/dev/DevEnv.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/dev/RESTAPI.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/dev/Repository.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/environment.pickle sqoop-1.99.7-bin-hadoop200/docs/.doctrees/index.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/security.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/security/API TLS-SSL.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/security/AuthenticationAndAuthorization.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/security/RepositoryEncryption.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/CommandLineClient.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/Connectors.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/Examples.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/Sqoop5MinutesDemo.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/connectors/Connector-FTP.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/connectors/Connector-GenericJDBC.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/connectors/Connector-HDFS.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/connectors/Connector-Kafka.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/connectors/Connector-Kite.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/connectors/Connector-SFTP.doctree sqoop-1.99.7-bin-hadoop200/docs/.doctrees/user/examples/S3Import.doctree sqoop-1.99.7-bin-hadoop200/docs/_sources/admin.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/admin/Installation.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/admin/Tools.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/admin/Upgrade.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/dev.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/dev/BuildingSqoop2.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/dev/ClientAPI.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/dev/ConnectorDevelopment.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/dev/DevEnv.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/dev/RESTAPI.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/dev/Repository.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/index.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/security.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/security/API TLS-SSL.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/security/AuthenticationAndAuthorization.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/security/RepositoryEncryption.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/CommandLineClient.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/Connectors.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/Examples.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/Sqoop5MinutesDemo.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/connectors/Connector-FTP.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/connectors/Connector-GenericJDBC.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/connectors/Connector-HDFS.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/connectors/Connector-Kafka.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/connectors/Connector-Kite.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/connectors/Connector-SFTP.txt sqoop-1.99.7-bin-hadoop200/docs/_sources/user/examples/S3Import.txt sqoop-1.99.7-bin-hadoop200/docs/_static/ajax-loader.gif sqoop-1.99.7-bin-hadoop200/docs/_static/basic.css sqoop-1.99.7-bin-hadoop200/docs/_static/comment-bright.png sqoop-1.99.7-bin-hadoop200/docs/_static/comment-close.png sqoop-1.99.7-bin-hadoop200/docs/_static/comment.png sqoop-1.99.7-bin-hadoop200/docs/_static/css/badge_only.css sqoop-1.99.7-bin-hadoop200/docs/_static/css/theme.css sqoop-1.99.7-bin-hadoop200/docs/_static/doctools.js sqoop-1.99.7-bin-hadoop200/docs/_static/down-pressed.png sqoop-1.99.7-bin-hadoop200/docs/_static/down.png sqoop-1.99.7-bin-hadoop200/docs/_static/file.png sqoop-1.99.7-bin-hadoop200/docs/_static/fonts/fontawesome-webfont.svg sqoop-1.99.7-bin-hadoop200/docs/_static/jquery.js sqoop-1.99.7-bin-hadoop200/docs/_static/js/modernizr.min.js sqoop-1.99.7-bin-hadoop200/docs/_static/js/theme.js sqoop-1.99.7-bin-hadoop200/docs/_static/minus.png sqoop-1.99.7-bin-hadoop200/docs/_static/plus.png sqoop-1.99.7-bin-hadoop200/docs/_static/pygments.css sqoop-1.99.7-bin-hadoop200/docs/_static/searchtools.js sqoop-1.99.7-bin-hadoop200/docs/_static/sqoop-logo.png sqoop-1.99.7-bin-hadoop200/docs/_static/underscore.js sqoop-1.99.7-bin-hadoop200/docs/_static/up-pressed.png sqoop-1.99.7-bin-hadoop200/docs/_static/up.png sqoop-1.99.7-bin-hadoop200/docs/_static/websupport.js sqoop-1.99.7-bin-hadoop200/docs/admin.html sqoop-1.99.7-bin-hadoop200/docs/admin/Installation.html sqoop-1.99.7-bin-hadoop200/docs/admin/Tools.html sqoop-1.99.7-bin-hadoop200/docs/admin/Upgrade.html sqoop-1.99.7-bin-hadoop200/docs/dev.html sqoop-1.99.7-bin-hadoop200/docs/dev/BuildingSqoop2.html sqoop-1.99.7-bin-hadoop200/docs/dev/ClientAPI.html sqoop-1.99.7-bin-hadoop200/docs/dev/ConnectorDevelopment.html sqoop-1.99.7-bin-hadoop200/docs/dev/DevEnv.html sqoop-1.99.7-bin-hadoop200/docs/dev/RESTAPI.html sqoop-1.99.7-bin-hadoop200/docs/dev/Repository.html sqoop-1.99.7-bin-hadoop200/docs/genindex.html sqoop-1.99.7-bin-hadoop200/docs/index.html sqoop-1.99.7-bin-hadoop200/docs/objects.inv sqoop-1.99.7-bin-hadoop200/docs/search.html sqoop-1.99.7-bin-hadoop200/docs/searchindex.js sqoop-1.99.7-bin-hadoop200/docs/security.html sqoop-1.99.7-bin-hadoop200/docs/security/API TLS-SSL.html sqoop-1.99.7-bin-hadoop200/docs/security/AuthenticationAndAuthorization.html sqoop-1.99.7-bin-hadoop200/docs/security/RepositoryEncryption.html sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/parsers/rst/include/README.txt sqoop-1.99.7-bin-hadoop200/docs/target/sphinx/docutils/writers/s5_html/themes/README.txt sqoop-1.99.7-bin-hadoop200/docs/user.html sqoop-1.99.7-bin-hadoop200/docs/user/CommandLineClient.html sqoop-1.99.7-bin-hadoop200/docs/user/Connectors.html sqoop-1.99.7-bin-hadoop200/docs/user/Examples.html sqoop-1.99.7-bin-hadoop200/docs/user/Sqoop5MinutesDemo.html sqoop-1.99.7-bin-hadoop200/docs/user/connectors/Connector-FTP.html sqoop-1.99.7-bin-hadoop200/docs/user/connectors/Connector-GenericJDBC.html sqoop-1.99.7-bin-hadoop200/docs/user/connectors/Connector-HDFS.html sqoop-1.99.7-bin-hadoop200/docs/user/connectors/Connector-Kafka.html sqoop-1.99.7-bin-hadoop200/docs/user/connectors/Connector-Kite.html sqoop-1.99.7-bin-hadoop200/docs/user/connectors/Connector-SFTP.html sqoop-1.99.7-bin-hadoop200/docs/user/examples/S3Import.html sqoop-1.99.7-bin-hadoop200/server/lib/avro-1.7.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/commons-cli-1.2.jar sqoop-1.99.7-bin-hadoop200/server/lib/commons-codec-1.9.jar sqoop-1.99.7-bin-hadoop200/server/lib/commons-compress-1.9.jar sqoop-1.99.7-bin-hadoop200/server/lib/commons-dbcp-1.4.jar sqoop-1.99.7-bin-hadoop200/server/lib/commons-io-2.4.jar sqoop-1.99.7-bin-hadoop200/server/lib/commons-lang-2.5.jar sqoop-1.99.7-bin-hadoop200/server/lib/commons-pool-1.5.4.jar sqoop-1.99.7-bin-hadoop200/server/lib/connector-sdk-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/connector-sdk-hadoop-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/derby-10.8.2.2.jar sqoop-1.99.7-bin-hadoop200/server/lib/guava-11.0.2.jar sqoop-1.99.7-bin-hadoop200/server/lib/jackson-core-asl-1.9.13.jar sqoop-1.99.7-bin-hadoop200/server/lib/jackson-mapper-asl-1.9.13.jar sqoop-1.99.7-bin-hadoop200/server/lib/javax.servlet-api-3.1.0.jar sqoop-1.99.7-bin-hadoop200/server/lib/jcommander-1.27.jar sqoop-1.99.7-bin-hadoop200/server/lib/jetty-http-9.2.13.v20150730.jar sqoop-1.99.7-bin-hadoop200/server/lib/jetty-io-9.2.13.v20150730.jar sqoop-1.99.7-bin-hadoop200/server/lib/jetty-security-9.2.13.v20150730.jar sqoop-1.99.7-bin-hadoop200/server/lib/jetty-server-9.2.13.v20150730.jar sqoop-1.99.7-bin-hadoop200/server/lib/jetty-servlet-9.2.13.v20150730.jar sqoop-1.99.7-bin-hadoop200/server/lib/jetty-util-9.2.13.v20150730.jar sqoop-1.99.7-bin-hadoop200/server/lib/joda-time-2.4.jar sqoop-1.99.7-bin-hadoop200/server/lib/json-simple-1.1.jar sqoop-1.99.7-bin-hadoop200/server/lib/jsr305-1.3.9.jar sqoop-1.99.7-bin-hadoop200/server/lib/log4j-1.2.16.jar sqoop-1.99.7-bin-hadoop200/server/lib/paranamer-2.3.jar sqoop-1.99.7-bin-hadoop200/server/lib/postgresql-9.1-901.jdbc4.jar sqoop-1.99.7-bin-hadoop200/server/lib/slf4j-api-1.6.1.jar sqoop-1.99.7-bin-hadoop200/server/lib/snappy-java-1.0.5.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-common-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-connector-ftp-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-connector-generic-jdbc-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-connector-hdfs-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-connector-kafka-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-connector-kite-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-connector-oracle-jdbc-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-connector-sftp-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-core-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-execution-mapreduce-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-repository-common-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-repository-derby-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-repository-mysql-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-repository-postgresql-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-security-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-server-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-submission-mapreduce-1.99.7.jar sqoop-1.99.7-bin-hadoop200/server/lib/sqoop-tools-1.99.7.jar sqoop-1.99.7-bin-hadoop200/shell/lib/activation-1.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/apacheds-i18n-2.0.0-M15.jar sqoop-1.99.7-bin-hadoop200/shell/lib/apacheds-kerberos-codec-2.0.0-M15.jar sqoop-1.99.7-bin-hadoop200/shell/lib/api-asn1-api-1.0.0-M20.jar sqoop-1.99.7-bin-hadoop200/shell/lib/api-util-1.0.0-M20.jar sqoop-1.99.7-bin-hadoop200/shell/lib/asm-3.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/avro-1.7.7.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-beanutils-1.7.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-beanutils-core-1.8.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-cli-1.2.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-codec-1.9.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-collections-3.2.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-compress-1.9.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-configuration-1.6.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-digester-1.8.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-el-1.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-httpclient-3.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-io-2.4.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-lang-2.5.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-logging-1.1.3.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-math3-3.1.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/commons-net-3.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/curator-client-2.6.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/curator-framework-2.6.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/curator-recipes-2.6.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/groovy-all-2.4.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/gson-2.2.4.jar sqoop-1.99.7-bin-hadoop200/shell/lib/guava-11.0.2.jar sqoop-1.99.7-bin-hadoop200/shell/lib/hadoop-annotations-2.6.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/hadoop-auth-2.6.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/hadoop-common-2.6.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/htrace-core-3.0.4.jar sqoop-1.99.7-bin-hadoop200/shell/lib/httpclient-4.1.2.jar sqoop-1.99.7-bin-hadoop200/shell/lib/httpcore-4.1.2.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jackson-core-asl-1.9.13.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jackson-jaxrs-1.8.3.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jackson-mapper-asl-1.9.13.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jackson-xc-1.8.3.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jansi-1.7.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jasper-compiler-5.5.23.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jasper-runtime-5.5.23.jar sqoop-1.99.7-bin-hadoop200/shell/lib/java-xmlbuilder-0.4.jar sqoop-1.99.7-bin-hadoop200/shell/lib/javax.ws.rs-api-2.0.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jaxb-api-2.2.2.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jaxb-impl-2.2.3-1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jersey-core-1.9.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jersey-json-1.9.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jersey-server-1.9.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jets3t-0.9.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jettison-1.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jetty-6.1.26.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jetty-util-6.1.26.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jline-2.13.jar sqoop-1.99.7-bin-hadoop200/shell/lib/joda-time-2.4.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jsch-0.1.42.jar sqoop-1.99.7-bin-hadoop200/shell/lib/json-simple-1.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jsp-api-2.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/jsr305-1.3.9.jar sqoop-1.99.7-bin-hadoop200/shell/lib/log4j-1.2.16.jar sqoop-1.99.7-bin-hadoop200/shell/lib/netty-3.7.0.Final.jar sqoop-1.99.7-bin-hadoop200/shell/lib/paranamer-2.3.jar sqoop-1.99.7-bin-hadoop200/shell/lib/protobuf-java-2.5.0.jar sqoop-1.99.7-bin-hadoop200/shell/lib/servlet-api-2.5.jar sqoop-1.99.7-bin-hadoop200/shell/lib/slf4j-api-1.6.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/slf4j-log4j12-1.6.1.jar sqoop-1.99.7-bin-hadoop200/shell/lib/snappy-java-1.0.5.jar sqoop-1.99.7-bin-hadoop200/shell/lib/sqoop-client-1.99.7.jar sqoop-1.99.7-bin-hadoop200/shell/lib/sqoop-common-1.99.7.jar sqoop-1.99.7-bin-hadoop200/shell/lib/sqoop-shell-1.99.7.jar sqoop-1.99.7-bin-hadoop200/shell/lib/stax-api-1.0-2.jar sqoop-1.99.7-bin-hadoop200/shell/lib/xmlenc-0.52.jar sqoop-1.99.7-bin-hadoop200/shell/lib/zookeeper-3.4.6.jar sqoop-1.99.7-bin-hadoop200/tools/lib/avro-1.7.7.jar sqoop-1.99.7-bin-hadoop200/tools/lib/bsh-2.0b4.jar sqoop-1.99.7-bin-hadoop200/tools/lib/commons-cli-1.2.jar sqoop-1.99.7-bin-hadoop200/tools/lib/commons-codec-1.9.jar sqoop-1.99.7-bin-hadoop200/tools/lib/commons-compress-1.9.jar sqoop-1.99.7-bin-hadoop200/tools/lib/commons-dbcp-1.4.jar sqoop-1.99.7-bin-hadoop200/tools/lib/commons-io-2.4.jar sqoop-1.99.7-bin-hadoop200/tools/lib/commons-lang-2.5.jar sqoop-1.99.7-bin-hadoop200/tools/lib/commons-pool-1.5.4.jar sqoop-1.99.7-bin-hadoop200/tools/lib/connector-sdk-1.99.7.jar sqoop-1.99.7-bin-hadoop200/tools/lib/connector-sdk-hadoop-1.99.7.jar sqoop-1.99.7-bin-hadoop200/tools/lib/guava-11.0.2.jar sqoop-1.99.7-bin-hadoop200/tools/lib/jackson-core-asl-1.9.13.jar sqoop-1.99.7-bin-hadoop200/tools/lib/jackson-mapper-asl-1.9.13.jar sqoop-1.99.7-bin-hadoop200/tools/lib/jcommander-1.27.jar sqoop-1.99.7-bin-hadoop200/tools/lib/joda-time-2.4.jar sqoop-1.99.7-bin-hadoop200/tools/lib/json-simple-1.1.jar sqoop-1.99.7-bin-hadoop200/tools/lib/jsr305-1.3.9.jar sqoop-1.99.7-bin-hadoop200/tools/lib/log4j-1.2.16.jar sqoop-1.99.7-bin-hadoop200/tools/lib/paranamer-2.3.jar sqoop-1.99.7-bin-hadoop200/tools/lib/slf4j-api-1.6.1.jar sqoop-1.99.7-bin-hadoop200/tools/lib/snappy-java-1.0.5.jar sqoop-1.99.7-bin-hadoop200/tools/lib/sqoop-common-1.99.7.jar sqoop-1.99.7-bin-hadoop200/tools/lib/sqoop-core-1.99.7.jar sqoop-1.99.7-bin-hadoop200/tools/lib/sqoop-tools-1.99.7.jar sqoop-1.99.7-bin-hadoop200/tools/lib/testng-6.8.17.jar | cs |
5. 압축 해제한 디렉터리를 원하는 위치로 이동 혹은 복사합니다.
1 2 | $ sudo mv ~/sqoop-1.99.7-bin-hadoop200 /usr/local/ | cs |
6. 해당 디렉터리의 링크를 생성합니다.
1 2 | $ sudo ln -sf /usr/local/sqoop-1.99.7-bin-hadoop200/ /usr/local/sqoop | cs |
7. ~/.bashrc 파일을 편집합니다.
1 2 | $ vi ~/.bashrc | cs |
8. hadoop 의 환경 변수의 설정값을 확인합니다.
1 2 3 4 5 6 7 8 9 | # Export HADOOP_HOME variable export HADOOP_HOME=/usr/local/hadoop # Or alternatively HADOOP_*_HOME variables export HADOOP_COMMON_HOME=${HADOOP_HOME} export HADOOP_HDFS_HOME=${HADOOP_HOME} export HADOOP_MAPRED_HOME=${HADOOP_HOME} export HADOOP_YARN_HOME=${HADOOP_HOME} | cs |
* 환경 변수 $HADOOP_HOME 이 설정되면 sqoop 은 아래와 같은 위치를 사용합니다.
1 2 3 4 5 | $HADOOP_HOME/share/hadoop/common $HADOOP_HOME/share/hadoop/hdfs $HADOOP_HOME/share/hadoop/mapreduce $HADOOP_HOME/share/hadoop/yarn | cs |
9. ~/.bashrc 파일의 하단에 아래와 같이 추가 후 저장합니다.
1 2 3 | export SQOOP_HOME=/usr/local/sqoop export PATH=$PATH:$HADOOP_HOME/bin:$JAVA_HOME/bin:$HADOOP_HOME/sbin:$HIVE_HOME/bin:$SQOOP_HOME/bin | cs |
* PATH 같은 경우 기존의 설정이 있을 경우 ":$SQOOP_HOME/bin" 와 같은 형식으로 추가 후 작성합니다.
10. ~/.bashrc 파일 수정 후 변경 사항을 반영합니다.
1 2 | $ source ~/.bashrc | cs |
11. hadoop 의 core-site.xml 파일을 편집합니다.
1 2 | $ vi /usr/local/hadoop/etc/hadoop/core-site.xml | cs |
12. configuration 태그 사이에 hosts 와 groups 의 속성을 추가합니다.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | <configuration> <!-- Site specific YARN configuration properties --> ... <property> <name>hadoop.proxyuser.hadoop-user.hosts</name> <value>*</value> </property> <property> <name>hadoop.proxyuser.hadoop-user.groups</name> <value>*</value> </property> </configuration> | cs |
* 각 name 태그에 hadoop-user 의 부분은 sqoop2 서버를 실행할 사용자를 입력해야 하므로 확인 후 입력하세요.
13. hadoop 의 container-executor.cfg 파일을 편집합니다.
1 2 | $ vi /usr/local/hadoop/etc/hadoop/container-executor.cfg | cs |
13-1. 수정 전
1 2 3 4 5 | yarn.nodemanager.linux-container-executor.group=#configured value of yarn.nodemanager.linux-container-executor.group banned.users=#comma separated list of users who can not run applications min.user.id=1000#Prevent other super-users allowed.system.users=##comma separated list of system users who CAN run applications | cs |
13-2. 수정 후
1 2 3 4 5 | yarn.nodemanager.linux-container-executor.group=#configured value of yarn.nodemanager.linux-container-executor.group banned.users=#comma separated list of users who can not run applications min.user.id=1000#Prevent other super-users allowed.system.users=hadoop-user##comma separated list of system users who CAN run applications | cs |
* "allowd.system.users=" 의 부분에 hadoop-user 를 추가합니다. 12번 과정과 마찬가지로 sqoop2 서버를 실행할 사용자의 계정을 입력합니다.
* 수정 후 저장 및 종료합니다.
14. /var/lib 이하에 sqoop2 디렉터리를 생성합니다.
1 2 | $ sudo mkdir /var/lib/sqoop2/ | cs |
15. Third party jars 파일은 /var/lib/sqoop2 디렉터리에 저장되며 classpath 에 전달하기 위해 환경 변수에 등록합니다.
1 2 3 | # And finally export this directory to SQOOP_SERVER_EXTRA_LIB export SQOOP_SERVER_EXTRA_LIB=/var/lib/sqoop2/ | cs |
16. hadoop 관련 jar 파일을 /var/lib/sqoop2 디렉터리에 복사합니다.
1 2 3 4 5 6 7 8 9 10 11 | cp -R $HADOOP_HOME/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/lib/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/share/hadoop/common/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/share/hadoop/common/lib/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/share/hadoop/hdfs/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/share/hadoop/hdfs/lib/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/share/hadoop/mapreduce/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/share/hadoop/mapreduce/lib/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/share/hadoop/yarn/*.jar /var/lib/sqoop2/ cp -R $HADOOP_HOME/share/hadoop/yarn/lib/*.jar /var/lib/sqoop2/ | cs |
17. sqoop.properties 파일을 편집합니다.
1 2 | $ vi /usr/local/sqoop/conf/sqoop.properties | cs |
18. org.apache.sqoop.submission.engine.mapreduce.configuration.directory 속성의 값을 아래와 같이 수정합니다.
18-1. 수정 전
1 2 3 | # Hadoop configuration directory org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/etc/hadoop/conf/ | cs |
18-2. 수정 후
1 2 3 | # Hadoop configuration directory org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/usr/local/hadoop/etc/hadoop/ | cs |
* hadoop 의 설정 디렉터리는 각자 다를 수 있으므로 확인 후 위와 같이 경로를 수정 후 저장 및 종료합니다.
19. 시작하기 전에 메타 데이터 저장소를 초기화합니다.
1 2 3 4 5 6 7 8 9 10 11 | $ sqoop2-tool upgrade Setting conf dir: /usr/local/sqoop/bin/../conf Sqoop home directory: /usr/local/sqoop Sqoop tool executor: Version: 1.99.7 Revision: 125d5e61b911a32a1bce567fe5fb1a9c0c9b1bab Compiled on Tue Jul 19 16:08:27 PDT 2016 by abefine Running tool: class org.apache.sqoop.tools.tool.UpgradeTool 2017-11-16 09:50:11,498 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread Tool class org.apache.sqoop.tools.tool.UpgradeTool has finished correctly. | cs |
20. sqoop2 서버를 검증합니다.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | $ ./sqoop2-tool verify Setting conf dir: /usr/local/sqoop/bin/../conf Sqoop home directory: /usr/local/sqoop Sqoop tool executor: Version: 1.99.7 Revision: 125d5e61b911a32a1bce567fe5fb1a9c0c9b1bab Compiled on Tue Jul 19 16:08:27 PDT 2016 by abefine Running tool: class org.apache.sqoop.tools.tool.VerifyTool 2017-11-16 09:50:41,202 INFO [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server. 2017-11-16 09:50:41,213 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/sqoop-1.99.7-bin-hadoop200/server/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/local/apache-hive-2.1.1-bin/lib/log4j-slf4j-impl-2.4.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. Verification was successful. Tool class org.apache.sqoop.tools.tool.VerifyTool has finished correctly. | cs |
21. sqoop2 서버를 기동합니다.
1 2 3 4 5 6 7 8 9 10 11 12 | $ sqoop2-server start Setting conf dir: /usr/local/sqoop/bin/../conf Sqoop home directory: /usr/local/sqoop Starting the Sqoop2 server... 2017-11-16 09:50:59,535 INFO [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server. 2017-11-16 09:50:59,544 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/sqoop-1.99.7-bin-hadoop200/server/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/local/apache-hive-2.1.1-bin/lib/log4j-slf4j-impl-2.4.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. Sqoop2 server started. | cs |
22. 서비스 상태 확인
1 2 3 4 5 6 7 8 9 | $ jps 21458 SqoopJettyServer 2500 NodeManager 6181 NameNode 21915 Jps 31037 QuorumPeerMain 6510 ResourceManager 2479 Drillbit | cs |
* 위의 서비스 중에서 SqoopJettyServer 서비스 상태를 확인합니다.
23. sqoop2 셸에 접속을 합니다.
1 2 3 4 5 6 7 | $ /usr/local/sqoop/bin/sqoop2-shell Setting conf dir: /usr/local/sqoop/bin/../conf Sqoop home directory: /usr/local/sqoop Sqoop Shell: Type 'help' or '\h' for help. sqoop:000> | cs |
24. sqoop2 서버를 정지합니다.
1 2 3 4 5 | $ /usr/local/sqoop/bin/sqoop.sh server stop Setting conf dir: ./../conf Sqoop home directory: /usr/local/sqoop No Sqoop server is running. | cs |
'Big Data Platform > Sqoop' 카테고리의 다른 글
| sqoop 1.4.6 외부 파일로 password 지정하여 실행 (0) | 2018.02.07 |
|---|---|
| [경고] Loading class `com.mysql.jdbc.Driver'. (0) | 2017.11.21 |
| [에러] JDBCREPO_0007:Unable to lease link (0) | 2017.11.16 |
| sqoop2 error 발생 시 stack trace 출력 (0) | 2017.11.14 |