구축 정보
구분 |
IP |
Host Name | 제외 단계 |
name node |
192.168.10.101 |
master | 13 |
secondary node |
192.168.10.102 |
secondary | 12, 13 |
data node |
192.168.10.103 |
datanode-a | 12 |
data node |
192.168.10.104 |
datanode-b | 12 |
data node |
192.168.10.105 |
datanode-c | 12 |
* 각 노드별로 해당하는 작업이 일부 상이하여 제외해야 하는 단계를 주의해서 참조하세요!
1. 패키지 인덱스 정보 업데이트
1 2 3 4 5 6 7 8 | $ sudo apt-get update Hit:1 http://us.archive.ubuntu.com/ubuntu xenial InRelease Get:2 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Get:3 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Get:4 http://us.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Fetched 306 kB in 1s (154 kB/s) Reading package lists... Done | cs |
2. 설치된 패키지 업그레이드
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 | $ sudo apt-get upgrade Reading package lists... Done Building dependency tree Reading state information... Done Calculating upgrade... Done The following packages have been kept back: linux-generic linux-headers-generic linux-image-generic The following packages will be upgraded: apparmor bind9-host ca-certificates cryptsetup cryptsetup-bin curl dnsmasq-base dnsutils gcc-5-base git git-man grub-legacy-ec2 libapparmor-perl libapparmor1 libbind9-140 libcryptsetup4 libcurl3-gnutls libdns-export162 libdns162 libidn11 libisc-export160 libisc160 libisccc140 libisccfg140 liblwres141 libmspack0 libplymouth4 libpython3.5 libpython3.5-minimal libpython3.5-stdlib libstdc++6 libxml2 linux-firmware logrotate lxd lxd-client mdadm plymouth plymouth-theme-ubuntu-text python3-update-manager python3.5 python3.5-minimal snapd tcpdump unattended-upgrades update-manager-core update-notifier-common vlan xfsprogs 49 upgraded, 0 newly installed, 0 to remove and 3 not upgraded. Need to get 71.1 MB of archives. After this operation, 9,276 kB of additional disk space will be used. Do you want to continue? [Y/n] Y Get:1 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libpython3.5 amd64 3.5.2-2ubuntu0~16.04.3 [1,360 kB] Get:2 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python3.5 amd64 3.5.2-2ubuntu0~16.04.3 [165 kB] Get:3 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libpython3.5-stdlib amd64 3.5.2-2ubuntu0~16.04.3 [2,132 kB] Get:4 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python3.5-minimal amd64 3.5.2-2ubuntu0~16.04.3 [1,596 kB] Get:5 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libpython3.5-minimal amd64 3.5.2-2ubuntu0~16.04.3 [524 kB] Get:6 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libidn11 amd64 1.32-3ubuntu1.2 [46.5 kB] Get:7 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 dnsmasq-base amd64 2.75-1ubuntu0.16.04.3 [295 kB] Get:8 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 lxd amd64 2.0.10-0ubuntu1~16.04.2 [3,416 kB] Get:9 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 lxd-client amd64 2.0.10-0ubuntu1~16.04.2 [1,857 kB] Get:10 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 update-manager-core all 1:16.04.9 [5,330 B] Get:11 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python3-update-manager all 1:16.04.9 [31.9 kB] Get:12 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 update-notifier-common all 3.168.5 [165 kB] Get:13 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libapparmor1 amd64 2.10.95-0ubuntu2.7 [31.2 kB] Get:14 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libcryptsetup4 amd64 2:1.6.6-5ubuntu2.1 [73.3 kB] Get:15 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 gcc-5-base amd64 5.4.0-6ubuntu1~16.04.5 [17.1 kB] Get:16 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libstdc++6 amd64 5.4.0-6ubuntu1~16.04.5 [393 kB] Get:17 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libisc-export160 amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [153 kB] Get:18 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libdns-export162 amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [666 kB] Get:19 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 logrotate amd64 3.8.7-2ubuntu2.16.04.2 [37.7 kB] Get:20 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libapparmor-perl amd64 2.10.95-0ubuntu2.7 [31.6 kB] Get:21 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 apparmor amd64 2.10.95-0ubuntu2.7 [450 kB] Get:22 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libxml2 amd64 2.9.3+dfsg1-1ubuntu0.3 [697 kB] Get:23 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 bind9-host amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [38.4 kB] Get:24 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 dnsutils amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [89.0 kB] Get:25 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libisc160 amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [215 kB] Get:26 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libdns162 amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [882 kB] Get:27 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libisccc140 amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [16.3 kB] Get:28 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libisccfg140 amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [40.4 kB] Get:29 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 liblwres141 amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [33.7 kB] Get:30 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libbind9-140 amd64 1:9.10.3.dfsg.P4-8ubuntu1.8 [23.6 kB] Get:31 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 ca-certificates all 20170717~16.04.1 [168 kB] Get:32 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 curl amd64 7.47.0-1ubuntu2.3 [138 kB] Get:33 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libcurl3-gnutls amd64 7.47.0-1ubuntu2.3 [185 kB] Get:34 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libplymouth4 amd64 0.9.2-3ubuntu13.2 [85.1 kB] Get:35 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 plymouth amd64 0.9.2-3ubuntu13.2 [107 kB] Get:36 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 plymouth-theme-ubuntu-text amd64 0.9.2-3ubuntu13.2 [9,094 B] Get:37 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 tcpdump amd64 4.9.2-0ubuntu0.16.04.1 [387 kB] Get:38 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 cryptsetup-bin amd64 2:1.6.6-5ubuntu2.1 [61.8 kB] Get:39 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 cryptsetup amd64 2:1.6.6-5ubuntu2.1 [123 kB] Get:40 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 git-man all 1:2.7.4-0ubuntu1.3 [736 kB] Get:41 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 git amd64 1:2.7.4-0ubuntu1.3 [3,102 kB] Get:42 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libmspack0 amd64 0.5-1ubuntu0.16.04.1 [37.0 kB] Get:43 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 linux-firmware all 1.157.12 [38.8 MB] Get:44 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 mdadm amd64 3.3-2ubuntu7.4 [394 kB] Get:45 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 snapd amd64 2.27.5 [10.7 MB] Get:46 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 unattended-upgrades all 0.90ubuntu0.8 [32.4 kB] Get:47 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 xfsprogs amd64 4.3.0+nmu1ubuntu1.1 [597 kB] Get:48 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 grub-legacy-ec2 all 0.7.9-233-ge586fe35-0ubuntu1~16.04.2 [28.2 kB] Get:49 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 vlan amd64 1.9-3.2ubuntu1.16.04.4 [30.6 kB] Fetched 71.1 MB in 53s (1,332 kB/s) Extracting templates from packages: 100% Preconfiguring packages ... (Reading database ... 59734 files and directories currently installed.) Preparing to unpack .../libpython3.5_3.5.2-2ubuntu0~16.04.3_amd64.deb ... Unpacking libpython3.5:amd64 (3.5.2-2ubuntu0~16.04.3) over (3.5.2-2ubuntu0~16.04.1) ... Preparing to unpack .../python3.5_3.5.2-2ubuntu0~16.04.3_amd64.deb ... Unpacking python3.5 (3.5.2-2ubuntu0~16.04.3) over (3.5.2-2ubuntu0~16.04.1) ... Preparing to unpack .../libpython3.5-stdlib_3.5.2-2ubuntu0~16.04.3_amd64.deb ... Unpacking libpython3.5-stdlib:amd64 (3.5.2-2ubuntu0~16.04.3) over (3.5.2-2ubuntu0~16.04.1) ... Preparing to unpack .../python3.5-minimal_3.5.2-2ubuntu0~16.04.3_amd64.deb ... Unpacking python3.5-minimal (3.5.2-2ubuntu0~16.04.3) over (3.5.2-2ubuntu0~16.04.1) ... Preparing to unpack .../libpython3.5-minimal_3.5.2-2ubuntu0~16.04.3_amd64.deb ... Unpacking libpython3.5-minimal:amd64 (3.5.2-2ubuntu0~16.04.3) over (3.5.2-2ubuntu0~16.04.1) ... Preparing to unpack .../libidn11_1.32-3ubuntu1.2_amd64.deb ... Unpacking libidn11:amd64 (1.32-3ubuntu1.2) over (1.32-3ubuntu1.1) ... Preparing to unpack .../dnsmasq-base_2.75-1ubuntu0.16.04.3_amd64.deb ... Unpacking dnsmasq-base (2.75-1ubuntu0.16.04.3) over (2.75-1ubuntu0.16.04.2) ... Preparing to unpack .../lxd_2.0.10-0ubuntu1~16.04.2_amd64.deb ... Warning: Stopping lxd.service, but it can still be activated by: lxd.socket Unpacking lxd (2.0.10-0ubuntu1~16.04.2) over (2.0.10-0ubuntu1~16.04.1) ... Warning: Stopping lxd.service, but it can still be activated by: lxd.socket Preparing to unpack .../lxd-client_2.0.10-0ubuntu1~16.04.2_amd64.deb ... Unpacking lxd-client (2.0.10-0ubuntu1~16.04.2) over (2.0.10-0ubuntu1~16.04.1) ... Preparing to unpack .../update-manager-core_1%3a16.04.9_all.deb ... Unpacking update-manager-core (1:16.04.9) over (1:16.04.7) ... Preparing to unpack .../python3-update-manager_1%3a16.04.9_all.deb ... Unpacking python3-update-manager (1:16.04.9) over (1:16.04.7) ... Preparing to unpack .../update-notifier-common_3.168.5_all.deb ... Unpacking update-notifier-common (3.168.5) over (3.168.4) ... Preparing to unpack .../libapparmor1_2.10.95-0ubuntu2.7_amd64.deb ... Unpacking libapparmor1:amd64 (2.10.95-0ubuntu2.7) over (2.10.95-0ubuntu2.6) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for man-db (2.7.5-1) ... Processing triggers for mime-support (3.59ubuntu1) ... Processing triggers for ureadahead (0.100.0-19) ... Setting up libapparmor1:amd64 (2.10.95-0ubuntu2.7) ... Processing triggers for systemd (229-4ubuntu19) ... Processing triggers for dbus (1.10.6-1ubuntu3.3) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... (Reading database ... 59735 files and directories currently installed.) Preparing to unpack .../libcryptsetup4_2%3a1.6.6-5ubuntu2.1_amd64.deb ... Unpacking libcryptsetup4:amd64 (2:1.6.6-5ubuntu2.1) over (2:1.6.6-5ubuntu2) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Setting up libcryptsetup4:amd64 (2:1.6.6-5ubuntu2.1) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... (Reading database ... 59735 files and directories currently installed.) Preparing to unpack .../gcc-5-base_5.4.0-6ubuntu1~16.04.5_amd64.deb ... Unpacking gcc-5-base:amd64 (5.4.0-6ubuntu1~16.04.5) over (5.4.0-6ubuntu1~16.04.4) ... Setting up gcc-5-base:amd64 (5.4.0-6ubuntu1~16.04.5) ... (Reading database ... 59735 files and directories currently installed.) Preparing to unpack .../libstdc++6_5.4.0-6ubuntu1~16.04.5_amd64.deb ... Unpacking libstdc++6:amd64 (5.4.0-6ubuntu1~16.04.5) over (5.4.0-6ubuntu1~16.04.4) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Setting up libstdc++6:amd64 (5.4.0-6ubuntu1~16.04.5) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... (Reading database ... 59735 files and directories currently installed.) Preparing to unpack .../libisc-export160_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking libisc-export160 (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../libdns-export162_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking libdns-export162 (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../logrotate_3.8.7-2ubuntu2.16.04.2_amd64.deb ... Unpacking logrotate (3.8.7-2ubuntu2.16.04.2) over (3.8.7-2ubuntu2.16.04.1) ... Preparing to unpack .../libapparmor-perl_2.10.95-0ubuntu2.7_amd64.deb ... Unpacking libapparmor-perl (2.10.95-0ubuntu2.7) over (2.10.95-0ubuntu2.6) ... Preparing to unpack .../apparmor_2.10.95-0ubuntu2.7_amd64.deb ... Unpacking apparmor (2.10.95-0ubuntu2.7) over (2.10.95-0ubuntu2.6) ... Preparing to unpack .../libxml2_2.9.3+dfsg1-1ubuntu0.3_amd64.deb ... Unpacking libxml2:amd64 (2.9.3+dfsg1-1ubuntu0.3) over (2.9.3+dfsg1-1ubuntu0.2) ... Preparing to unpack .../bind9-host_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking bind9-host (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../dnsutils_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking dnsutils (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../libisc160_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking libisc160:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../libdns162_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking libdns162:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../libisccc140_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking libisccc140:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../libisccfg140_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking libisccfg140:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../liblwres141_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking liblwres141:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../libbind9-140_1%3a9.10.3.dfsg.P4-8ubuntu1.8_amd64.deb ... Unpacking libbind9-140:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) over (1:9.10.3.dfsg.P4-8ubuntu1.7) ... Preparing to unpack .../ca-certificates_20170717~16.04.1_all.deb ... Unpacking ca-certificates (20170717~16.04.1) over (20160104ubuntu1) ... Preparing to unpack .../curl_7.47.0-1ubuntu2.3_amd64.deb ... Unpacking curl (7.47.0-1ubuntu2.3) over (7.47.0-1ubuntu2.2) ... Preparing to unpack .../libcurl3-gnutls_7.47.0-1ubuntu2.3_amd64.deb ... Unpacking libcurl3-gnutls:amd64 (7.47.0-1ubuntu2.3) over (7.47.0-1ubuntu2.2) ... Preparing to unpack .../libplymouth4_0.9.2-3ubuntu13.2_amd64.deb ... Unpacking libplymouth4:amd64 (0.9.2-3ubuntu13.2) over (0.9.2-3ubuntu13.1) ... Preparing to unpack .../plymouth_0.9.2-3ubuntu13.2_amd64.deb ... Unpacking plymouth (0.9.2-3ubuntu13.2) over (0.9.2-3ubuntu13.1) ... Preparing to unpack .../plymouth-theme-ubuntu-text_0.9.2-3ubuntu13.2_amd64.deb ... Unpacking plymouth-theme-ubuntu-text (0.9.2-3ubuntu13.2) over (0.9.2-3ubuntu13.1) ... Preparing to unpack .../tcpdump_4.9.2-0ubuntu0.16.04.1_amd64.deb ... Unpacking tcpdump (4.9.2-0ubuntu0.16.04.1) over (4.9.0-1ubuntu1~ubuntu16.04.1) ... Preparing to unpack .../cryptsetup-bin_2%3a1.6.6-5ubuntu2.1_amd64.deb ... Unpacking cryptsetup-bin (2:1.6.6-5ubuntu2.1) over (2:1.6.6-5ubuntu2) ... Preparing to unpack .../cryptsetup_2%3a1.6.6-5ubuntu2.1_amd64.deb ... Unpacking cryptsetup (2:1.6.6-5ubuntu2.1) over (2:1.6.6-5ubuntu2) ... Preparing to unpack .../git-man_1%3a2.7.4-0ubuntu1.3_all.deb ... Unpacking git-man (1:2.7.4-0ubuntu1.3) over (1:2.7.4-0ubuntu1.1) ... Preparing to unpack .../git_1%3a2.7.4-0ubuntu1.3_amd64.deb ... Unpacking git (1:2.7.4-0ubuntu1.3) over (1:2.7.4-0ubuntu1.1) ... Preparing to unpack .../libmspack0_0.5-1ubuntu0.16.04.1_amd64.deb ... Unpacking libmspack0:amd64 (0.5-1ubuntu0.16.04.1) over (0.5-1) ... Preparing to unpack .../linux-firmware_1.157.12_all.deb ... Unpacking linux-firmware (1.157.12) over (1.157.11) ... Preparing to unpack .../mdadm_3.3-2ubuntu7.4_amd64.deb ... Unpacking mdadm (3.3-2ubuntu7.4) over (3.3-2ubuntu7.2) ... Preparing to unpack .../snapd_2.27.5_amd64.deb ... Warning: Stopping snapd.service, but it can still be activated by: snapd.socket Unpacking snapd (2.27.5) over (2.25) ... Preparing to unpack .../unattended-upgrades_0.90ubuntu0.8_all.deb ... Unpacking unattended-upgrades (0.90ubuntu0.8) over (0.90ubuntu0.7) ... Preparing to unpack .../xfsprogs_4.3.0+nmu1ubuntu1.1_amd64.deb ... Unpacking xfsprogs (4.3.0+nmu1ubuntu1.1) over (4.3.0+nmu1ubuntu1) ... Preparing to unpack .../grub-legacy-ec2_0.7.9-233-ge586fe35-0ubuntu1~16.04.2_all.deb ... Leaving 'diversion of /usr/sbin/grub-set-default to /usr/sbin/grub-set-default.real by grub-legacy-ec2' Unpacking grub-legacy-ec2 (0.7.9-233-ge586fe35-0ubuntu1~16.04.2) over (0.7.9-153-g16a7302f-0ubuntu1~16.04.2) ... Preparing to unpack .../vlan_1.9-3.2ubuntu1.16.04.4_amd64.deb ... Unpacking vlan (1.9-3.2ubuntu1.16.04.4) over (1.9-3.2ubuntu1.16.04.3) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for man-db (2.7.5-1) ... Processing triggers for ureadahead (0.100.0-19) ... Processing triggers for systemd (229-4ubuntu19) ... Setting up libpython3.5-minimal:amd64 (3.5.2-2ubuntu0~16.04.3) ... Setting up libpython3.5-stdlib:amd64 (3.5.2-2ubuntu0~16.04.3) ... Setting up libpython3.5:amd64 (3.5.2-2ubuntu0~16.04.3) ... Setting up python3.5-minimal (3.5.2-2ubuntu0~16.04.3) ... Setting up python3.5 (3.5.2-2ubuntu0~16.04.3) ... Setting up libidn11:amd64 (1.32-3ubuntu1.2) ... Setting up dnsmasq-base (2.75-1ubuntu0.16.04.3) ... Setting up lxd-client (2.0.10-0ubuntu1~16.04.2) ... Setting up lxd (2.0.10-0ubuntu1~16.04.2) ... Setting up python3-update-manager (1:16.04.9) ... Setting up update-manager-core (1:16.04.9) ... Setting up update-notifier-common (3.168.5) ... Setting up libisc-export160 (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up libdns-export162 (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up logrotate (3.8.7-2ubuntu2.16.04.2) ... Setting up libapparmor-perl (2.10.95-0ubuntu2.7) ... Setting up apparmor (2.10.95-0ubuntu2.7) ... update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults Skipping profile in /etc/apparmor.d/disable: usr.sbin.rsyslogd Setting up libxml2:amd64 (2.9.3+dfsg1-1ubuntu0.3) ... Setting up libisc160:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up libdns162:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up libisccc140:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up libisccfg140:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up libbind9-140:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up liblwres141:amd64 (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up bind9-host (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up dnsutils (1:9.10.3.dfsg.P4-8ubuntu1.8) ... Setting up ca-certificates (20170717~16.04.1) ... Setting up libcurl3-gnutls:amd64 (7.47.0-1ubuntu2.3) ... Setting up curl (7.47.0-1ubuntu2.3) ... Setting up libplymouth4:amd64 (0.9.2-3ubuntu13.2) ... Setting up plymouth (0.9.2-3ubuntu13.2) ... update-initramfs: deferring update (trigger activated) update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults Setting up plymouth-theme-ubuntu-text (0.9.2-3ubuntu13.2) ... update-initramfs: deferring update (trigger activated) Setting up tcpdump (4.9.2-0ubuntu0.16.04.1) ... Installing new version of config file /etc/apparmor.d/usr.sbin.tcpdump ... Setting up cryptsetup-bin (2:1.6.6-5ubuntu2.1) ... Setting up cryptsetup (2:1.6.6-5ubuntu2.1) ... update-initramfs: deferring update (trigger activated) update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults Setting up git-man (1:2.7.4-0ubuntu1.3) ... Setting up git (1:2.7.4-0ubuntu1.3) ... Setting up libmspack0:amd64 (0.5-1ubuntu0.16.04.1) ... Setting up linux-firmware (1.157.12) ... update-initramfs: Generating /boot/initrd.img-4.4.0-87-generic W: mdadm: /etc/mdadm/mdadm.conf defines no arrays. Setting up mdadm (3.3-2ubuntu7.4) ... update-initramfs: deferring update (trigger activated) Generating grub configuration file ... File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17133: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17133: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17146: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17146: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17159: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17159: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17172: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17172: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17231: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17231: /usr/sbin/grub-probe Found linux image: /boot/vmlinuz-4.4.0-87-generic Found initrd image: /boot/initrd.img-4.4.0-87-generic File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17464: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on vgs invocation. Parent PID 17464: /usr/sbin/grub-probe File descriptor 3 (pipe:[36247]) leaked on lvs invocation. Parent PID 17580: /bin/sh done update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults Setting up snapd (2.27.5) ... Installing new version of config file /etc/apparmor.d/usr.lib.snapd.snap-confine.real ... Setting up unattended-upgrades (0.90ubuntu0.8) ... Setting up xfsprogs (4.3.0+nmu1ubuntu1.1) ... update-initramfs: deferring update (trigger activated) Setting up grub-legacy-ec2 (0.7.9-233-ge586fe35-0ubuntu1~16.04.2) ... Searching for GRUB installation directory ... found: /boot/grub Searching for default file ... found: /boot/grub/default Testing for an existing GRUB menu.lst file ... found: /boot/grub/menu.lst Searching for splash image ... none found, skipping ... Found kernel: /vmlinuz-4.4.0-87-generic Found kernel: /vmlinuz-4.4.0-87-generic Updating /boot/grub/menu.lst ... done Setting up vlan (1.9-3.2ubuntu1.16.04.4) ... Installing new version of config file /etc/network/if-up.d/ip ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for ca-certificates (20170717~16.04.1) ... Updating certificates in /etc/ssl/certs... 17 added, 42 removed; done. Running hooks in /etc/ca-certificates/update.d... done. Processing triggers for initramfs-tools (0.122ubuntu8.8) ... update-initramfs: Generating /boot/initrd.img-4.4.0-87-generic W: mdadm: /etc/mdadm/mdadm.conf defines no arrays. | cs |
* 설치 진행 중에 "Do you want to continue?" 와 같이 계속 진행할 것인지를 묻는데 이때 Y 를 입력합니다.
3. java 설치 전에 openjdk~ 로 시작하는 패키지 및 설정 파일 삭제
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 | $ sudo apt purge openjdk* Reading package lists... Done Building dependency tree Reading state information... Done Note, selecting 'openjdk-9-jre-headless' for glob 'openjdk*' Note, selecting 'openjdk-8-jdk' for glob 'openjdk*' Note, selecting 'openjdk-8-jre' for glob 'openjdk*' Note, selecting 'openjdk-6-jdk' for glob 'openjdk*' Note, selecting 'openjdk-6-jre' for glob 'openjdk*' Note, selecting 'openjdk-9-demo' for glob 'openjdk*' Note, selecting 'openjdk-6-jre-headless' for glob 'openjdk*' Note, selecting 'openjdk-8-demo' for glob 'openjdk*' Note, selecting 'openjdk-8-jre-dcevm' for glob 'openjdk*' Note, selecting 'openjdk-8-jdk-headless' for glob 'openjdk*' Note, selecting 'openjdk-9-dbg' for glob 'openjdk*' Note, selecting 'openjdk-7-jre-headless' for glob 'openjdk*' Note, selecting 'openjdk-9-doc' for glob 'openjdk*' Note, selecting 'openjdk-8-jre-zero' for glob 'openjdk*' Note, selecting 'openjdk-8-source' for glob 'openjdk*' Note, selecting 'openjdk-jre' for glob 'openjdk*' Note, selecting 'openjdk-9-jdk' for glob 'openjdk*' Note, selecting 'openjdk-9-jre' for glob 'openjdk*' Note, selecting 'openjdk-7-jdk' for glob 'openjdk*' Note, selecting 'openjdk-7-jre' for glob 'openjdk*' Note, selecting 'openjdk-9-jdk-headless' for glob 'openjdk*' Note, selecting 'openjdk-8-jre-headless' for glob 'openjdk*' Note, selecting 'openjdk-9-source' for glob 'openjdk*' Note, selecting 'openjdk-8-jre-jamvm' for glob 'openjdk*' Note, selecting 'openjdk-8-dbg' for glob 'openjdk*' Note, selecting 'openjdk-8-doc' for glob 'openjdk*' Package 'openjdk-6-jdk' is not installed, so not removed Package 'openjdk-7-jre-headless' is not installed, so not removed Package 'openjdk-6-jre-headless' is not installed, so not removed Package 'openjdk-7-jre' is not installed, so not removed Package 'openjdk-6-jre' is not installed, so not removed Package 'openjdk-7-jdk' is not installed, so not removed Package 'openjdk-jre' is not installed, so not removed Package 'openjdk-8-jre-dcevm' is not installed, so not removed Package 'openjdk-9-dbg' is not installed, so not removed Package 'openjdk-9-demo' is not installed, so not removed Package 'openjdk-9-doc' is not installed, so not removed Package 'openjdk-9-jdk' is not installed, so not removed Package 'openjdk-9-jdk-headless' is not installed, so not removed Package 'openjdk-9-jre' is not installed, so not removed Package 'openjdk-9-jre-headless' is not installed, so not removed Package 'openjdk-9-source' is not installed, so not removed Package 'openjdk-8-dbg' is not installed, so not removed Package 'openjdk-8-demo' is not installed, so not removed Package 'openjdk-8-doc' is not installed, so not removed Package 'openjdk-8-jdk' is not installed, so not removed Package 'openjdk-8-jdk-headless' is not installed, so not removed Package 'openjdk-8-jre' is not installed, so not removed Package 'openjdk-8-jre-headless' is not installed, so not removed Package 'openjdk-8-jre-jamvm' is not installed, so not removed Package 'openjdk-8-source' is not installed, so not removed Package 'openjdk-8-jre-zero' is not installed, so not removed 0 upgraded, 0 newly installed, 0 to remove and 3 not upgraded. | cs |
* 주의사항
-> "apt purge" 명령어는 remove 명령어와 다르게 관련 설정 파일도 삭제하기 때문에 추후 사용 시에 주의가 필요합니다.
4. 개인 패키지 저장소 추가
1 2 3 4 5 6 7 8 9 10 11 | $ sudo add-apt-repository -y ppa:webupd8team/java gpg: keyring `/tmp/tmpy82g2jco/secring.gpg' created gpg: keyring `/tmp/tmpy82g2jco/pubring.gpg' created gpg: requesting key EEA14886 from hkp server keyserver.ubuntu.com gpg: /tmp/tmpy82g2jco/trustdb.gpg: trustdb created gpg: key EEA14886: public key "Launchpad VLC" imported gpg: no ultimately trusted keys found gpg: Total number processed: 1 gpg: imported: 1 (RSA: 1) OK | cs |
5. 패키지 인덱스 정보 업데이트
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | $ sudo apt update Hit:1 http://us.archive.ubuntu.com/ubuntu xenial InRelease Get:2 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Get:3 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial InRelease [17.5 kB] Get:4 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Get:5 http://us.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Get:6 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial/main amd64 Packages [2,912 B] Get:7 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial/main i386 Packages [2,460 B] Get:8 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial/main Translation-en [1,260 B] Fetched 331 kB in 2s (116 kB/s) Reading package lists... Done Building dependency tree Reading state information... Done 3 packages can be upgraded. Run 'apt list --upgradable' to see them. | cs |
6. java 설치
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 | $ sudo apt install -y oracle-java8-installer Reading package lists... Done Building dependency tree Reading state information... Done The following additional packages will be installed: binutils gsfonts gsfonts-x11 java-common libfontenc1 libxfont1 oracle-java8-set-default x11-common xfonts-encodings xfonts-utils Suggested packages: binutils-doc binfmt-support visualvm ttf-baekmuk | ttf-unfonts | ttf-unfonts-core ttf-kochi-gothic | ttf-sazanami-gothic ttf-kochi-mincho | ttf-sazanami-mincho ttf-arphic-uming firefox | firefox-2 | iceweasel | mozilla-firefox | iceape-browser | mozilla-browser | epiphany-gecko | epiphany-webkit | epiphany-browser | galeon | midbrowser | moblin-web-browser | xulrunner | xulrunner-1.9 | konqueror | chromium-browser | midori | google-chrome The following NEW packages will be installed: binutils gsfonts gsfonts-x11 java-common libfontenc1 libxfont1 oracle-java8-installer oracle-java8-set-default x11-common xfonts-encodings xfonts-utils 0 upgraded, 11 newly installed, 0 to remove and 3 not upgraded. Need to get 6,519 kB of archives. After this operation, 20.5 MB of additional disk space will be used. Get:1 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial/main amd64 oracle-java8-installer all 8u144-1~webupd8~0 [32.9 kB] Get:2 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial/main amd64 oracle-java8-set-default all 8u144-1~webupd8~0 [6,738 B] Get:3 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 binutils amd64 2.26.1-1ubuntu1~16.04.5 [2,311 kB] Get:4 http://us.archive.ubuntu.com/ubuntu xenial/main amd64 java-common all 0.56ubuntu2 [7,742 B] Get:5 http://us.archive.ubuntu.com/ubuntu xenial/main amd64 gsfonts all 1:8.11+urwcyr1.0.7~pre44-4.2ubuntu1 [3,374 kB] Get:6 http://us.archive.ubuntu.com/ubuntu xenial/main amd64 libfontenc1 amd64 1:1.1.3-1 [13.9 kB] Get:7 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libxfont1 amd64 1:1.5.1-1ubuntu0.16.04.3 [95.1 kB] Get:8 http://us.archive.ubuntu.com/ubuntu xenial/main amd64 x11-common all 1:7.7+13ubuntu3 [22.4 kB] Get:9 http://us.archive.ubuntu.com/ubuntu xenial/main amd64 xfonts-encodings all 1:1.0.4-2 [573 kB] Get:10 http://us.archive.ubuntu.com/ubuntu xenial-updates/main amd64 xfonts-utils amd64 1:7.7+3ubuntu0.16.04.2 [74.6 kB] Get:11 http://us.archive.ubuntu.com/ubuntu xenial/universe amd64 gsfonts-x11 all 0.24 [7,314 B] Fetched 6,519 kB in 34s (191 kB/s) Preconfiguring packages ... Selecting previously unselected package binutils. (Reading database ... 59721 files and directories currently installed.) Preparing to unpack .../binutils_2.26.1-1ubuntu1~16.04.5_amd64.deb ... Unpacking binutils (2.26.1-1ubuntu1~16.04.5) ... Selecting previously unselected package java-common. Preparing to unpack .../java-common_0.56ubuntu2_all.deb ... Unpacking java-common (0.56ubuntu2) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for man-db (2.7.5-1) ... Setting up binutils (2.26.1-1ubuntu1~16.04.5) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Selecting previously unselected package oracle-java8-installer. (Reading database ... 59937 files and directories currently installed.) Preparing to unpack .../oracle-java8-installer_8u144-1~webupd8~0_all.deb ... Unpacking oracle-java8-installer (8u144-1~webupd8~0) ... Processing triggers for shared-mime-info (1.5-2ubuntu0.1) ...............................] Processing triggers for mime-support (3.59ubuntu1) ... Setting up java-common (0.56ubuntu2) ... Setting up oracle-java8-installer (8u144-1~webupd8~0) ...................................] No /var/cache/oracle-jdk8-installer/wgetrc file found....................................] Creating /var/cache/oracle-jdk8-installer/wgetrc and using default oracle-java8-installer wgetrc settings for it. Downloading Oracle Java 8... --2017-10-12 11:00:36-- http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz Resolving download.oracle.com (download.oracle.com)... 121.254.136.49, 121.254.136.58 Connecting to download.oracle.com (download.oracle.com)|121.254.136.49|:80... connected. HTTP request sent, awaiting response... 302 Moved Temporarily Location: https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz [following] --2017-10-12 11:00:36-- https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz Resolving edelivery.oracle.com (edelivery.oracle.com)... 104.75.42.49, 2600:1417:e:28b::2d3e, 2600:1417:e:28e::2d3e Connecting to edelivery.oracle.com (edelivery.oracle.com)|104.75.42.49|:443... connected. HTTP request sent, awaiting response... 302 Moved Temporarily Location: http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1507773757_0e6167adc159ce7d572399a0af8ead7b [following] --2017-10-12 11:00:37-- http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1507773757_0e6167adc159ce7d572399a0af8ead7b Connecting to download.oracle.com (download.oracle.com)|121.254.136.49|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 185515842 (177M) [application/x-gzip] Saving to: ‘jdk-8u144-linux-x64.tar.gz’ 0K ........ ........ ........ ........ ........ ........ 1% 10.9M 16s 3072K ........ ........ ........ ........ ........ ........ 3% 11.3M 15s 6144K ........ ........ ........ ........ ........ ........ 5% 9.95M 16s 9216K ........ ........ ........ ........ ........ ........ 6% 11.3M 15s 12288K ........ ........ ........ ........ ........ ........ 8% 11.3M 15s 15360K ........ ........ ........ ........ ........ ........ 10% 11.3M 14s 18432K ........ ........ ........ ........ ........ ........ 11% 11.3M 14s 21504K ........ ........ ........ ........ ........ ........ 13% 11.3M 14s 24576K ........ ........ ........ ........ ........ ........ 15% 11.3M 14s 27648K ........ ........ ........ ........ ........ ........ 16% 11.0M 13s 30720K ........ ........ ........ ........ ........ ........ 18% 11.0M 13s 33792K ........ ........ ........ ........ ........ ........ 20% 11.3M 13s 36864K ........ ........ ........ ........ ........ ........ 22% 10.9M 12s 39936K ........ ........ ........ ........ ........ ........ 23% 11.3M 12s 43008K ........ ........ ........ ........ ........ ........ 25% 10.5M 12s 46080K ........ ........ ........ ........ ........ ........ 27% 10.0M 12s 49152K ........ ........ ........ ........ ........ ........ 28% 11.3M 11s 52224K ........ ........ ........ ........ ........ ........ 30% 4.47M 12s 55296K ........ ........ ........ ........ ........ ........ 32% 11.3M 12s 58368K ........ ........ ........ ........ ........ ........ 33% 11.3M 11s 61440K ........ ........ ........ ........ ........ ........ 35% 11.3M 11s 64512K ........ ........ ........ ........ ........ ........ 37% 11.3M 11s 67584K ........ ........ ........ ........ ........ ........ 39% 9.56M 10s 70656K ........ ........ ........ ........ ........ ........ 40% 8.83M 10s 73728K ........ ........ ........ ........ ........ ........ 42% 10.5M 10s 76800K ........ ........ ........ ........ ........ ........ 44% 10.0M 10s 79872K ........ ........ ........ ........ ........ ........ 45% 9.65M 9s 82944K ........ ........ ........ ........ ........ ........ 47% 8.52M 9s 86016K ........ ........ ........ ........ ........ ........ 49% 7.87M 9s 89088K ........ ........ ........ ........ ........ ........ 50% 10.5M 9s 92160K ........ ........ ........ ........ ........ ........ 52% 10.6M 8s 95232K ........ ........ ........ ........ ........ ........ 54% 11.2M 8s 98304K ........ ........ ........ ........ ........ ........ 55% 11.1M 8s 101376K ........ ........ ........ ........ ........ ........ 57% 11.3M 7s 104448K ........ ........ ........ ........ ........ ........ 59% 11.3M 7s 107520K ........ ........ ........ ........ ........ ........ 61% 11.3M 7s 110592K ........ ........ ........ ........ ........ ........ 62% 11.3M 6s 113664K ........ ........ ........ ........ ........ ........ 64% 11.3M 6s 116736K ........ ........ ........ ........ ........ ........ 66% 11.0M 6s 119808K ........ ........ ........ ........ ........ ........ 67% 11.2M 6s 122880K ........ ........ ........ ........ ........ ........ 69% 10.7M 5s 125952K ........ ........ ........ ........ ........ ........ 71% 11.3M 5s 129024K ........ ........ ........ ........ ........ ........ 72% 4.86M 5s 132096K ........ ........ ........ ........ ........ ........ 74% 11.3M 4s 135168K ........ ........ ........ ........ ........ ........ 76% 11.2M 4s 138240K ........ ........ ........ ........ ........ ........ 78% 11.3M 4s 141312K ........ ........ ........ ........ ........ ........ 79% 11.3M 4s 144384K ........ ........ ........ ........ ........ ........ 81% 11.3M 3s 147456K ........ ........ ........ ........ ........ ........ 83% 11.2M 3s 150528K ........ ........ ........ ........ ........ ........ 84% 11.3M 3s 153600K ........ ........ ........ ........ ........ ........ 86% 10.8M 2s 156672K ........ ........ ........ ........ ........ ........ 88% 11.3M 2s 159744K ........ ........ ........ ........ ........ ........ 89% 8.77M 2s 162816K ........ ........ ........ ........ ........ ........ 91% 11.3M 1s 165888K ........ ........ ........ ........ ........ ........ 93% 9.29M 1s 168960K ........ ........ ........ ........ ........ ........ 94% 10.2M 1s 172032K ........ ........ ........ ........ ........ ........ 96% 11.2M 1s 175104K ........ ........ ........ ........ ........ ........ 98% 11.3M 0s 178176K ........ ........ ........ ........ ........ ...... 100% 11.3M=17s 2017-10-12 11:00:54 (10.3 MB/s) - ‘jdk-8u144-linux-x64.tar.gz’ saved [185515842/185515842] Download done. Removing outdated cached downloads... update-alternatives: error: no alternatives for java update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/ControlPanel to provide /usr/bin/ControlPanel (ControlPanel) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/java to provide /usr/bin/java (java) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/javaws to provide /usr/bin/javaws (javaws) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/jcontrol to provide /usr/bin/jcontrol (jcontrol) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/jjs to provide /usr/bin/jjs (jjs) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/keytool to provide /usr/bin/keytool (keytool) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/pack200 to provide /usr/bin/pack200 (pack200) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/rmid to provide /usr/bin/rmid (rmid) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/rmiregistry to provide /usr/bin/rmiregistry (rmiregistry) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/bin/unpack200 to provide /usr/bin/unpack200 (unpack200) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/lib/jexec to provide /usr/bin/jexec (jexec) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jar to provide /usr/bin/jar (jar) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jarsigner to provide /usr/bin/jarsigner (jarsigner) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/javac to provide /usr/bin/javac (javac) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/javadoc to provide /usr/bin/javadoc (javadoc) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/javafxpackager to provide /usr/bin/javafxpackager (javafxpackager) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/javah to provide /usr/bin/javah (javah) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/javap to provide /usr/bin/javap (javap) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/javapackager to provide /usr/bin/javapackager (javapackager) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jcmd to provide /usr/bin/jcmd (jcmd) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jconsole to provide /usr/bin/jconsole (jconsole) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jdb to provide /usr/bin/jdb (jdb) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jdeps to provide /usr/bin/jdeps (jdeps) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jinfo to provide /usr/bin/jinfo (jinfo) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jmap to provide /usr/bin/jmap (jmap) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jmc to provide /usr/bin/jmc (jmc) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jps to provide /usr/bin/jps (jps) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jrunscript to provide /usr/bin/jrunscript (jrunscript) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jstack to provide /usr/bin/jstack (jstack) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jstat to provide /usr/bin/jstat (jstat) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jstatd to provide /usr/bin/jstatd (jstatd) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/jvisualvm to provide /usr/bin/jvisualvm (jvisualvm) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/rmic to provide /usr/bin/rmic (rmic) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/serialver to provide /usr/bin/serialver (serialver) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode update-alternatives: using /usr/lib/jvm/java-8-oracle/jre/lib/amd64/libnpjp2.so to provide /usr/lib/mozilla/plugins/libjavaplugin.so (mozilla-javaplugin.so) in auto mode Oracle JDK 8 installed #####Important######## To set Oracle JDK8 as default, install the "oracle-java8-set-default" package. E.g.: sudo apt install oracle-java8-set-default On Ubuntu systems, oracle-java8-set-default is most probably installed automatically with this package. ###################### Selecting previously unselected package oracle-java8-set-default.........................] (Reading database ... 59978 files and directories currently installed.) Preparing to unpack .../oracle-java8-set-default_8u144-1~webupd8~0_all.deb ... Unpacking oracle-java8-set-default (8u144-1~webupd8~0) ..................................] Selecting previously unselected package gsfonts..........................................] Preparing to unpack .../gsfonts_1%3a8.11+urwcyr1.0.7~pre44-4.2ubuntu1_all.deb ... Unpacking gsfonts (1:8.11+urwcyr1.0.7~pre44-4.2ubuntu1) .................................] Selecting previously unselected package libfontenc1:amd64................................] Preparing to unpack .../libfontenc1_1%3a1.1.3-1_amd64.deb ... Unpacking libfontenc1:amd64 (1:1.1.3-1) ...###...........................................] Selecting previously unselected package libxfont1:amd64..................................] Preparing to unpack .../libxfont1_1%3a1.5.1-1ubuntu0.16.04.3_amd64.deb ... Unpacking libxfont1:amd64 (1:1.5.1-1ubuntu0.16.04.3) ....................................] Selecting previously unselected package x11-common.##....................................] Preparing to unpack .../x11-common_1%3a7.7+13ubuntu3_all.deb ... Unpacking x11-common (1:7.7+13ubuntu3) ...############...................................] Selecting previously unselected package xfonts-encodings.................................] Preparing to unpack .../xfonts-encodings_1%3a1.0.4-2_all.deb ... Unpacking xfonts-encodings (1:1.0.4-2) ...################...............................] Selecting previously unselected package xfonts-utils.#######.............................] Preparing to unpack .../xfonts-utils_1%3a7.7+3ubuntu0.16.04.2_amd64.deb ... Unpacking xfonts-utils (1:7.7+3ubuntu0.16.04.2) ...###########...........................] Selecting previously unselected package gsfonts-x11.############.........................] Preparing to unpack .../gsfonts-x11_0.24_all.deb ... Unpacking gsfonts-x11 (0.24) ...#################################........................] Processing triggers for libc-bin (2.23-0ubuntu9) ...################.....................] Processing triggers for systemd (229-4ubuntu19) ... Processing triggers for ureadahead (0.100.0-19) ... Processing triggers for man-db (2.7.5-1) ... Setting up oracle-java8-set-default (8u144-1~webupd8~0) ... Setting up gsfonts (1:8.11+urwcyr1.0.7~pre44-4.2ubuntu1) ...##########...................] Setting up libfontenc1:amd64 (1:1.1.3-1) ...#############################................] Setting up libxfont1:amd64 (1:1.5.1-1ubuntu0.16.04.3) ...###################.............] Setting up x11-common (1:7.7+13ubuntu3) ...###################################...........] update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults Setting up xfonts-encodings (1:1.0.4-2) ...######################################........] Setting up xfonts-utils (1:7.7+3ubuntu0.16.04.2) ...###############################......] Setting up gsfonts-x11 (0.24) ...#####################################################...] Processing triggers for libc-bin (2.23-0ubuntu9) ...####################################.] Processing triggers for systemd (229-4ubuntu19) ... Processing triggers for ureadahead (0.100.0-19) ... | cs |
* 설치 진행 중에 아래와 같이 license 동의 관련 창이 출력됩니다.
6-1. license 동의서
6-2. license 동의서
* 위와 같이 Yes 를 선택하고 다음으로 넘어갑니다.
7. java 버전 확인
1 2 3 4 5 | $ java -version java version "1.8.0_144" Java(TM) SE Runtime Environment (build 1.8.0_144-b01) Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode) | cs |
8. java 환경 변수 추가
* 참고
: 명령어를 통해 환경 변수 설정 등을 기본값으로 하는 방법은 다음과 같습니다.
1 2 | sudo apt install oracle-java8-set-default | cs |
8-1. java 경로 확인
1 2 3 4 5 6 7 8 9 10 | $ sudo update-alternatives --config java There is 1 choice for the alternative java (providing /usr/bin/java). Selection Path Priority Status ------------------------------------------------------------ 0 /usr/lib/jvm/java-8-oracle/jre/bin/java 1081 auto mode * 1 /usr/lib/jvm/java-8-oracle/jre/bin/java 1081 manual mode Press <enter> to keep the current choice[*], or type selection number: | cs |
* 현재 선택된 설정을 유지하려면 <enter> 버튼을 누르세요.
* jdk 가 설치된 경로는 "/usr/lib/jvm/java-8-oracle" 와 같습니다.
8-2. environment 파일에 java 환경 변수 등록
8-2-1. environment 파일 편집
1 | $ sudo nano /etc/environment | cs |
* 기호에 따라서 vi 를 사용해도 좋습니다.
8-2-2. java 환경 변수 추가
1 2 3 | PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/gam$ JAVA_HOME="/usr/lib/jvm/java-8-oracle" | cs |
* 하단에 위와 같이 JAVA_HOME="/usr/lib/jvm/java-8-oracle" 부분을 추가하고 저장합니다.
8-2-3. environment 파일에 편집한 내용을 적용
1 | $ source /etc/environment | cs |
8-3. profile 파일에 java 환경 변수 등록
8-3-1. profile 파일 편집
1 | $ sudo nano /etc/profile | cs |
8-3-2. java 환경 변수 추가
1 2 3 4 5 6 7 8 | # /etc/profile: system-wide .profile file for the Bourne shell (sh(1)) # and Bourne compatible shells (bash(1), ksh(1), ash(1), ...). ... export JAVA_HOME=/usr/lib/jvm/java-8-oracle export PATH=$PATH:$JAVA_HOME/bin | cs |
* 하단에 위와 같이 JAVA_HOME="/usr/lib/jvm/java-8-oracle" 부분을 추가하고 저장합니다.
8-3-3. profile 파일에 편집한 내용을 적용
1 | $ source /etc/profile | cs |
9-1. host 파일 편집
1 | $ sudo nano /etc/hosts | cs |
9-2. host 파일에 각 node 등록
1 2 3 4 5 6 7 8 9 10 11 12 13 14 | 127.0.0.1 localhost #127.0.1.1 ubuntu.localdomain ubuntu # The following lines are desirable for IPv6 capable hosts ::1 localhost ip6-localhost ip6-loopback ff02::1 ip6-allnodes ff02::2 ip6-allrouters 192.168.10.101 master 192.168.10.102 secondary 192.168.10.103 datanode-a 192.168.10.104 datanode-b 192.168.10.105 datanode-c | cs |
* 127.0.1.1 에 해당하는 부분을 주석 처리
* 각 node 의 IP 주소와 host 명을 입력하고 저장합니다.
10. sysctl.conf
10-1. sysctl.conf 파일 편집
1 | $ sudo nano /etc/sysctl.conf | cs |
10-2. sysctl.conf 파일에 다음의 내용을 추가 후 저장
1 2 3 4 5 6 7 8 9 10 11 12 13 | # # /etc/sysctl.conf - Configuration file for setting system variables # See /etc/sysctl.d/ for additional system variables. # See sysctl.conf (5) for information. # ... # disable ipv6 net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.default.disable_ipv6 = 1 net.ipv6.conf.lo.disable_ipv6 = 1 | cs |
* 위와 같이 4라인을 추가 후 저장합니다.
* 수정 후 저장이 끝나면 서버를 재기동합니다.
10-3. server 재기동
1 | $ sudo reboot | cs |
11. hadoop 관련 그룹 및 계정 추가
11-1. hadoop 그룹 추가
1 2 3 4 | $ sudo addgroup hadoop Adding group `hadoop' (GID 1001) ... Done. | cs |
11-2. hadoop 유저 추가
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | $ sudo adduser --ingroup hadoop hadoop-user Adding user `hadoop-user' ... Adding new user `hadoop-user' (1001) with group `hadoop' ... Creating home directory `/home/hadoop-user' ... Copying files from `/etc/skel' ... Enter new UNIX password: Retype new UNIX password: passwd: password updated successfully Changing the user information for hadoop-user Enter the new value, or press ENTER for the default Full Name []: Room Number []: Work Phone []: Home Phone []: Other []: Is the information correct? [Y/n] Y | cs |
* --ingroup 옵션은 다른 그룹에 포함되도록 그룹 지정을 가능케 하는 옵션입니다. 기본적으로 시스템 유저는 nogroup 그룹에 포함됩니다.
* 새롭게 유저를 추가하는 경우 비밀번호와 유저 이름을 입력받는 프롬프트 표시됩니다.
* 마지막에 입력한 내용의 이상 유무를 확인하면 유저가 추가됩니다.
-> ssh 설정 관련 상세한 설명은 위의 링크를 참고하세요.
12-1. ssh 설정 관련 축약
1 2 3 4 5 6 7 8 9 10 11 12 | $ ssh-keygen -t rsa -P $ cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys $ ssh-copy-id ~/.ssh/id_rsa.pub hadoop-user@datanode-a $ ssh-copy-id ~/.ssh/id_rsa.pub hadoop-user@datanode-b $ ssh-copy-id ~/.ssh/id_rsa.pub hadoop-user@datanode-c $ ssh secondary $ ssh datanode-a $ ssh datanode-b $ ssh datanode-c | cs |
* name node 에서 각 node 에 이상 없이 접속이 돼야 합니다.
13. Data Node 의 hadoop 저장소 생성 및 권한 설정
13-1. hadoop 저장소 생성
1 2 3 4 | $ sudo mkdir -p /data01/datanode $ sudo mkdir -p /data02/datanode $ sudo mkdir -p /data03/datanode | cs |
* mkdir -p 에서 -p 옵션을 사용하면 부모 디렉토리가 존재하지 않을 경우 함께 생성을 합니다.
13-2. hadoop 저장소 생성 확인
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | $ ll / |grep data* drwxr-xr-x 3 root root 4096 Oct 12 15:22 data01/ drwxr-xr-x 3 root root 4096 Oct 12 15:24 data02/ drwxr-xr-x 3 root root 4096 Oct 12 15:25 data03/ $ ll /data* /data01: total 12 drwxr-xr-x 3 root root 4096 Oct 12 15:22 ./ drwxr-xr-x 26 root root 4096 Oct 12 15:25 ../ drwxr-xr-x 2 root root 4096 Oct 12 15:22 datanode/ /data02: total 12 drwxr-xr-x 3 root root 4096 Oct 12 15:24 ./ drwxr-xr-x 26 root root 4096 Oct 12 15:25 ../ drwxr-xr-x 2 root root 4096 Oct 12 15:24 datanode/ /data03: total 12 drwxr-xr-x 3 root root 4096 Oct 12 15:25 ./ drwxr-xr-x 26 root root 4096 Oct 12 15:25 ../ drwxr-xr-x 2 root root 4096 Oct 12 15:25 datanode/ | cs |
* hadoop 저장소의 소유자가 hadoop-user 가 아니기 때문에 다음 과정에서 소유자 및 소유 그룹을 변경합니다.
13-3. hadoop 저장소의 소유자 및 소유 그룹 변경
1 2 3 | $ sudo chown -R hadoop-user:hadoop /data01 $ sudo chown -R hadoop-user:hadoop /data02 $ sudo chown -R hadoop-user:hadoop /data03 | cs |
13-4. hadoop 저장소의 소유자 및 소유 그룹 확인
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | $ ll / |grep data* drwxr-xr-x 3 hadoop-user hadoop 4096 Oct 12 15:22 data01/ drwxr-xr-x 3 hadoop-user hadoop 4096 Oct 12 15:24 data02/ drwxr-xr-x 3 hadoop-user hadoop 4096 Oct 12 15:25 data03/ $ ll /data* /data01: total 12 drwxr-xr-x 3 hadoop-user hadoop 4096 Oct 12 15:22 ./ drwxr-xr-x 26 root root 4096 Oct 12 15:25 ../ drwxr-xr-x 2 hadoop-user hadoop 4096 Oct 12 15:22 datanode/ /data02: total 12 drwxr-xr-x 3 hadoop-user hadoop 4096 Oct 12 15:24 ./ drwxr-xr-x 26 root root 4096 Oct 12 15:25 ../ drwxr-xr-x 2 hadoop-user hadoop 4096 Oct 12 15:24 datanode/ /data03: total 12 drwxr-xr-x 3 hadoop-user hadoop 4096 Oct 12 15:25 ./ drwxr-xr-x 26 root root 4096 Oct 12 15:25 ../ drwxr-xr-x 2 hadoop-user hadoop 4096 Oct 12 15:25 datanode/ | cs |
14. hadoop 다운로드
1 2 3 4 5 6 7 8 9 10 11 12 | $ wget http://apache.mirror.cdnetworks.com/hadoop/common/hadoop-2.8.1/hadoop-2.8.1.tar.gz --2017-10-12 15:46:05-- http://apache.mirror.cdnetworks.com/hadoop/common/hadoop-2.8.1/hadoop-2.8.1.tar.gz Resolving apache.mirror.cdnetworks.com (apache.mirror.cdnetworks.com)... 14.0.101.165 Connecting to apache.mirror.cdnetworks.com (apache.mirror.cdnetworks.com)|14.0.101.165|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 424555111 (405M) [application/x-gzip] Saving to: ‘hadoop-2.8.1.tar.gz’ hadoop-2.8.1.tar.gz 100%[============================>] 404.89M 5.97MB/s in 2m 18s 2017-10-12 15:48:23 (2.94 MB/s) - ‘hadoop-2.8.1.tar.gz’ saved [424555111/424555111] | cs |
15. hadoop 압축 파일 해제
1 2 | $ tar -xvzf /usr/local/hadoop-2.8.1.tar.gz | cs |
hadoop-2.8.1.txt※ 16번 이후 작업에 대해서는 hadoop 소유자로 계정을 전환하여 진행하는 편이 좋습니다.
1 2 3 | $ su - hadoop-user Password: | cs |
※ hadoop-user 계정을 생성한 이후 별다른 설정을 하지 않았다면 sudo 명령을 사용할 수 없기 때문에 아래 링크를 참조하세요.
16. ~/hadoop-2.8.1 디렉토리를 /usr/local/ 디렉토리로 이동
1 2 | $ sudo mv ~/hadoop-2.8.1 /usr/local/ | cs |
17. hadoop 디렉토리 경로 확인
1 2 3 | $ ll /usr/local/ |grep hadoop-2.8.1 drwxrwxr-x 9 user user 4096 Jun 2 15:24 hadoop-2.8.1/ | cs |
18. /usr/local/hadoop-2.8.1 디렉토리에 대한 /usr/local/hadoop 링크 생성
1 2 | $ sudo ln -sf /usr/local/hadoop-2.8.1 /usr/local/hadoop | cs |
19. hadoop 링크 생성 확인
1 2 3 4 | $ ll /usr/local/ |grep hadoop lrwxrwxrwx 1 root root 23 Oct 12 17:28 hadoop -> /usr/local/hadoop-2.8.1/ drwxrwxr-x 9 user user 4096 Jun 2 15:24 hadoop-2.8.1/ | cs |
* 위의 디렉토리에 대한 소유자 및 소유 그룹이 hadoop 소유 그룹 및 소유자가 아니기 때문에 다음 과정에서 변경합니다.
20. hadoop 디렉토리의 소유 그룹 및 소유자 변경
1 2 | $ sudo chown -R hadoop-user:hadoop /usr/local/hadoop-2.8.1 | cs |
21. hadoop 디렉토리의 소유 그룹 및 소유자 확인
1 2 3 4 | $ ll /usr/local/ |grep hadoop lrwxrwxrwx 1 root root 23 Oct 12 17:28 hadoop -> /usr/local/hadoop-2.8.1/ drwxrwxr-x 9 hadoop-user hadoop 4096 Jun 2 15:24 hadoop-2.8.1/ | cs |
22. masters 파일 생성
1 2 | $ echo secondary > /usr/local/hadoop/etc/hadoop/masters | cs |
* masters 파일에 보조 네임 노드가 있을 경우 해당 보조 네임 노드의 호스트명을 입력합니다.
23. slaves 파일 수정
23-1. 초기 상태
1 2 | $ cat /usr/local/hadoop/etc/hadoop/slaves | cs |
23-2. 설정 수정
23-2-1. salves 편집
1 2 | $ vi /usr/local/hadoop/etc/hadoop/slaves | cs |
23-2-2. 설정 편집 후 저장
1 2 3 4 | datanode-a datanode-b datanode-c | cs |
* 기존의 localhost 라고 작성된 내용을 삭제 후 위와 같이 데이터 노드의 호스트명을 차례로 입력 후 저장합니다.
24. java 환경 변수 추가
24-1. .bashrc 파일에 java 환경 변수 등록
24-1-1. .bashrc 파일 편집
1 2 | $ nano ~/.bashrc | cs |
24-1-2. java 환경 변수 추가
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | # ~/.bashrc: executed by bash(1) for non-login shells. # see /usr/share/doc/bash/examples/startup-files (in the package bash-doc) # for examples ... # Set Hadoop-related environment variables export HADOOP_PREFIX=/usr/local/hadoop export HADOOP_HOME=/usr/local/hadoop export HADOOP_MAPRED_HOME=${HADOOP_HOME} export HADOOP_COMMON_HOME=${HADOOP_HOME} export HADOOP_HDFS_HOME=${HADOOP_HOME} export HADOOP_YARN_HOME=${HADOOP_HOME} export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop # Native path export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_PREFIX}/lib/native export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib/native" # Java path export JAVA_HOME=/usr/lib/jvm/java-8-oracle # Add Hadoop bin/ directory to PATH export PATH=$PATH:$HADOOP_HOME/bin:$JAVA_PATH/bin:$HADOOP_HOME/sbin | cs |
* 하단에 위와 같이 7~21라인 부분을 추가하고 저장합니다.
24-1-3. .bashrc 파일에 편집한 내용을 적용
1 | $ source ~/.bashrc | cs |
25. hadoop 의 환경 설정
25-1. core-site.xml 파일 편집
1 2 | $ vi /usr/local/hadoop/etc/hadoop/core-site.xml | cs |
25-1-1. core-site.xml 파일에 설정 추가
25-1-2. 초기 상태
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 | <?xml version="1.0" encoding="UTF-8"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. See accompanying LICENSE file. --> <!-- Put site-specific property overrides in this file. --> <configuration> </configuration> | cs |
* <configuration> 과 </configuration> 의 사이에 해당 내용을 추가합니다.
25-1-3. 설정 추가
1 2 3 4 5 6 7 8 9 | <property> <name>fs.default.name</name> <value>hdfs://master:8020</value> </property> <property> <name>hadoop.tmp.dir</name> <value>/usr/local/hadoop/tmp</value> </property> | cs |
* 위의 내용을 추가하고 저장합니다.
* master 는 네임 노드의 호스트명이며 각자의 호스트명에 맞게 기입하세요.
25-2. hdfs-site.xml 파일 편집
1 2 | $ vi /usr/local/hadoop/etc/hadoop/hdfs-site.xml | cs |
25-2-1. hdfs-site.xml 파일에 설정 추가
25-2-2. 초기 상태
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | <?xml version="1.0" encoding="UTF-8"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. See accompanying LICENSE file. --> <!-- Put site-specific property overrides in this file. --> <configuration> </configuration> | cs |
* <configuration> 과 </configuration> 의 사이에 해당 내용을 추가합니다.
25-2-3. 설정 추가
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 | <property> <name>dfs.replication</name> <value>3</value> </property> <property> <name>dfs.http.address</name> <value>master:50070</value> </property> <property> <name>dfs.namenode.name.dir</name> <value>/usr/local/hadoop/yarn_data/hdfs/namenode</value> </property> <property> <name>dfs.namenode.secondary.http-address</name> <value>secondary:50090</value> </property> <!-- <property> <name>fs.default.name</name> <value>hdfs://master:8020</value> </property> --> <property> <name>dfs.hosts</name> <value>/usr/local/hadoop/etc/hadoop/slaves</value> </property> <property> <name>dfs.datanode.data.dir</name> <value>/data01/datanode,/data02/datanode,/data03/datanode</value> </property> | cs |
* 위의 내용을 추가하고 저장합니다.
* "/usr/local/hadoop/yarn_data/hdfs/namenode" 부분에 해당 디렉토리를 생성합니다.
1 2 | $ mkdir -p /usr/local/hadoop/yarn_data/hdfs/namenode | cs |
25-3. mapred-site.xml 파일 생성
1 2 | cp /usr/local/hadoop/etc/hadoop/mapred-site.xml.template /usr/local/hadoop/etc/hadoop/mapred-site.xml | cs |
* 초기 상태에서 mapred-site.xml 이 존재하지 않기 때문에 mapred-site.xml.template 파일을 mapred-site.xml 이름으로 복사합니다.
25-3-1. mapred-site.xml 파일에 설정 추가
25-3-2. 초기 상태
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. See accompanying LICENSE file. --> <!-- Put site-specific property overrides in this file. --> <configuration> </configuration> | cs |
* <configuration> 과 </configuration> 의 사이에 해당 내용을 추가합니다.
25-3-3. 설정 추가
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | <property> <name>mapreduce.framework.name</name> <value>yarn</value> </property> <property> <name>mapreduce.jobtracker.address</name> <value>master:8021</value> </property> <property> <name>mapred.job.tracker</name> <value>master:9001</value> </property> <property> <name>mapred.job.tracker.http.address</name> <value>master:50030</value> </property> | cs |
* 위의 내용을 추가하고 저장합니다.
25-4. yarn-site.xml 파일 편집
1 2 | $ vi /usr/local/hadoop/etc/hadoop/yarn-site.xml | cs |
25-4-1. yarn-site.xml 파일에 설정 추가
25-4-2. 초기 상태
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 | <?xml version="1.0"?> <!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. See accompanying LICENSE file. --> <configuration> <!-- Site specific YARN configuration properties --> </configuration> | cs |
* <configuration> 과 </configuration> 의 사이에 해당 내용을 추가합니다.
25-4-3. 설정 추가
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 | <configuration> <!-- Site specific YARN configuration properties --> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> <property> <name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name> <value>org.apache.hadoop.mapred.ShuffleHandler</value> </property> <property> <name>yarn.resourcemanager.hostname</name> <value>master</value> </property> <property> <name>yarn.resourcemanager.scheduler.address</name> <value>master:8030</value> </property> <property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>master:8031</value> </property> <property> <name>yarn.resourcemanager.address</name> <value>master:8032</value> </property> <property> <name>yarn.resourcemanager.admin.address</name> <value>master:8041</value> </property> </configuration> | cs |
* 위의 내용을 추가하고 저장합니다.
위의 과정이 전 노드에 설치 및 설정 완료된 이후 name node에서 아래 단계를 진행하세요. |
26. hdfs 포맷
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 | $ hdfs namenode -format SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.8.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/local/hive-0.8.1/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 17/10/13 09:17:17 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: user = hadoop-user STARTUP_MSG: host = master/192.168.10.101 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 2.8.1 STARTUP_MSG: classpath = /usr/local/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/httpcore-4.4.4.jar:/usr/local/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar:/usr/local/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/common/lib/hamcrest-core-1.3.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/curator-client-2.7.1.jar:/usr/local/hadoop/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/usr/local/hadoop/share/hadoop/common/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/htrace-core4-4.0.1-incubating.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-collections-3.2.2.jar:/usr/local/hadoop/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/usr/local/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/usr/local/hadoop/share/hadoop/common/lib/gson-2.2.4.jar:/usr/local/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar:/usr/local/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/usr/local/hadoop/share/hadoop/common/lib/jcip-annotations-1.0.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/usr/local/hadoop/share/hadoop/common/lib/json-smart-1.1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/usr/local/hadoop/share/hadoop/common/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar:/usr/local/hadoop/share/hadoop/common/lib/jsr305-3.0.0.jar:/usr/local/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/common/lib/zookeeper-3.4.6.jar:/usr/local/hadoop/share/hadoop/common/lib/nimbus-jose-jwt-3.9.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/usr/local/hadoop/share/hadoop/common/lib/curator-framework-2.7.1.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-auth-2.8.1.jar:/usr/local/hadoop/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/usr/local/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/common/lib/jsch-0.1.51.jar:/usr/local/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/common/lib/junit-4.11.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/usr/local/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/usr/local/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-annotations-2.8.1.jar:/usr/local/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/usr/local/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/usr/local/hadoop/share/hadoop/common/lib/httpclient-4.5.2.jar:/usr/local/hadoop/share/hadoop/common/hadoop-nfs-2.8.1.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.8.1.jar:/usr/local/hadoop/share/hadoop/common/hadoop-common-2.8.1-tests.jar:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/okio-1.4.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/htrace-core4-4.0.1-incubating.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/okhttp-2.4.0.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.8.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/usr/local/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.8.1.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-native-client-2.8.1-tests.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.8.1.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-client-2.8.1.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-native-client-2.8.1.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.8.1-tests.jar:/usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-client-2.8.1-tests.jar:/usr/local/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/javassist-3.18.1-GA.jar:/usr/local/hadoop/share/hadoop/yarn/lib/fst-2.24.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-math-2.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/activation-1.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/objenesis-2.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/usr/local/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/usr/local/hadoop/share/hadoop/yarn/lib/curator-test-2.7.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar:/usr/local/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/usr/local/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar:/usr/local/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.8.1.jar:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.1-tests.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.8.1.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.8.1.jar:/usr/local/hive/conf:/usr/local/hive/lib:/usr/local/hive/lib/ant-contrib-1.0b3.jar:/usr/local/hive/lib/antlr-2.7.7.jar:/usr/local/hive/lib/antlr-3.0.1.jar:/usr/local/hive/lib/antlr-runtime-3.0.1.jar:/usr/local/hive/lib/asm-3.1.jar:/usr/local/hive/lib/commons-cli-1.2.jar:/usr/local/hive/lib/commons-codec-1.3.jar:/usr/local/hive/lib/commons-collections-3.2.1.jar:/usr/local/hive/lib/commons-dbcp-1.4.jar:/usr/local/hive/lib/commons-lang-2.4.jar:/usr/local/hive/lib/commons-logging-1.0.4.jar:/usr/local/hive/lib/commons-logging-api-1.0.4.jar:/usr/local/hive/lib/commons-pool-1.5.4.jar:/usr/local/hive/lib/datanucleus-connectionpool-2.0.3.jar:/usr/local/hive/lib/datanucleus-core-2.0.3.jar:/usr/local/hive/lib/datanucleus-enhancer-2.0.3.jar:/usr/local/hive/lib/datanucleus-rdbms-2.0.3.jar:/usr/local/hive/lib/derby-10.4.2.0.jar:/usr/local/hive/lib/guava-r06.jar:/usr/local/hive/lib/hbase-0.89.0-SNAPSHOT.jar:/usr/local/hive/lib/hbase-0.89.0-SNAPSHOT-tests.jar:/usr/local/hive/lib/hive-anttasks-0.8.1.jar:/usr/local/hive/lib/hive-builtins-0.8.1.jar:/usr/local/hive/lib/hive-cli-0.8.1.jar:/usr/local/hive/lib/hive-common-0.8.1.jar:/usr/local/hive/lib/hive-contrib-0.8.1.jar:/usr/local/hive/lib/hive_contrib.jar:/usr/local/hive/lib/hive-exec-0.8.1.jar:/usr/local/hive/lib/hive-hbase-handler-0.8.1.jar:/usr/local/hive/lib/hive-hwi-0.8.1.jar:/usr/local/hive/lib/hive-jdbc-0.8.1.jar:/usr/local/hive/lib/hive-metastore-0.8.1.jar:/usr/local/hive/lib/hive-pdk-0.8.1.jar:/usr/local/hive/lib/hive-serde-0.8.1.jar:/usr/local/hive/lib/hive-service-0.8.1.jar:/usr/local/hive/lib/hive-shims-0.8.1.jar:/usr/local/hive/lib/javaewah-0.3.jar:/usr/local/hive/lib/jdo2-api-2.3-ec.jar:/usr/local/hive/lib/jline-0.9.94.jar:/usr/local/hive/lib/json-20090211.jar:/usr/local/hive/lib/junit-4.10.jar:/usr/local/hive/lib/libfb303-0.7.0.jar:/usr/local/hive/lib/libfb303.jar:/usr/local/hive/lib/libthrift-0.7.0.jar:/usr/local/hive/lib/libthrift.jar:/usr/local/hive/lib/log4j-1.2.15.jar:/usr/local/hive/lib/log4j-1.2.16.jar:/usr/local/hive/lib/mockito-all-1.8.2.jar:/usr/local/hive/lib/mysql-connector-java-5.1.9.jar:/usr/local/hive/lib/slf4j-api-1.6.1.jar:/usr/local/hive/lib/slf4j-log4j12-1.6.1.jar:/usr/local/hive/lib/stringtemplate-3.1-b1.jar:/usr/local/hive/lib/velocity-1.5.jar:/usr/local/hive/lib/zookeeper-3.3.1.jar STARTUP_MSG: build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r 20fe5304904fc2f5a18053c389e43cd26f7a70fe; compiled by 'vinodkv' on 2017-06-02T06:14Z STARTUP_MSG: java = 1.8.0_144 ************************************************************/ 17/10/13 09:17:17 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT] 17/10/13 09:17:17 INFO namenode.NameNode: createNameNode [-format] 17/10/13 09:17:18 WARN common.Util: Path /usr/local/hadoop/yarn_data/hdfs/namenode should be specified as a URI in configuration files. Please update hdfs configuration. 17/10/13 09:17:18 WARN common.Util: Path /usr/local/hadoop/yarn_data/hdfs/namenode should be specified as a URI in configuration files. Please update hdfs configuration. Formatting using clusterid: CID-fc9f843f-928a-4c9c-bd10-e2dd4c567d79 17/10/13 09:17:18 INFO namenode.FSEditLog: Edit logging is async:false 17/10/13 09:17:18 INFO namenode.FSNamesystem: KeyProvider: null 17/10/13 09:17:18 INFO namenode.FSNamesystem: fsLock is fair: true 17/10/13 09:17:18 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 17/10/13 09:17:18 INFO util.HostsFileReader: Adding a node "datanode-a" to the list of included hosts from /usr/local/hadoop/etc/hadoop/slaves 17/10/13 09:17:18 INFO util.HostsFileReader: Adding a node "datanode-b" to the list of included hosts from /usr/local/hadoop/etc/hadoop/slaves 17/10/13 09:17:18 INFO util.HostsFileReader: Adding a node "datanode-c" to the list of included hosts from /usr/local/hadoop/etc/hadoop/slaves 17/10/13 09:17:18 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000 17/10/13 09:17:18 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 17/10/13 09:17:18 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 17/10/13 09:17:18 INFO blockmanagement.BlockManager: The block deletion will start around 2017 Oct 13 09:17:18 17/10/13 09:17:18 INFO util.GSet: Computing capacity for map BlocksMap 17/10/13 09:17:18 INFO util.GSet: VM type = 64-bit 17/10/13 09:17:18 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB 17/10/13 09:17:18 INFO util.GSet: capacity = 2^21 = 2097152 entries 17/10/13 09:17:18 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false 17/10/13 09:17:18 INFO blockmanagement.BlockManager: defaultReplication = 3 17/10/13 09:17:18 INFO blockmanagement.BlockManager: maxReplication = 512 17/10/13 09:17:18 INFO blockmanagement.BlockManager: minReplication = 1 17/10/13 09:17:18 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 17/10/13 09:17:18 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000 17/10/13 09:17:18 INFO blockmanagement.BlockManager: encryptDataTransfer = false 17/10/13 09:17:18 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 17/10/13 09:17:18 INFO namenode.FSNamesystem: fsOwner = hadoop-user (auth:SIMPLE) 17/10/13 09:17:18 INFO namenode.FSNamesystem: supergroup = supergroup 17/10/13 09:17:18 INFO namenode.FSNamesystem: isPermissionEnabled = true 17/10/13 09:17:18 INFO namenode.FSNamesystem: HA Enabled: false 17/10/13 09:17:18 INFO namenode.FSNamesystem: Append Enabled: true 17/10/13 09:17:18 INFO util.GSet: Computing capacity for map INodeMap 17/10/13 09:17:18 INFO util.GSet: VM type = 64-bit 17/10/13 09:17:18 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB 17/10/13 09:17:18 INFO util.GSet: capacity = 2^20 = 1048576 entries 17/10/13 09:17:18 INFO namenode.FSDirectory: ACLs enabled? false 17/10/13 09:17:18 INFO namenode.FSDirectory: XAttrs enabled? true 17/10/13 09:17:18 INFO namenode.NameNode: Caching file names occurring more than 10 times 17/10/13 09:17:18 INFO util.GSet: Computing capacity for map cachedBlocks 17/10/13 09:17:18 INFO util.GSet: VM type = 64-bit 17/10/13 09:17:18 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB 17/10/13 09:17:18 INFO util.GSet: capacity = 2^18 = 262144 entries 17/10/13 09:17:18 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033 17/10/13 09:17:18 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0 17/10/13 09:17:18 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000 17/10/13 09:17:18 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 17/10/13 09:17:18 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 17/10/13 09:17:18 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 17/10/13 09:17:18 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 17/10/13 09:17:18 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 17/10/13 09:17:18 INFO util.GSet: Computing capacity for map NameNodeRetryCache 17/10/13 09:17:18 INFO util.GSet: VM type = 64-bit 17/10/13 09:17:18 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB 17/10/13 09:17:18 INFO util.GSet: capacity = 2^15 = 32768 entries 17/10/13 09:17:21 INFO namenode.FSImage: Allocated new BlockPoolId: BP-1747180547-192.168.10.101-1507853841326 17/10/13 09:17:21 INFO common.Storage: Storage directory /usr/local/hadoop-2.8.1/yarn_data/hdfs/namenode has been successfully formatted. 17/10/13 09:17:21 INFO namenode.FSImageFormatProtobuf: Saving image file /usr/local/hadoop-2.8.1/yarn_data/hdfs/namenode/current/fsimage.ckpt_0000000000000000000 using no compression 17/10/13 09:17:21 INFO namenode.FSImageFormatProtobuf: Image file /usr/local/hadoop-2.8.1/yarn_data/hdfs/namenode/current/fsimage.ckpt_0000000000000000000 of size 328 bytes saved in 0 seconds. 17/10/13 09:17:21 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0 17/10/13 09:17:21 INFO util.ExitUtil: Exiting with status 0 17/10/13 09:17:21 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at master/192.168.10.101 ************************************************************/ | cs |
* name node 에 메타 데이터가 저장되고 있기 때문에 데이터가 저장된 이후에는 hdfs 포맷은 신중히 하는 게 좋습니다.
27. hadoop 서비스 실행
27-1. 서비스 실행 방법1
1 2 3 | $ /usr/local/hadoop/sbin/start-dfs.sh $ /usr/local/hadoop/sbin/start-yarn.sh | cs |
27-2. 서비스 실행 방법2
1 2 | $ /usr/local/hadoop/sbin/start-all.sh | cs |
* 위의 2가지 명령어를 한 번에 실행하는 명령어이나 권장하는 방법은 아닙니다.
27-3. 서비스 실행 시
27-3-1. start-dfs.sh
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | $ /usr/local/hadoop/sbin/hadoop/start-dfs.sh SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.8.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Starting namenodes on [master] master: starting namenode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-namenode-master.out datanode-b: starting datanode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-datanode-datanode-b.out datanode-a: starting datanode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-datanode-datanode-a.out datanode-c: starting datanode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-datanode-datanode-c.out Starting secondary namenodes [secondary] secondary: starting secondarynamenode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-secondarynamenode-secondary.out SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.8.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] | cs |
27-3-2. start-yarn.sh
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | $ /usr/local/hadoop/sbin/hadoop/start-dfs.sh SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.8.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Starting namenodes on [master] master: starting namenode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-namenode-master.out datanode-b: starting datanode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-datanode-datanode-b.out datanode-a: starting datanode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-datanode-datanode-a.out datanode-c: starting datanode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-datanode-datanode-c.out Starting secondary namenodes [secondary] secondary: starting secondarynamenode, logging to /usr/local/hadoop-2.8.1/logs/hadoop-hadoop-user-secondarynamenode-secondary.out SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.8.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] | cs |
28. 서비스 실행
28-1. jps 혹은 jps -m
1 2 3 4 5 6 | $ jps 23185 ResourceManager 5508 NodeManager 22861 NameNode 23485 Jps | cs |
* 간혹 NodeManager 과 ResourceManager 이 올라오지 않는 경우가 있는데 이때 아래와 같이 개별적으로 서비스를 실행합니다.
1 2 3 | $ /usr/local/hadoop/sbin/yarn-daemon.sh start nodemanager $ /usr/local/hadoop/sbin/yarn-daemon.sh start resourcemanager | cs |
29-1. 서비스 확인
29-1-1. name node
1 2 3 4 5 6 | $ jps 23185 ResourceManager 5508 NodeManager 23549 Jps 22861 NameNode | cs |
29-1-2. secondary node
1 2 3 4 | $ jps 13976 Jps 13547 SecondaryNameNode | cs |
29-1-3. datanode-a
1 2 3 4 5 | $ jps 2050 Jps 1847 NodeManager 1722 DataNode | cs |
29-1-4. datanode-b
1 2 3 4 5 | $ jps 2038 Jps 1835 NodeManager 1711 DataNode | cs |
29-1-5. datanode-c
1 2 3 4 5 | $ jps 1732 DataNode 1897 NodeManager 2061 Jps | cs |
* 각 노드별 해당 서비스 이상 없이 실행되고 있는지 확인합니다.
29-2. Web UI 를 통한 모니터링
28-2-1. namenode Web UI
* 25-2-3. 설정 추가에서 dfs.http.address 의 부분에 설정한 경로로 접근합니다.
28-2-2. resource manager Web UI
* resource manager 서비스를 모니터링할 수 있는 Web UI 로써 포트 번호는 8088로 접근합니다.
'Big Data Platform > Hadoop' 카테고리의 다른 글
| [에러] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project hadoop-pipes: An Ant BuildException has occured: exec returned: 1 (0) | 2018.01.12 |
|---|---|
| [경고] Unable to load native-hadoop library for your platform (0) | 2018.01.10 |
| wordcount 실습 (0) | 2017.10.13 |
| pi 실습 (0) | 2017.10.13 |
| Unable to determine address of the host-falling back to "localhost" address (0) | 2017.10.13 |