[vagrant@masternode ~]$ sudo yum install hadoop-hdfs-namenode Failed to set locale, defaulting to C Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: ftp.uninett.no * extras: ftp.uninett.no * updates: ftp.uninett.no Resolving Dependencies --> Running transaction check ---> Package hadoop-hdfs-namenode.x86_64 0:3.0.0+cdh6.0.1-590678.el7 will be installed --> Processing Dependency: hadoop-hdfs = 3.0.0+cdh6.0.1-590678.el7 for package: hadoop-hdfs-namenode-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Processing Dependency: hadoop-hdfs = 3.0.0+cdh6.0.1-590678.el7 for package: hadoop-hdfs-namenode-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Processing Dependency: hadoop = 3.0.0+cdh6.0.1-590678.el7 for package: hadoop-hdfs-namenode-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Running transaction check ---> Package hadoop.x86_64 0:3.0.0+cdh6.0.1-590678.el7 will be installed cloudera-cdh6/filelists_db | 408 kB 00:00:00 --> Processing Dependency: zookeeper >= 3.4.0 for package: hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Processing Dependency: bigtop-utils >= 0.7 for package: hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Processing Dependency: psmisc for package: hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 base/7/x86_64/filelists_db | 6.9 MB 00:00:00 --> Processing Dependency: parquet for package: hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Processing Dependency: nc for package: hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Processing Dependency: avro-libs for package: hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Processing Dependency: /lib/lsb/init-functions for package: hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 extras/7/x86_64/filelists_db | 603 kB 00:00:00 puppet5/x86_64/filelists_db | 4.3 MB 00:00:00 updates/7/x86_64/filelists_db | 3.2 MB 00:00:00 ---> Package hadoop-hdfs.x86_64 0:3.0.0+cdh6.0.1-590678.el7 will be installed --> Processing Dependency: bigtop-jsvc for package: hadoop-hdfs-3.0.0+cdh6.0.1-590678.el7.x86_64 --> Running transaction check ---> Package avro-libs.noarch 0:1.8.2+cdh6.0.1-590678.el7 will be installed ---> Package bigtop-jsvc.x86_64 0:1.0.10+cdh6.0.1-590678.el7 will be installed ---> Package bigtop-utils.noarch 0:0.7.0+cdh6.0.1-590678.el7 will be installed ---> Package nmap-ncat.x86_64 2:6.40-13.el7 will be installed --> Processing Dependency: libpcap.so.1()(64bit) for package: 2:nmap-ncat-6.40-13.el7.x86_64 ---> Package parquet.noarch 0:1.9.0+cdh6.0.1-590678.el7 will be installed --> Processing Dependency: parquet-format >= 2.1.0 for package: parquet-1.9.0+cdh6.0.1-590678.el7.noarch --> Processing Dependency: hadoop-client >= 2.6.0+cdh5.4.0 for package: parquet-1.9.0+cdh6.0.1-590678.el7.noarch --> Processing Dependency: hadoop-yarn for package: parquet-1.9.0+cdh6.0.1-590678.el7.noarch --> Processing Dependency: hadoop-mapreduce for package: parquet-1.9.0+cdh6.0.1-590678.el7.noarch ---> Package psmisc.x86_64 0:22.20-15.el7 will be installed ---> Package redhat-lsb-core.x86_64 0:4.1-27.el7.centos.1 will be installed --> Processing Dependency: redhat-lsb-submod-security(x86-64) = 4.1-27.el7.centos.1 for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: spax for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /usr/bin/time for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /usr/bin/patch for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /usr/bin/m4 for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /usr/bin/lpr for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /usr/bin/lp for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /usr/bin/bc for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /usr/bin/batch for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /usr/bin/at for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /bin/mailx for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 --> Processing Dependency: /bin/ed for package: redhat-lsb-core-4.1-27.el7.centos.1.x86_64 ---> Package zookeeper.x86_64 0:3.4.5+cdh6.0.1-590678.el7 will be installed --> Running transaction check ---> Package at.x86_64 0:3.1.13-23.el7 will be installed ---> Package bc.x86_64 0:1.06.95-13.el7 will be installed ---> Package cups-client.x86_64 1:1.6.3-35.el7 will be installed ---> Package ed.x86_64 0:1.9-4.el7 will be installed ---> Package hadoop-client.x86_64 0:3.0.0+cdh6.0.1-590678.el7 will be installed ---> Package hadoop-mapreduce.x86_64 0:3.0.0+cdh6.0.1-590678.el7 will be installed ---> Package hadoop-yarn.x86_64 0:3.0.0+cdh6.0.1-590678.el7 will be installed ---> Package libpcap.x86_64 14:1.5.3-11.el7 will be installed ---> Package m4.x86_64 0:1.4.16-10.el7 will be installed ---> Package mailx.x86_64 0:12.5-19.el7 will be installed ---> Package parquet-format.noarch 0:2.3.1+cdh6.0.1-590678.el7 will be installed ---> Package patch.x86_64 0:2.7.1-10.el7_5 will be installed ---> Package redhat-lsb-submod-security.x86_64 0:4.1-27.el7.centos.1 will be installed ---> Package spax.x86_64 0:1.5.2-13.el7 will be installed ---> Package time.x86_64 0:1.7-45.el7 will be installed --> Finished Dependency Resolution Dependencies Resolved ===================================================================================================== Package Arch Version Repository Size ===================================================================================================== Installing: hadoop-hdfs-namenode x86_64 3.0.0+cdh6.0.1-590678.el7 cloudera-cdh6 6.1 k Installing for dependencies: at x86_64 3.1.13-23.el7 base 51 k avro-libs noarch 1.8.2+cdh6.0.1-590678.el7 cloudera-cdh6 41 M bc x86_64 1.06.95-13.el7 base 115 k bigtop-jsvc x86_64 1.0.10+cdh6.0.1-590678.el7 cloudera-cdh6 29 k bigtop-utils noarch 0.7.0+cdh6.0.1-590678.el7 cloudera-cdh6 11 k cups-client x86_64 1:1.6.3-35.el7 base 151 k ed x86_64 1.9-4.el7 base 72 k hadoop x86_64 3.0.0+cdh6.0.1-590678.el7 cloudera-cdh6 103 M hadoop-client x86_64 3.0.0+cdh6.0.1-590678.el7 cloudera-cdh6 25 k hadoop-hdfs x86_64 3.0.0+cdh6.0.1-590678.el7 cloudera-cdh6 44 M hadoop-mapreduce x86_64 3.0.0+cdh6.0.1-590678.el7 cloudera-cdh6 16 M hadoop-yarn x86_64 3.0.0+cdh6.0.1-590678.el7 cloudera-cdh6 13 M libpcap x86_64 14:1.5.3-11.el7 base 138 k m4 x86_64 1.4.16-10.el7 base 256 k mailx x86_64 12.5-19.el7 base 245 k nmap-ncat x86_64 2:6.40-13.el7 base 205 k parquet noarch 1.9.0+cdh6.0.1-590678.el7 cloudera-cdh6 79 M parquet-format noarch 2.3.1+cdh6.0.1-590678.el7 cloudera-cdh6 616 k patch x86_64 2.7.1-10.el7_5 updates 110 k psmisc x86_64 22.20-15.el7 base 141 k redhat-lsb-core x86_64 4.1-27.el7.centos.1 base 38 k redhat-lsb-submod-security x86_64 4.1-27.el7.centos.1 base 15 k spax x86_64 1.5.2-13.el7 base 260 k time x86_64 1.7-45.el7 base 30 k zookeeper x86_64 3.4.5+cdh6.0.1-590678.el7 cloudera-cdh6 4.0 M Transaction Summary ===================================================================================================== Install 1 Package (+25 Dependent packages) Total download size: 302 M Installed size: 353 M Is this ok [y/d/N]: y Downloading packages: (1/26): at-3.1.13-23.el7.x86_64.rpm | 51 kB 00:00:00 warning: /var/cache/yum/x86_64/7/cloudera-cdh6/packages/bigtop-jsvc-1.0.10+cdh6.0.1-590678.el7.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID 84415700: NOKEY Public key for bigtop-jsvc-1.0.10+cdh6.0.1-590678.el7.x86_64.rpm is not installed (2/26): bigtop-jsvc-1.0.10+cdh6.0.1-590678.el7.x86_64.rpm | 29 kB 00:00:00 (3/26): bigtop-utils-0.7.0+cdh6.0.1-590678.el7.noarch.rpm | 11 kB 00:00:00 (4/26): cups-client-1.6.3-35.el7.x86_64.rpm | 151 kB 00:00:00 (5/26): bc-1.06.95-13.el7.x86_64.rpm | 115 kB 00:00:00 (6/26): ed-1.9-4.el7.x86_64.rpm | 72 kB 00:00:00 (7/26): avro-libs-1.8.2+cdh6.0.1-590678.el7.noarch.rpm | 41 MB 00:00:09 (8/26): hadoop-client-3.0.0+cdh6.0.1-590678.el7.x86_64.rpm | 25 kB 00:00:00 (9/26): hadoop-hdfs-3.0.0+cdh6.0.1-590678.el7.x86_64.rpm | 44 MB 00:00:09 (10/26): hadoop-hdfs-namenode-3.0.0+cdh6.0.1-590678.el7.x86_64.rpm | 6.1 kB 00:00:00 (11/26): hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64.rpm | 103 MB 00:00:20 (12/26): libpcap-1.5.3-11.el7.x86_64.rpm | 138 kB 00:00:00 (13/26): nmap-ncat-6.40-13.el7.x86_64.rpm | 205 kB 00:00:00 (14/26): m4-1.4.16-10.el7.x86_64.rpm | 256 kB 00:00:00 (15/26): mailx-12.5-19.el7.x86_64.rpm | 245 kB 00:00:00 (16/26): hadoop-mapreduce-3.0.0+cdh6.0.1-590678.el7.x86_64.rpm | 16 MB 00:00:03 (17/26): hadoop-yarn-3.0.0+cdh6.0.1-590678.el7.x86_64.rpm | 13 MB 00:00:02 (18/26): parquet-format-2.3.1+cdh6.0.1-590678.el7.noarch.rpm | 616 kB 00:00:00 (19/26): redhat-lsb-core-4.1-27.el7.centos.1.x86_64.rpm | 38 kB 00:00:00 (20/26): patch-2.7.1-10.el7_5.x86_64.rpm | 110 kB 00:00:00 (21/26): redhat-lsb-submod-security-4.1-27.el7.centos.1.x86_64.rpm | 15 kB 00:00:00 (22/26): psmisc-22.20-15.el7.x86_64.rpm | 141 kB 00:00:00 (23/26): spax-1.5.2-13.el7.x86_64.rpm | 260 kB 00:00:00 (24/26): time-1.7-45.el7.x86_64.rpm | 30 kB 00:00:00 (25/26): zookeeper-3.4.5+cdh6.0.1-590678.el7.x86_64.rpm | 4.0 MB 00:00:00 (26/26): parquet-1.9.0+cdh6.0.1-590678.el7.noarch.rpm | 79 MB 00:00:08 Total 9.6 MB/s | 302 MB 00:00:31 Retrieving key from https://archive.cloudera.com/cdh6/6.0.1/redhat7/yum/RPM-GPG-KEY-cloudera Importing GPG key 0x84415700: Userid : "Cloudera " Fingerprint: cecd b80c 4e90 04b0 cfe8 5296 2279 6627 8441 5700 From : https://archive.cloudera.com/cdh6/6.0.1/redhat7/yum/RPM-GPG-KEY-cloudera Is this ok [y/N]: y Running transaction check Running transaction test Transaction test succeeded Running transaction Installing : avro-libs-1.8.2+cdh6.0.1-590678.el7.noarch 1/26 Installing : bigtop-utils-0.7.0+cdh6.0.1-590678.el7.noarch 2/26 Installing : zookeeper-3.4.5+cdh6.0.1-590678.el7.x86_64 3/26 Installing : psmisc-22.20-15.el7.x86_64 4/26 Installing : bigtop-jsvc-1.0.10+cdh6.0.1-590678.el7.x86_64 5/26 Installing : mailx-12.5-19.el7.x86_64 6/26 Installing : ed-1.9-4.el7.x86_64 7/26 Installing : spax-1.5.2-13.el7.x86_64 8/26 Installing : time-1.7-45.el7.x86_64 9/26 Installing : 1:cups-client-1.6.3-35.el7.x86_64 10/26 Installing : 14:libpcap-1.5.3-11.el7.x86_64 11/26 Installing : 2:nmap-ncat-6.40-13.el7.x86_64 12/26 Installing : patch-2.7.1-10.el7_5.x86_64 13/26 Installing : at-3.1.13-23.el7.x86_64 14/26 Installing : bc-1.06.95-13.el7.x86_64 15/26 Installing : m4-1.4.16-10.el7.x86_64 16/26 Installing : redhat-lsb-submod-security-4.1-27.el7.centos.1.x86_64 17/26 Installing : redhat-lsb-core-4.1-27.el7.centos.1.x86_64 18/26 Installing : hadoop-client-3.0.0+cdh6.0.1-590678.el7.x86_64 19/26 Installing : parquet-format-2.3.1+cdh6.0.1-590678.el7.noarch 20/26 Installing : parquet-1.9.0+cdh6.0.1-590678.el7.noarch 21/26 Installing : hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 22/26 Installing : hadoop-yarn-3.0.0+cdh6.0.1-590678.el7.x86_64 23/26 Installing : hadoop-hdfs-3.0.0+cdh6.0.1-590678.el7.x86_64 24/26 Installing : hadoop-mapreduce-3.0.0+cdh6.0.1-590678.el7.x86_64 25/26 Installing : hadoop-hdfs-namenode-3.0.0+cdh6.0.1-590678.el7.x86_64 26/26 Verifying : redhat-lsb-submod-security-4.1-27.el7.centos.1.x86_64 1/26 Verifying : bigtop-utils-0.7.0+cdh6.0.1-590678.el7.noarch 2/26 Verifying : avro-libs-1.8.2+cdh6.0.1-590678.el7.noarch 3/26 Verifying : m4-1.4.16-10.el7.x86_64 4/26 Verifying : hadoop-mapreduce-3.0.0+cdh6.0.1-590678.el7.x86_64 5/26 Verifying : bc-1.06.95-13.el7.x86_64 6/26 Verifying : at-3.1.13-23.el7.x86_64 7/26 Verifying : zookeeper-3.4.5+cdh6.0.1-590678.el7.x86_64 8/26 Verifying : hadoop-yarn-3.0.0+cdh6.0.1-590678.el7.x86_64 9/26 Verifying : parquet-format-2.3.1+cdh6.0.1-590678.el7.noarch 10/26 Verifying : bigtop-jsvc-1.0.10+cdh6.0.1-590678.el7.x86_64 11/26 Verifying : hadoop-client-3.0.0+cdh6.0.1-590678.el7.x86_64 12/26 Verifying : psmisc-22.20-15.el7.x86_64 13/26 Verifying : parquet-1.9.0+cdh6.0.1-590678.el7.noarch 14/26 Verifying : patch-2.7.1-10.el7_5.x86_64 15/26 Verifying : hadoop-hdfs-namenode-3.0.0+cdh6.0.1-590678.el7.x86_64 16/26 Verifying : 14:libpcap-1.5.3-11.el7.x86_64 17/26 Verifying : 1:cups-client-1.6.3-35.el7.x86_64 18/26 Verifying : hadoop-3.0.0+cdh6.0.1-590678.el7.x86_64 19/26 Verifying : hadoop-hdfs-3.0.0+cdh6.0.1-590678.el7.x86_64 20/26 Verifying : time-1.7-45.el7.x86_64 21/26 Verifying : spax-1.5.2-13.el7.x86_64 22/26 Verifying : ed-1.9-4.el7.x86_64 23/26 Verifying : redhat-lsb-core-4.1-27.el7.centos.1.x86_64 24/26 Verifying : mailx-12.5-19.el7.x86_64 25/26 Verifying : 2:nmap-ncat-6.40-13.el7.x86_64 26/26 Installed: hadoop-hdfs-namenode.x86_64 0:3.0.0+cdh6.0.1-590678.el7 Dependency Installed: at.x86_64 0:3.1.13-23.el7 avro-libs.noarch 0:1.8.2+cdh6.0.1-590678.el7 bc.x86_64 0:1.06.95-13.el7 bigtop-jsvc.x86_64 0:1.0.10+cdh6.0.1-590678.el7 bigtop-utils.noarch 0:0.7.0+cdh6.0.1-590678.el7 cups-client.x86_64 1:1.6.3-35.el7 ed.x86_64 0:1.9-4.el7 hadoop.x86_64 0:3.0.0+cdh6.0.1-590678.el7 hadoop-client.x86_64 0:3.0.0+cdh6.0.1-590678.el7 hadoop-hdfs.x86_64 0:3.0.0+cdh6.0.1-590678.el7 hadoop-mapreduce.x86_64 0:3.0.0+cdh6.0.1-590678.el7 hadoop-yarn.x86_64 0:3.0.0+cdh6.0.1-590678.el7 libpcap.x86_64 14:1.5.3-11.el7 m4.x86_64 0:1.4.16-10.el7 mailx.x86_64 0:12.5-19.el7 nmap-ncat.x86_64 2:6.40-13.el7 parquet.noarch 0:1.9.0+cdh6.0.1-590678.el7 parquet-format.noarch 0:2.3.1+cdh6.0.1-590678.el7 patch.x86_64 0:2.7.1-10.el7_5 psmisc.x86_64 0:22.20-15.el7 redhat-lsb-core.x86_64 0:4.1-27.el7.centos.1 redhat-lsb-submod-security.x86_64 0:4.1-27.el7.centos.1 spax.x86_64 0:1.5.2-13.el7 time.x86_64 0:1.7-45.el7 zookeeper.x86_64 0:3.4.5+cdh6.0.1-590678.el7 Complete! [vagrant@masternode ~]$ sudo -u hdfs hdfs namenode -format WARNING: /usr/lib/hadoop/logs does not exist. Creating. mkdir: cannot create directory '/usr/lib/hadoop/logs': Permission denied ERROR: Unable to create /usr/lib/hadoop/logs. Aborting. [vagrant@masternode ~]$ cat /etc/default/hadoop-hdfs-namenode # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. export HADOOP_PID_DIR=/var/run/hadoop-hdfs export HADOOP_LOG_DIR=/var/log/hadoop-hdfs export HADOOP_NAMENODE_USER=hdfs export HADOOP_SECONDARYNAMENODE_USER=hdfs export HADOOP_DATANODE_USER=hdfs export HADOOP_IDENT_STRING=hdfs # We always want to start NFS as root and by setting a default value like the one below we # ensure this happens. Once port registration completes, privileges are dropped back from root # to HADOOP_PRIVILEGED_NFS_USER. export HADOOP_PRIVILEGED_NFS_USER=hdfs export HADOOP_PRIVILEGED_NFS_PID_DIR=/var/run/hadoop-hdfs export HADOOP_PRIVILEGED_NFS_LOG_DIR=/var/log/hadoop-hdfs # export HADOOP_SECURE_DN_USER=hdfs # export HADOOP_SECURE_DN_PID_DIR=/var/run/hadoop-hdfs # export HADOOP_SECURE_DN_LOG_DIR=/var/log/hadoop-hdfs [vagrant@masternode ~]$ sudo -u hdfs HADOOP_LOG_DIR=/var/log/hadoop-hdfs hdfs namenode -format 2018-10-15 10:02:01,293 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = masternode.marvi.xyz/127.0.0.1 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 3.0.0-cdh6.0.1 STARTUP_MSG: classpath = /etc/hadoop/conf:/usr/lib/hadoop/lib/jersey-servlet-1.19.jar:/usr/lib/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/lib/hadoop/lib/httpclient-4.5.3.jar:/usr/lib/hadoop/lib/kerb-core-1.0.0.jar:/usr/lib/hadoop/lib/jackson-core-2.9.5.jar:/usr/lib/hadoop/lib/jetty-security-9.3.20.v20170531.jar:/usr/lib/hadoop/lib/gson-2.2.4.jar:/usr/lib/hadoop/lib/jetty-webapp-9.3.20.v20170531.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/jetty-xml-9.3.20.v20170531.jar:/usr/lib/hadoop/lib/jersey-server-1.19.jar:/usr/lib/hadoop/lib/jetty-io-9.3.20.v20170531.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/json-smart-2.3.jar:/usr/lib/hadoop/lib/jersey-core-1.19.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/lib/jsch-0.1.54.jar:/usr/lib/hadoop/lib/commons-io-2.6.jar:/usr/lib/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/lib/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/kerb-common-1.0.0.jar:/usr/lib/hadoop/lib/log4j-core-2.8.2.jar:/usr/lib/hadoop/lib/kerb-crypto-1.0.0.jar:/usr/lib/hadoop/lib/stax2-api-3.1.4.jar:/usr/lib/hadoop/lib/azure-data-lake-store-sdk-2.2.9.jar:/usr/lib/hadoop/lib/aws-java-sdk-bundle-1.11.271.jar:/usr/lib/hadoop/lib/audience-annotations-0.5.0.jar:/usr/lib/hadoop/lib/kerb-admin-1.0.0.jar:/usr/lib/hadoop/lib/logredactor-2.0.6.jar:/usr/lib/hadoop/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop/lib/log4j-api-2.8.2.jar:/usr/lib/hadoop/lib/netty-3.10.5.Final.jar:/usr/lib/hadoop/lib/re2j-1.1.jar:/usr/lib/hadoop/lib/avro.jar:/usr/lib/hadoop/lib/zookeeper.jar:/usr/lib/hadoop/lib/kerb-server-1.0.0.jar:/usr/lib/hadoop/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/lib/hadoop/lib/slf4j-api-1.7.25.jar:/usr/lib/hadoop/lib/curator-recipes-2.12.0.jar:/usr/lib/hadoop/lib/hamcrest-core-1.3.jar:/usr/lib/hadoop/lib/kerb-util-1.0.0.jar:/usr/lib/hadoop/lib/snappy-java-1.1.4.jar:/usr/lib/hadoop/lib/jackson-databind-2.9.5.jar:/usr/lib/hadoop/lib/kerby-pkix-1.0.0.jar:/usr/lib/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/lib/hadoop/lib/asm-5.0.4.jar:/usr/lib/hadoop/lib/jackson-xc-1.9.13.jar:/usr/lib/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/lib/hadoop/lib/metrics-core-3.0.1.jar:/usr/lib/hadoop/lib/jersey-json-1.19.jar:/usr/lib/hadoop/lib/junit-4.11.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.11.jar:/usr/lib/hadoop/lib/jackson-annotations-2.9.5.jar:/usr/lib/hadoop/lib/jetty-http-9.3.20.v20170531.jar:/usr/lib/hadoop/lib/kerby-config-1.0.0.jar:/usr/lib/hadoop/lib/accessors-smart-1.2.jar:/usr/lib/hadoop/lib/kerby-util-1.0.0.jar:/usr/lib/hadoop/lib/woodstox-core-5.0.3.jar:/usr/lib/hadoop/lib/jetty-server-9.3.20.v20170531.jar:/usr/lib/hadoop/lib/curator-client-2.12.0.jar:/usr/lib/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/lib/hadoop/lib/paranamer-2.8.jar:/usr/lib/hadoop/lib/kerb-client-1.0.0.jar:/usr/lib/hadoop/lib/jetty-servlet-9.3.20.v20170531.jar:/usr/lib/hadoop/lib/jetty-util-9.3.20.v20170531.jar:/usr/lib/hadoop/lib/httpcore-4.4.6.jar:/usr/lib/hadoop/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop/lib/jsr305-3.0.0.jar:/usr/lib/hadoop/lib/kerb-identity-1.0.0.jar:/usr/lib/hadoop/lib/kerby-asn1-1.0.0.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.9.13-cloudera.1.jar:/usr/lib/hadoop/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/commons-lang-2.6.jar:/usr/lib/hadoop/lib/xz-1.6.jar:/usr/lib/hadoop/lib/kerb-simplekdc-1.0.0.jar:/usr/lib/hadoop/lib/commons-lang3-3.7.jar:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop/lib/slf4j-log4j12.jar:/usr/lib/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/lib/hadoop/lib/curator-framework-2.12.0.jar:/usr/lib/hadoop/lib/jsr311-api-1.1.1.jar:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop/lib/kerby-xdr-1.0.0.jar:/usr/lib/hadoop/.//hadoop-common.jar:/usr/lib/hadoop/.//parquet-scala_2.10.jar:/usr/lib/hadoop/.//hadoop-nfs.jar:/usr/lib/hadoop/.//parquet-jackson.jar:/usr/lib/hadoop/.//parquet-thrift.jar:/usr/lib/hadoop/.//parquet-cascading3.jar:/usr/lib/hadoop/.//hadoop-azure-datalake-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop/.//hadoop-azure-datalake.jar:/usr/lib/hadoop/.//parquet-column.jar:/usr/lib/hadoop/.//parquet-pig.jar:/usr/lib/hadoop/.//hadoop-nfs-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop/.//parquet-format-javadoc.jar:/usr/lib/hadoop/.//hadoop-common-tests.jar:/usr/lib/hadoop/.//parquet-format.jar:/usr/lib/hadoop/.//hadoop-common-3.0.0-cdh6.0.1-tests.jar:/usr/lib/hadoop/.//parquet-pig-bundle.jar:/usr/lib/hadoop/.//parquet-format-sources.jar:/usr/lib/hadoop/.//parquet-encoding.jar:/usr/lib/hadoop/.//parquet-hadoop.jar:/usr/lib/hadoop/.//hadoop-kms-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop/.//hadoop-auth-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop/.//parquet-cascading.jar:/usr/lib/hadoop/.//hadoop-common-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop/.//parquet-hadoop-bundle.jar:/usr/lib/hadoop/.//hadoop-annotations.jar:/usr/lib/hadoop/.//hadoop-annotations-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop/.//parquet-generator.jar:/usr/lib/hadoop/.//parquet-protobuf.jar:/usr/lib/hadoop/.//parquet-avro.jar:/usr/lib/hadoop/.//hadoop-aws-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop/.//parquet-common.jar:/usr/lib/hadoop/.//hadoop-aws.jar:/usr/lib/hadoop/.//hadoop-auth.jar:/usr/lib/hadoop/.//hadoop-kms.jar:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/lib/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/lib/hadoop-hdfs/lib/httpclient-4.5.3.jar:/usr/lib/hadoop-hdfs/lib/kerb-core-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-2.9.5.jar:/usr/lib/hadoop-hdfs/lib/jetty-security-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/lib/hadoop-hdfs/lib/jetty-webapp-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/jettison-1.1.jar:/usr/lib/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-hdfs/lib/avro-1.8.2-cdh6.0.1.jar:/usr/lib/hadoop-hdfs/lib/jetty-xml-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/lib/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/lib/hadoop-hdfs/lib/jetty-io-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/lib/hadoop-hdfs/lib/commons-net-3.1.jar:/usr/lib/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.6.jar:/usr/lib/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/lib/hadoop-hdfs/lib/kerb-common-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/kerb-crypto-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/lib/hadoop-hdfs/lib/audience-annotations-0.5.0.jar:/usr/lib/hadoop-hdfs/lib/kerb-admin-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-ajax-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/lib/hadoop-hdfs/lib/re2j-1.1.jar:/usr/lib/hadoop-hdfs/lib/kerb-server-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/lib/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/lib/hadoop-hdfs/lib/kerb-util-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/snappy-java-1.1.4.jar:/usr/lib/hadoop-hdfs/lib/jackson-databind-2.9.5.jar:/usr/lib/hadoop-hdfs/lib/kerby-pkix-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/lib/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/lib/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/lib/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/lib/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/lib/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/lib/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/lib/hadoop-hdfs/lib/jackson-annotations-2.9.5.jar:/usr/lib/hadoop-hdfs/lib/jetty-http-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/kerby-config-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/lib/hadoop-hdfs/lib/kerby-util-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/lib/hadoop-hdfs/lib/jetty-server-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/lib/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/lib/hadoop-hdfs/lib/paranamer-2.8.jar:/usr/lib/hadoop-hdfs/lib/kerb-client-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/jetty-servlet-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-9.3.20.v20170531.jar:/usr/lib/hadoop-hdfs/lib/httpcore-4.4.6.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/lib/hadoop-hdfs/lib/kerb-identity-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/kerby-asn1-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13-cloudera.1.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/lib/hadoop-hdfs/lib/xz-1.6.jar:/usr/lib/hadoop-hdfs/lib/kerb-simplekdc-1.0.0.jar:/usr/lib/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/commons-lang3-3.7.jar:/usr/lib/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh6.0.1.jar:/usr/lib/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/lib/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/lib/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/kerby-xdr-1.0.0.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0-cdh6.0.1-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0-cdh6.0.1-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-3.0.0-cdh6.0.1-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/lib/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-gridmix-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/lib/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/lib/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/lib/hadoop-mapreduce/.//lz4-java-1.4.jar:/usr/lib/hadoop-mapreduce/.//kafka-clients-1.0.1-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/lib/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/lib/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-azure-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/lib/hadoop-mapreduce/.//hadoop-azure.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//jdom-1.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-rumen-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/lib/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives.jar:/usr/lib/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/lib/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/lib/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/lib/hadoop-mapreduce/.//hadoop-sls.jar:/usr/lib/hadoop-mapreduce/.//hadoop-aliyun-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archives-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0-cdh6.0.1-tests.jar:/usr/lib/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/lib/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-openstack-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-sls-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/lib/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-kafka-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-mapreduce/.//hadoop-extras.jar:/usr/lib/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/lib/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/lib/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/lib/hadoop-yarn/lib/guice-4.0.jar:/usr/lib/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-base-2.9.5.jar:/usr/lib/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/lib/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.9.5.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/lib/hadoop-yarn/lib/metrics-core-3.0.1.jar:/usr/lib/hadoop-yarn/lib/fst-2.50.jar:/usr/lib/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.9.5.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-api-3.0.0-cdh6.0.1.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/lib/hadoop-yarn/.//hadoop-yarn-server-router.jar STARTUP_MSG: build = http://github.com/cloudera/hadoop -r 47165556c2149deb60153448d73226104921b1ef; compiled by 'jenkins' on 2018-09-19T16:09Z STARTUP_MSG: java = 1.8.0_181 ************************************************************/ 2018-10-15 10:02:01,317 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT] 2018-10-15 10:02:01,321 INFO namenode.NameNode: createNameNode [-format] Formatting using clusterid: CID-764e9b08-b6df-407c-b21f-59ae16f4f196 2018-10-15 10:02:02,423 INFO namenode.FSEditLog: Edit logging is async:true 2018-10-15 10:02:02,434 INFO namenode.FSNamesystem: KeyProvider: null 2018-10-15 10:02:02,435 INFO namenode.FSNamesystem: fsLock is fair: true 2018-10-15 10:02:02,439 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 2018-10-15 10:02:02,444 INFO namenode.FSNamesystem: fsOwner = hdfs (auth:SIMPLE) 2018-10-15 10:02:02,444 INFO namenode.FSNamesystem: supergroup = supergroup 2018-10-15 10:02:02,444 INFO namenode.FSNamesystem: isPermissionEnabled = true 2018-10-15 10:02:02,444 INFO namenode.FSNamesystem: HA Enabled: false 2018-10-15 10:02:02,485 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2018-10-15 10:02:02,499 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000 2018-10-15 10:02:02,499 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 2018-10-15 10:02:02,503 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 2018-10-15 10:02:02,503 INFO blockmanagement.BlockManager: The block deletion will start around 2018 Oct 15 10:02:02 2018-10-15 10:02:02,504 INFO util.GSet: Computing capacity for map BlocksMap 2018-10-15 10:02:02,504 INFO util.GSet: VM type = 64-bit 2018-10-15 10:02:02,505 INFO util.GSet: 2.0% max memory 916.4 MB = 18.3 MB 2018-10-15 10:02:02,505 INFO util.GSet: capacity = 2^21 = 2097152 entries 2018-10-15 10:02:02,532 INFO blockmanagement.BlockManager: dfs.block.access.token.enable = false 2018-10-15 10:02:02,536 INFO Configuration.deprecation: No unit for dfs.namenode.safemode.extension(30000) assuming MILLISECONDS 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.9990000128746033 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 30000 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManager: defaultReplication = 3 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManager: maxReplication = 512 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManager: minReplication = 1 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManager: redundancyRecheckInterval = 3000ms 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManager: encryptDataTransfer = false 2018-10-15 10:02:02,536 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 2018-10-15 10:02:02,609 INFO util.GSet: Computing capacity for map INodeMap 2018-10-15 10:02:02,609 INFO util.GSet: VM type = 64-bit 2018-10-15 10:02:02,609 INFO util.GSet: 1.0% max memory 916.4 MB = 9.2 MB 2018-10-15 10:02:02,609 INFO util.GSet: capacity = 2^20 = 1048576 entries 2018-10-15 10:02:02,610 INFO namenode.FSDirectory: ACLs enabled? false 2018-10-15 10:02:02,610 INFO namenode.FSDirectory: POSIX ACL inheritance enabled? true 2018-10-15 10:02:02,610 INFO namenode.FSDirectory: XAttrs enabled? true 2018-10-15 10:02:02,610 INFO namenode.NameNode: Caching file names occurring more than 10 times 2018-10-15 10:02:02,615 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: true, skipCaptureAccessTimeOnlyChange: false, snapshotDiffAllowSnapRootDescendant: true 2018-10-15 10:02:02,627 INFO util.GSet: Computing capacity for map cachedBlocks 2018-10-15 10:02:02,627 INFO util.GSet: VM type = 64-bit 2018-10-15 10:02:02,627 INFO util.GSet: 0.25% max memory 916.4 MB = 2.3 MB 2018-10-15 10:02:02,627 INFO util.GSet: capacity = 2^18 = 262144 entries 2018-10-15 10:02:02,640 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 2018-10-15 10:02:02,640 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 2018-10-15 10:02:02,640 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2018-10-15 10:02:02,644 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 2018-10-15 10:02:02,644 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2018-10-15 10:02:02,645 INFO util.GSet: Computing capacity for map NameNodeRetryCache 2018-10-15 10:02:02,646 INFO util.GSet: VM type = 64-bit 2018-10-15 10:02:02,646 INFO util.GSet: 0.029999999329447746% max memory 916.4 MB = 281.5 KB 2018-10-15 10:02:02,646 INFO util.GSet: capacity = 2^15 = 32768 entries 2018-10-15 10:02:02,698 INFO namenode.FSImage: Allocated new BlockPoolId: BP-2115801660-127.0.0.1-1539597722673 2018-10-15 10:02:02,721 INFO common.Storage: Storage directory /var/lib/hadoop-hdfs/cache/hdfs/dfs/name has been successfully formatted. 2018-10-15 10:02:02,730 INFO namenode.FSImageFormatProtobuf: Saving image file /var/lib/hadoop-hdfs/cache/hdfs/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression 2018-10-15 10:02:02,835 INFO namenode.FSImageFormatProtobuf: Image file /var/lib/hadoop-hdfs/cache/hdfs/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 389 bytes saved in 0 seconds . 2018-10-15 10:02:02,846 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0 2018-10-15 10:02:02,864 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at masternode.marvi.xyz/127.0.0.1 ************************************************************/