SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/mnt/yarn/usercache/hadoop/filecache/2159/__spark_libs__3027229192936044972.zip/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 17/02/28 10:48:03 INFO CoarseGrainedExecutorBackend: Started daemon with process name: 30618@ip-10-200-139-13 17/02/28 10:48:03 INFO SignalUtils: Registered signal handler for TERM 17/02/28 10:48:03 INFO SignalUtils: Registered signal handler for HUP 17/02/28 10:48:03 INFO SignalUtils: Registered signal handler for INT 17/02/28 10:48:04 INFO SecurityManager: Changing view acls to: yarn,hadoop 17/02/28 10:48:04 INFO SecurityManager: Changing modify acls to: yarn,hadoop 17/02/28 10:48:04 INFO SecurityManager: Changing view acls groups to: 17/02/28 10:48:04 INFO SecurityManager: Changing modify acls groups to: 17/02/28 10:48:04 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, hadoop); groups with view permissions: Set(); users with modify permissions: Set(yarn, hadoop); groups with modify permissions: Set() 17/02/28 10:48:05 INFO TransportClientFactory: Successfully created connection to /10.200.139.129:41666 after 82 ms (0 ms spent in bootstraps) 17/02/28 10:48:05 INFO SecurityManager: Changing view acls to: yarn,hadoop 17/02/28 10:48:05 INFO SecurityManager: Changing modify acls to: yarn,hadoop 17/02/28 10:48:05 INFO SecurityManager: Changing view acls groups to: 17/02/28 10:48:05 INFO SecurityManager: Changing modify acls groups to: 17/02/28 10:48:05 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, hadoop); groups with view permissions: Set(); users with modify permissions: Set(yarn, hadoop); groups with modify permissions: Set() 17/02/28 10:48:05 INFO TransportClientFactory: Successfully created connection to /10.200.139.129:41666 after 1 ms (0 ms spent in bootstraps) 17/02/28 10:48:05 INFO DiskBlockManager: Created local directory at /mnt/yarn/usercache/hadoop/appcache/application_1482343367445_0211/blockmgr-8c6d7f71-c11b-450c-9c46-a3239c9f69a4 17/02/28 10:48:05 INFO DiskBlockManager: Created local directory at /mnt1/yarn/usercache/hadoop/appcache/application_1482343367445_0211/blockmgr-692686b3-b368-4837-bacf-39e9b235162c 17/02/28 10:48:05 INFO MemoryStore: MemoryStore started with capacity 2.8 GB 17/02/28 10:48:05 INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@10.200.139.129:41666 17/02/28 10:48:05 INFO CoarseGrainedExecutorBackend: Successfully registered with driver 17/02/28 10:48:05 INFO Executor: Starting executor ID 1 on host ip-10-200-139-13.ec2.internal 17/02/28 10:48:05 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 40663. 17/02/28 10:48:05 INFO NettyBlockTransferService: Server created on ip-10-200-139-13.ec2.internal:40663 17/02/28 10:48:05 INFO BlockManager: external shuffle service port = 7337 17/02/28 10:48:05 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(1, ip-10-200-139-13.ec2.internal, 40663) 17/02/28 10:48:05 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(1, ip-10-200-139-13.ec2.internal, 40663) 17/02/28 10:48:05 INFO BlockManager: Registering executor with local external shuffle service. 17/02/28 10:48:05 INFO TransportClientFactory: Successfully created connection to ip-10-200-139-13.ec2.internal/10.200.139.13:7337 after 1 ms (0 ms spent in bootstraps) 17/02/28 10:48:05 INFO Executor: Using REPL class URI: spark://10.200.139.129:41666/classes 17/02/28 10:48:05 INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 17/02/28 10:48:05 INFO MemoryStore: MemoryStore cleared 17/02/28 10:48:05 INFO BlockManager: BlockManager stopped 17/02/28 10:48:05 INFO ShutdownHookManager: Shutdown hook called