Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-623

Job Failed : java.lang.NullPointerException

          Details

          • Type: Bug
          • Status: Closed
          • Priority: Major
          • Resolution: Not A Bug
          • Affects Version/s: CDH 5.0.2
          • Fix Version/s: None
          • Component/s: Hadoop Common
          • Environment:
            CentOS, Eclipse Juno
          • Release Note:
            Hide

            Input:
            2012-01-01 09:00 San Jose Men's Clothing 214.05 Amex
            2012-01-01 09:00 Fort Worth Women's Clothing 153.57 Visa
            2012-01-01 09:00 San Diego Music 66.08 Cash
            2012-01-01 09:00 Pittsburgh Pet Supplies 493.51 Discover
            2012-01-01 09:00 Omaha Children's Clothing 235.63 MasterCard
            2012-01-01 09:00 Stockton Men's Clothing 247.18 MasterCard
            2012-01-01 09:00 Austin Cameras 379.6 Visa
            2012-01-01 09:00 New York Consumer Electronics 296.8 Cash
            2012-01-01 09:00 Corpus Christi Toys 25.38 Discover

            Error:

            SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
            SLF4J: Defaulting to no-operation (NOP) logger implementation
            SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
            14/08/02 16:25:32 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
            14/08/02 16:25:32 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
            14/08/02 16:25:32 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
            14/08/02 16:25:32 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
            14/08/02 16:25:32 INFO input.FileInputFormat: Total input paths to process : 1
            14/08/02 16:25:33 INFO mapred.LocalJobRunner: OutputCommitter set in config null
            14/08/02 16:25:33 INFO mapred.JobClient: Running job: job_local1383032901_0001
            14/08/02 16:25:33 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
            14/08/02 16:25:33 INFO mapred.LocalJobRunner: Waiting for map tasks
            14/08/02 16:25:33 INFO mapred.LocalJobRunner: Starting task: attempt_local1383032901_0001_m_000000_0
            14/08/02 16:25:33 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
            14/08/02 16:25:33 INFO util.ProcessTree: setsid exited with exit code 0
            14/08/02 16:25:33 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7a628653
            14/08/02 16:25:33 INFO mapred.MapTask: Processing split: file:/home/cloudera/workspace/AnalyticStore_6/purchases_min.txt:0+10515
            14/08/02 16:25:33 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
            14/08/02 16:25:33 INFO mapred.MapTask: io.sort.mb = 100
            14/08/02 16:25:33 INFO mapred.MapTask: data buffer = 79691776/99614720
            14/08/02 16:25:33 INFO mapred.MapTask: record buffer = 262144/327680
            14/08/02 16:25:33 INFO mapred.LocalJobRunner: Map task executor complete.
            14/08/02 16:25:33 WARN mapred.LocalJobRunner: job_local1383032901_0001
            java.lang.Exception: java.lang.NullPointerException
                at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:406)
            Caused by: java.lang.NullPointerException
                at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:843)
                at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:376)
                at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:85)
                at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:584)
                at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:656)
                at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
                at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:268)
                at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
                at java.util.concurrent.FutureTask.run(FutureTask.java:262)
                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
                at java.lang.Thread.run(Thread.java:744)
            14/08/02 16:25:34 INFO mapred.JobClient: map 0% reduce 0%
            14/08/02 16:25:34 INFO mapred.JobClient: Job complete: job_local1383032901_0001
            14/08/02 16:25:34 INFO mapred.JobClient: Counters: 0
            false
            Show
            Input: 2012-01-01 09:00 San Jose Men's Clothing 214.05 Amex 2012-01-01 09:00 Fort Worth Women's Clothing 153.57 Visa 2012-01-01 09:00 San Diego Music 66.08 Cash 2012-01-01 09:00 Pittsburgh Pet Supplies 493.51 Discover 2012-01-01 09:00 Omaha Children's Clothing 235.63 MasterCard 2012-01-01 09:00 Stockton Men's Clothing 247.18 MasterCard 2012-01-01 09:00 Austin Cameras 379.6 Visa 2012-01-01 09:00 New York Consumer Electronics 296.8 Cash 2012-01-01 09:00 Corpus Christi Toys 25.38 Discover Error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. 14/08/02 16:25:32 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/08/02 16:25:32 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 14/08/02 16:25:32 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 14/08/02 16:25:32 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 14/08/02 16:25:32 INFO input.FileInputFormat: Total input paths to process : 1 14/08/02 16:25:33 INFO mapred.LocalJobRunner: OutputCommitter set in config null 14/08/02 16:25:33 INFO mapred.JobClient: Running job: job_local1383032901_0001 14/08/02 16:25:33 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 14/08/02 16:25:33 INFO mapred.LocalJobRunner: Waiting for map tasks 14/08/02 16:25:33 INFO mapred.LocalJobRunner: Starting task: attempt_local1383032901_0001_m_000000_0 14/08/02 16:25:33 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead 14/08/02 16:25:33 INFO util.ProcessTree: setsid exited with exit code 0 14/08/02 16:25:33 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7a628653 14/08/02 16:25:33 INFO mapred.MapTask: Processing split: file:/home/cloudera/workspace/AnalyticStore_6/purchases_min.txt:0+10515 14/08/02 16:25:33 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer 14/08/02 16:25:33 INFO mapred.MapTask: io.sort.mb = 100 14/08/02 16:25:33 INFO mapred.MapTask: data buffer = 79691776/99614720 14/08/02 16:25:33 INFO mapred.MapTask: record buffer = 262144/327680 14/08/02 16:25:33 INFO mapred.LocalJobRunner: Map task executor complete. 14/08/02 16:25:33 WARN mapred.LocalJobRunner: job_local1383032901_0001 java.lang.Exception: java.lang.NullPointerException     at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:406) Caused by: java.lang.NullPointerException     at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:843)     at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:376)     at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:85)     at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:584)     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:656)     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)     at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:268)     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)     at java.util.concurrent.FutureTask.run(FutureTask.java:262)     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)     at java.lang.Thread.run(Thread.java:744) 14/08/02 16:25:34 INFO mapred.JobClient: map 0% reduce 0% 14/08/02 16:25:34 INFO mapred.JobClient: Job complete: job_local1383032901_0001 14/08/02 16:25:34 INFO mapred.JobClient: Counters: 0 false

            Description

            Wanted to print the output with StoreName and total purchases in that stored encountered NullPointerError

            14/08/02 16:25:33 WARN mapred.LocalJobRunner: job_local1383032901_0001
            java.lang.Exception: java.lang.NullPointerException
            at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:406)
            Caused by: java.lang.NullPointerException

            I have attached the source files and the input is under resource

              Attachments

                Activity

                  People

                  • Assignee:
                    Unassigned
                    Reporter:
                    kexcaliber Shashank K
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    2 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: