Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-468

CDH 4.2.0 includes avro-1.7.3 which can cause problems (AVRO-1240) when reading specific avro records from Tool implementations

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: CDH4.2.0
          • Fix Version/s: CDH4.7.0
          • Component/s: Hadoop Common
          • Labels:
            None

            Description

            There is AVRO-1240 (https://issues.apache.org/jira/browse/AVRO-1240) that describes some classloading issues. Namely, if you read avro records using Reflect or Specific datum readers from Tool implementations, then you will get an exception (see AVRO-1240). Avro 1.7.4 fixes it, so it would be nice if CDH included it.
            As a workaround, before running your job do:

             
export HADOOP_USER_CLASSPATH_FIRST=true
export HADOOP_CLASSPATH=/path/to/avro-1.7.4.jar

              Attachments

                Activity

                  People

                  • Assignee:
                    Unassigned
                    Reporter:
                    detonator413 Vyacheslav Zholudev
                  • Votes:
                    1 Vote for this issue
                    Watchers:
                    4 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: