Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-696

HDFS - file size and date not changing for ls on append and hsync

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Bug
    • Affects Version/s: CDH 5.3.0
    • Fix Version/s: None
    • Component/s: HDFS
    • Labels:
    • Environment:
      Linux 2.6.32-431.29.2.el6.x86_64

      Description

      There seems to be an issue with Hadoop append and using hsync. The file data is updated but the ls file stats are not being updated. Attached is a small java program to illustrate the issue. Also attached is the input and output of running the program.

      The expected output is the file size and date updated should be updated after a hsync when a ls is done.

      Note that this in turn causes the map part of a mapreduce jobs not to read any appended data because the file length does not change.

        Attachments

        1. AppendWrite.java
          1 kB
          Michael Smith
        2. run_output.txt
          0.6 kB
          Michael Smith

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              michaels Michael Smith
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: