Uploaded image for project: 'Flume (READ-ONLY)'
  1. Flume (READ-ONLY)
  2. FLUME-126

Sample Code Conribution: Flume HBase Statistics Sink

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Here is some sample source code I wrote at this month's hackathon - the HBaseIncrementerSink listens for Twitter feeds and for each bigram in such a feed, it updates a compound HBase key date/bigram, it also updates a summary count of events by date. The HBaseStatsServer provides a simple server that lets a webapp query the resulting HBase information, returning JSON data for the event counts and bigram counts for all time (it could be expanded to accept a time range query). This worked with a version of Flume that included Pat Hunt's inclusion of HBase suppport.

      This could be a start on other more general/other Flume sink support for HBase.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                rbodkin Ron Bodkin
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: