Details
Description
The current import MR framework retrieves each record from the database and then writes its results to HDFS synchronously. We should use a producer/consumer queue in the OutputFormat so that round-trips to the db in RecordReader.next() are overlapped with preceding HDFS writes. (Similar to how ExportOutputFormat works.)