When using taildir in a single node configuration records are being lost

When using tailDir to ingest file using flumes we're seeing large numbers of records go missing from the beginning of the file. If we use the text source at the same file all records ingest successfully. The workflow we're using is very simple, one node is used per source and sink. The node reads the data using tailDir and writes out using escapedCustomDfs.