Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16713

Use PathCapabilities for default configuring append mode for RollingFileSystemSink

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.0
    • None
    • metrics
    • None

    Description

      RollingFileSystemSink uses a filesystem to store metrics. The key allow-append is disabled by default, but if enabled, new metrics can be appended to an existing file.

      Given that we can have the PathCapabilities interface, we can change the default of allow-append mode depending on the support of the append operation decided by the FileSystem.hasPathCapability() call

      Attachments

        Activity

          People

            Unassigned Unassigned
            adam.antal Adam Antal
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: