Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-35097

Table API Filesystem connector with 'raw' format repeats last line

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.17.1
    • 1.18.2, 1.20.0, 1.19.1
    • I ran the above test with 1.17.1. I checked for existing bug tickets and release notes, but did not find anything, so assuming this effects 1.18 and 1.19.

    Description

      When using the Filesystem connector with 'raw' format to read text data that contains new lines, a row is returned for every line, but always contains the contents of the last line.

      For example, with the following file.

      line 1
      line 2
      line 3

      And table definition

      create TABLE MyRawTable (
      `doc` string,
      ) WITH (
      'path' = 'file:///path/to/data',
      'format' = 'raw',
      'connector' = 'filesystem'
      );

      Selecting `*` from the table produces three rows all with "line 3" for `doc`.

      Attachments

        Issue Links

          Activity

            People

              mallikarjuna Kumar Mallikarjuna
              david.perkins David Perkins
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: