Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-13498

[C++] ScanNode takes filter but doesn't filter

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • C++

    Description

      This turned out to be my confusion in ARROW-13344: because the ScanNode takes a filter and projection, I wasn't creating a FilterNode because I assume that the filter is already applied--why else would I provide a filter to the ScanNode? But it turns out that if you don't Filter again, you get unfiltered results:

      Table$create(
  group=c(1, 2), 
  value=c(5, 6)
) %>% 
  filter(value > 5) %>% 
  group_by(group) %>% 
  summarize(sum(value)) %>% 
  collect()

# A tibble: 2 x 2
  group `sum(value)`
  <dbl>        <dbl>
1     1            5
2     2            6

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. ARROW-14642 [C++] ScanNode is not using the filter expression

          • Major - Major loss of function.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. ARROW-13344 [R] Initial bindings for ExecPlan/ExecNode

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              npr Neal Richardson
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: