Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-11450

[Python] pyarrow<3 incompatible with numpy>=1.20.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • 3.0.0
    • None
    • None
    • python>=3.7
      Debian 5.7 x86_64

    Description

      pyarrow 1.0 and 2.0 is not compatible with numpy 1.20.0

      Running the following command would fail:

      pa.array(np.arange(10))

      with error

      pyarrow.lib.ArrowTypeError: Did not pass numpy.dtype object

      Numpy release note [link] mentions about the np.dtype related compatibility breaks. Also there is a C API change, which implies numpy dependency constraints should be tighter (whether <=1.20 or >1.20) depending on the compiled numpy version (if pyarrow is depending on it; I'm not aware of the pyarrow internal).

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. ARROW-10833 [Python] Avoid usage of NumPy's PyArray_DescrCheck macro

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. ARROW-11487 [Python] Can't create array from Categorical with numpy 1.20

          • Major - Major loss of function.
          • Closed
          supercedes

          Bug - A problem which impairs or prevents the functions of the product. ARROW-11458 PyArrow 1.x and 2.x do not work with numpy 1.20

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              Park Jongbin Park
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: