Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-8135

[Python] Problem importing PyArrow on a cluster

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.16.0
    • 0.16.0
    • C++
    • Linux, RedHat CentOS 7

    Description

      Hi, when I am trying to import pyarrow in python, I get the following error:

      File "<stdin>", line 1, in <module>
      File "/services/matejm/anaconda3/lib/python3.7/site-packages/pyarrow/_init_.py", line 49, in <module>
      from pyarrow.lib import cpu_count, set_cpu_count
      ImportError: libaws-cpp-sdk-s3.so: cannot open shared object file: No such file or directory
      What can this be related to? I have searched wherever i could've and could not find any reason for it, so I figured i might as well try in here.

      Thank you very much

      Note: I have installed py-arrow and its dependencies off-line, since our cluster has a company firewall that does not allow pip nor conda installation

      Attachments

        Activity

          People

            Unassigned Unassigned
            gorcurek Matej Murin
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: