Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: sdk-py-core
    • Labels:
      None

      Description

      I have been trying to use google datalab with python3. As I see there are several packages that does not support python3 yet which google datalab depends on. This is one of them.

      https://github.com/GoogleCloudPlatform/DataflowPythonSDK/issues/6

        Attachments

          Issue Links

          1.
          Support Python native types in Beam typehints Sub-task Open Ahmet Altay

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          2.
          Add an SDK harness container with Python 3 interpreter for portable pipelines. Sub-task In Progress Valentyn Tymofieiev

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          3.
          Exercise Python 3 SDK harness container in ValidatesContainer Jenkins test suite. Sub-task Open Unassigned  
          4.
          Finish Python 3 porting for examples module Sub-task In Progress Robbe

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          5.
          Finish Python 3 porting for io module Sub-task In Progress Robbe

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 13h 10m
          6.
          Finish Python 3 porting for typehints module Sub-task In Progress Simon

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          7.
          Add tox suites to exercise unit tests using Python3 interpreter with cython, and with gcp dependencies. Sub-task Open Mark Liu  
          8.
          Several tests fail on Python 3 with TypeError: 'cmp' is an invalid keyword argument for this function Sub-task Reopened Unassigned

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3.5h
          9.
          Side inputs don't work on Python 3 Sub-task In Progress Robert Bradshaw

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          10.
          Several tests fail on Python 3 with: Runtime type violation detected Sub-task Open Unassigned  
          11.
          Several IO tests fail in Python 3 when accessing a temporary file with TypeError: a bytes-like object is required, not 'str' Sub-task In Progress Robbe

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 20m
          12.
          Several VcfIO tests fail in Python 3 with TypeError: cannot use a string pattern on a bytes-like object Sub-task Open Simon  
          13.
          Typing library no longer provisional in Python 3.7 Sub-task Open Manu Zhang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          14.
          Add tox suites for various Python 3 versions (3.5, 3.6, 3.7) Sub-task Open Mark Liu  
          15.
          Disable compare parameter in Top.Of() combiner when executing in Python 3. Sub-task Open Valentyn Tymofieiev  
          16.
          Using methods in map is broken on Python 3 Sub-task Open Unassigned  
          17.
          Validates runner tests fail with: Cannot convert bytes value to JSON value Sub-task Open Mark Liu  
          18.
          Support DoFns with Keyword-only arguments in Python 3. Sub-task Open Unassigned

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          19.
          Support DataflowRunner on Python 3 Sub-task Open Mark Liu

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 50m
          20.
          Gradle setupVirtualenv supports Python 3 Sub-task Open Mark Liu

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          21.
          Revert dill pip install from github commit Sub-task Open Ahmet Altay  
          22.
          Gcsio batch delete broken in Python 3 Sub-task Open Mark Liu  
          23.
          Worker failed with save_main_session enabled on Dataflow in Python 3 Sub-task Open Robert Bradshaw  
          24.
          apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest.test_multimap_side_input fails in Python 3.6 Sub-task Open Unassigned  
          25.
          TypeError in DataflowRunner: dict_values does not support indexing Sub-task Open Mark Liu

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m

            Activity

              People

              • Assignee:
                RobbeSneyders Robbe
                Reporter:
                eyad.alsibai@gmail.com Eyad Sibai
              • Votes:
                34 Vote for this issue
                Watchers:
                50 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 123.5h
                  123.5h