Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13970 RunInference V1
  3. BEAM-14218

Add resource location hints to base RunInference Implementation

Details

    • Sub-task
    • Status: Open
    • P2
    • Resolution: Unresolved
    • None
    • None
    • sdk-py-core
    • None

    Description

      Our generic version of RunInference should add resource location hints, similar to what TFX-BSL does here.

       

      https://github.com/tensorflow/tfx-bsl/blob/182918aaefd5287e7669d87bfc818155470315aa/tfx_bsl/beam/run_inference.py#L117

       

      There's no reason that these hints shouldn't be just as relevant to sk-learn or pytorch large models hosted on GC or wherever these hints are supported.

      Attachments

        Issue Links

          Activity

            People

              Ryan.Thompson Ryan Thompson
              Ryan.Thompson Ryan Thompson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 20m
                  2h 20m