Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-39452

Extend EdgePartition1D with Destination based Strategy

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: In Progress
    • Minor
    • Resolution: Unresolved
    • 3.4.0
    • None
    • GraphX

    Description

      Currently, the EdgePartition1D  use only the source vertex ID.

      If doing topological like algorithm on graph, directly partition based on destination vertex ID would improve the performance significantly.

      The proposal here is either adding a new case object like EdgePartition1DDst or update the EdgePartition1D such that user can configure the src or dst directly.

      Attachments

        Activity

          People

            Unassigned Unassigned
            psun520 PEIYUAN SUN
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 12h
                12h
                Remaining:
                Remaining Estimate - 12h
                12h
                Logged:
                Time Spent - Not Specified
                Not Specified