Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31013

InMemoryStore: improve removeAllByIndexValues over natural key index

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • Spark Core, Web UI
    • None

    Description

      The method `removeAllByIndexValues` in KVStore is to delete all the objects which have certain values in the given index.
      However, in the current implementation of `InMemoryStore`, when the given index is the natural key index, there is no special handling for it and a linear search over all the task data is performed.

      We can improve it by deleting the natural keys directly from the internal hashmap.

      Attachments

        Activity

          People

            Gengliang.Wang Gengliang Wang
            Gengliang.Wang Gengliang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: