Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-47801

Use simdjson-java in JSON related UDFs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.5.2
    • None
    • Spark Core
    • None

    Description

      JSON parsing speed is important.

      Right now, functions like GET_JSON_OBJECT, FROM_JSON are slow because they don't use https://github.com/simdjson/simdjson-java

       

      We should consider adopting https://github.com/simdjson/simdjson-java for those UDFs.

      Attachments

        Activity

          People

            Unassigned Unassigned
            zshao Zheng Shao
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: