Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-7826

Support to unload FST's .tip into memory,make load or unload configuable!.

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • core/FSTs, core/store
    • None
    • New

    Description

      in real case,we use lucene index many documents. But some machine have not much memory.,once documents reach up to tens of billion,lucene can not start because of no enough memory. Most of the memry cost is FST;s .tip content.
      So I want to pull my change on lucene core to make load FST's .tip into memory become configurable!
      What do you think?

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. LUCENE-8635 Lazy loading Lucene FST offheap using mmap

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-7834 BlockTree's terms index should be loaded into memory lazily

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              Xibao Xibao
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified