Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-2829

Fused read to compressed

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • Not Applicable
    • None

    Description

      This task is to while reading in a matrix, trying to compress it.

      This would have to overwrite the read command and change it into a fused read-compress command.

      (Easier) One approach is to construct bit maps of the individual columns as they are read from file directly. Then after these bitmaps are constructed decide to join columns together.

      (Harder but probably better) Another is to use the first couple of blocks read to decide on a co coding scheme, and then directly put the read matrix into the compressed state.

      Attachments

        Activity

          People

            Unassigned Unassigned
            baunsgaard Sebastian Baunsgaard
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: