Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3223

Total table size quota management for every user

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.15.0
    • None
    • None

    Description

      Requirement description

      In production environment, the quota management for total tables size and single table size of a single user is necessary. If the quota is reached, the write operation including insert and update is forbidden, only table creation, scan and delete are allowed. 

      We need to allow admin to configure the quota for every user, monitor the quota status, and stop the write operation with an error returned to client.

      So, I hope Kudu cli can list the status. Currently, the kudu table statistics only gives the disk size and live row count. It is better improve this by adding user name for table statistics, or create a new parameter to query every table size for every user, and disable/enable a user's write privilege. Can this be configured through Apache Ranger?

      Typical scenarios

      1. Some user has malicious operation to create a huge table, or many small tables, as a result, the total table size exceeds the cluster's capacity, we have to stop him in time. 
      2. When writing Kudu table through Flink, the streaming process is always running, which means the Kudu table writing never stopped. If we do not have a protection, the Kudu cluster will be exhausted someday. 

      Attachments

        Activity

          People

            Unassigned Unassigned
            redriver Redriver
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: