Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15206

Add a validation functionality to hiveSchemaTool

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.2.0
    • None
    • Metastore
    • None

    Description

      We have seen issues that the metastore get corrupted and cause the whole hiveserver not running.

      Add the support to detect such corruption to hiveSchemaTool. Fixing the issue automatically could be risky, so may still defer to the admin.

      Attachments

        1.
        		 Schematool should detect malformed URIs Sub-task Resolved Yongzhi Chen
        2.
        		 Schematool should recognize missing tables in metastore Sub-task Resolved Naveen Gangam
        3.
        		 Schematool provides a way to detect invalid entries in VERSION table Sub-task Resolved Chaoyu Tang
        4.
        		 Remove unused 'COLUMNS' table from derby schema Sub-task Patch Available Aihua Xu
        5.
        		 Keep Schema in consistent state where schemaTool fails or succeeds. Sub-task Resolved Unassigned
        6.
        		 Implement a capability to detect incorrect sequence numbers Sub-task Resolved Aihua Xu
        7.
        		 Detect the values for incorrect NULL values Sub-task Resolved Aihua Xu
        8.
        		 Refactoring the validate function of HiveSchemaTool to make the output consistent Sub-task Resolved Aihua Xu
        9.
        		 Location validation for table should ignore the values for view. Sub-task Resolved Yongzhi Chen
        10.
        		 Eliminate conflicting output from schematool's table validator. Sub-task Resolved Naveen Gangam
        11.
        		 Change SchemaTool table validator to test based on the dbType Sub-task Resolved Naveen Gangam
        12.
        		 Some minor improvement on the validation tool Sub-task Resolved Aihua Xu
        13.
        		 SchemaTool should exit with non-zero exit code when one or more validator's fail. Sub-task Resolved Naveen Gangam
        14.
        		 Improve the validation output to make the output to stderr and stdout more consistent Sub-task Closed Aihua Xu
        15.
        		 Check if the console message from the hive schema tool needs to print to logging file Sub-task Open Unassigned
        16.
        		 Schema table validator should return a sorted list of missing tables Sub-task Closed Naveen Gangam
        17.
        		 Improve location validator to check for blank paths. Sub-task Closed Naveen Gangam
        18.
        		 Improve table validator's performance against Oracle Sub-task Closed Naveen Gangam
        19.
        		 Change the sort key for the schema tool validator to be <ID> Sub-task Closed Naveen Gangam

        Activity

          People

            aihuaxu Aihua Xu
            aihuaxu Aihua Xu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: