Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9439

Make --scale a mandatory option in single_node_perf_run.py

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 3.4.0
    • None
    • None
    • ghx-label-8

    Description

      Running bin/single_node_perf_run.py with --table_formats kudu currently fails with the following error:

      Traceback (most recent call last):
        File "./bin/run-workload.py", line 257, in <module>
          workload_runners.append(WorkloadRunner(workload, scale_factor, config))
        File "./tests/performance/workload_runner.py", line 71, in __init__
          self._generate_test_vectors()
        File "./tests/performance/workload_runner.py", line 88, in _generate_test_vectors
          self._test_vectors.append(TableFormatInfo.create_from_string(dataset, tf))
        File "./tests/common/test_dimensions.py", line 70, in create_from_string
          raise ValueError, 'Invalid table format %s' % table_format_string
      ValueError: Invalid table format kudu 
      Traceback (most recent call last):
        File "./bin/single_node_perf_run.py", line 348, in <module>
          main()
        File "./bin/single_node_perf_run.py", line 338, in main
          perf_ab_test(options, args)
        File "./bin/single_node_perf_run.py", line 230, in perf_ab_test
          build(hash_a, options)
        File "./bin/single_node_perf_run.py", line 111, in build
          configured_call(buildall)
        File "./bin/single_node_perf_run.py", line 87, in configured_call
          return subprocess.check_call(["bash", "-c", cmd])
        File "/usr/lib/python2.7/subprocess.py", line 541, in check_call
          raise CalledProcessError(retcode, cmd)
      subprocess.CalledProcessError: Command '['bash', '-c', 'source ./bin/impala-config.sh && ./buildall.sh -notests -release -noclean']' returned non-zero exit status 2

      kudu/none and kudu/none/none fail as well with this error:

      AnalysisException: Database does not exist: tpchNone_kudu 

      I think there is some handling of compression types / codecs that aren't applicable for Kudu, which are preventing this from working properly.

      Attachments

        Activity

          People

            stakiar Sahil Takiar
            stakiar Sahil Takiar
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: