Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1330

hive JDBC SqlCompleter takes very long time to load column/schema meta info when hive has a lot of tables

    XMLWordPrintableJSON

Details

    Description

      When use %hive, it takes very long time(at least 3 mins) to connect to HS2. As check HS2 log, we see it loads a lot of hive schema/column meta which takes long time to complete as in SqlCompleter code as follows:

      public static Set<String> getDataModelMetadataCompletions(Connection connection)
      throws SQLException {
      Set<String> completions = new TreeSet<>();
      if (null != connection)

      { getColumnNames(connection.getMetaData(), completions); getSchemaNames(connection.getMetaData(), completions); }

      return completions;
      }

      This class seems to be for web auto-completion. However, I don't see this feature in web instead BTW.

      Attachments

        1. shortcut.png
          48 kB
          Minwoo Kang

        Issue Links

          Activity

            People

              Unassigned Unassigned
              qiuzhuang.lian Qiuzhuang Lian
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: