Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8364

Erasure coding: fix some minor bugs in EC CLI

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      issue 1: it's not user-friendly. We should tell user that `hdfs erasurecode` is the entrance to EC commands(HDFS-7349)

       # bin/hdfs
      Usage: hdfs [--config confdir] [--daemon (start|stop|status)]
                 [--loglevel loglevel] COMMAND
             where COMMAND is one of:
        balancer             run a cluster balancing utility
        cacheadmin           configure the HDFS cache
        crypto               configure HDFS encryption zones
        ...
        zkfc                 run the ZK Failover Controller daemon
      

      issue 2: it's not user-friendly

       # bin/hdfs erasurecode -getZoneInfo /
      -getZoneInfo: Fatal internal error
      java.lang.NullPointerException
              at org.apache.hadoop.hdfs.tools.erasurecode.ECCommand$GetECZoneInfoCommand.processPath(ECCommand.java:168)
              at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:321)
              at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:293)
              at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:275)
              at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:259)
              at org.apache.hadoop.fs.shell.Command.processRawArguments(Command.java:205)
              at org.apache.hadoop.fs.shell.Command.run(Command.java:166)
              at org.apache.hadoop.fs.FsShell.run(FsShell.java:291)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
              at org.apache.hadoop.hdfs.tools.erasurecode.ECCli.main(ECCli.java:45)
      

      possible issue 3: We create zone twice at /

       # bin/hdfs erasurecode -createZone /
      EC Zone created successfully at hdfs://ds-34:9000/
       # bin/hdfs erasurecode -createZone /
      createZone: Unable to create EC zone for the path hdfs://ds-34:9000/
      

      It doesn't print detail error message.

      Attachments

        1. HDFS-8364-HDFS-7285.001.patch
          2 kB
          Walter Su
        2. HDFS-8364-HDFS-7285.002.patch
          4 kB
          Walter Su

        Activity

          People

            walter.k.su Walter Su
            walter.k.su Walter Su
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: