Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-977

Livy can not be started if HDFS is still in safe mode

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7.0
    • 0.9.0
    • Server
    • None

    Description

      When services are started by cdp environments start-environment, sometimes HDFS is started too close to Livy and this may lead to

      Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /user/livy/recovery. Name node is in safe mode.
The reported blocks 407318 has reached the threshold 0.9990 of total blocks 407318. The number of live datanodes 4 has reached the minimum number 1. In safe mode extension. Safe mode will be turned off automatically in 18 seconds. NamenodeHostName:bpicdpdev-datahub-de-master0.bpicdpde.ggj4-2xqj.cloudera.site
...
        at org.apache.hadoop.fs.FileContext.mkdir(FileContext.java:812)
        at org.apache.livy.server.recovery.FileSystemStateStore.<init>(FileSystemStateStore.scala:62)
        at org.apache.livy.server.recovery.FileSystemStateStore.<init>(FileSystemStateStore.scala:42)

      Attachments

        Activity

          People

            rajshekhar Rajshekhar Muchandi
            asifkhatri Asif Khatri
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 40m
                40m