Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24948

SHS filters wrongly some applications due to permission check

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 2.3.1
    • 2.2.3, 2.3.2, 2.4.0
    • Web UI
    • None

    Description

      SHS filters the event logs it doesn't have permissions to read. Unfortunately, this check is quite naive, as it takes into account only the base permissions (ie. user, group, other permissions). For instance, if ACL are enabled, they are ignored in this check; moreover, each filesystem may have different policies (eg. they can consider spark as a superuser who can access everything).

      This results in some applications not being displayed in the SHS, despite the Spark user (or whatever user the SHS is started with) can actually read their ent logs.

      Attachments

        Issue Links

          Activity

            People

              mgaido Marco Gaido
              mgaido Marco Gaido
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: