Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29510

JobGroup ID is not set for the job submitted from Spark-SQL and Spark -Shell

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0
    • None
    • Spark Shell, SQL
    • None

    Description

      When user submit jobs from Spark-shell or SQL Job group id is not set. UI Screen shot attached.

      But from beeline job Group ID is set.

      Steps:

      create table customer(id int, name String, CName String, address String, city String, pin int, country String);
      insert into customer values(1,'Alfred','Maria','Obere Str 57','Berlin',12209,'Germany');
      insert into customer values(2,'Ana','trujilo','Adva de la','Maxico D.F.',05021,'Maxico');
      insert into customer values(3,'Antonio','Antonio Moreno','Mataderos 2312','Maxico D.F.',05023,'Maxico'); 
      SELECT A.CName AS CustomerName1, B.CName AS CustomerName2, A.City FROM customer A, customer B WHERE A.id <> B.id AND A.City = B.City ORDER BY A.City;

       

      Attachments

        1. JobGroup1.png
          82 kB
          ABHISHEK KUMAR GUPTA
        2. JobGroup2.png
          92 kB
          ABHISHEK KUMAR GUPTA
        3. JobGroup3.png
          64 kB
          ABHISHEK KUMAR GUPTA

        Activity

          People

            Unassigned Unassigned
            abhishek.akg ABHISHEK KUMAR GUPTA
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: