Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29484

Very Poor Performance When Reading SQL Server Tables Using Active Directory Authentication

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.4.3
    • None
    • Spark Core

    Description

      When creating a dataframe via JDBC from MS SQL Server performance is so bad to be unusable when authentication was performed with Active Directory. When authentication is using SQL Server account performance is as expected. Created a java that that connected to the same Azure SQL database via Active Directory account and performance was the as Sql Server account.  When connecting via Active Directory it could 30 minutes to 1 hour to read a 250 row table compared to 5 seconds using SQL Server account or using a console Java app connecting via AD.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            Titan22 Scott Black
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: