[SPARK-30791] Dataframe add sameResult and sementicHash method - ASF JIRA

XML

Word

Printable

JSON

Sometimes, we want to check whether two dataframes are the same.

There is already an internal API like:

df1.queryExecution.analyzed.sameResult(...)
df1.queryExecution.analyzed.semanticHash()

We can make a public API for this:

Like:

df1.sameSemantic(df2) // return true if dataframe has the same semantic
df1.semanticHash() // return a semantic hashcode

links to

GitHub Pull Request #27565