Description
In Spark SQL, we apply "earlier entry wins" semantic to duplicated map keys. e.g.
scala> sql("SELECT map(1,2,1,3)[1]").show
+------------------+
|map(1, 2, 1, 3)[1]|
+------------------+
| 2|
+------------------+
However, this handling is not applied consistently.
Attachments
Issue Links
- is duplicated by
-
SPARK-25823 map_filter can generate incorrect data
- Closed
- is related to
-
SPARK-25832 remove newly added map related functions
- Resolved
- links to
(2 links to)
1.
|
Remove duplicated map entries in `showString` | Resolved | Unassigned | |
2.
|
should apply "earlier entry wins" in Dataset.collect | Resolved | Unassigned | |
3.
|
should apply "earlier entry wins" in hive map value converter | Resolved | Unassigned |