[SPARK-27385] use mapPartitionsWIthIndex in Dataframe - ASF JIRA

Rank to Top

Rank to Bottom

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Resolved
Priority: Minor
Resolution: Won't Fix
Affects Version/s: 1.6.0, 1.6.1, 1.6.2, 1.6.3
Fix Version/s: None
Component/s: SQL
Labels:
- DataFrame
- mapPartitionsWithIndex

Flags:

Patch

Description

As there is no mapPartitionsWithIndex in Dataframe ,if I want to use mapPartitionsWithIndex, I have to use dataframe.rdd.mapPartitionsWithIndex instade. What I want to do is to use mapPartitionsWithIndex directly in Dataframe. So, I want to add mapPartitionsWithIndex in Dataframe, that's all.