-
Notifications
You must be signed in to change notification settings - Fork 266
Open
Labels
good first issuepyspark-classicGraphFrames on PySpark ClassicGraphFrames on PySpark Classicpyspark-connectGraphFrames on PySpark ConnectGraphFrames on PySpark Connectscala
Milestone
Description
Is your feature request related to a problem? Please describe.
At the moment all the algorithms from lib return DataFrame and only PageRank returns a new GraphFrame where vertices has an additional column.
Describe the solution you would like
- Add an argument to PySpark wrappers like
legacy_mode: boolthat is true by default to avoid breaking changes - Based on this argument, if legacy mode we are returning from PageRank a
GraphFrame, but if it is false only a DataFrame of scores - Raise a deprecation warning if the
legacy_modeis true with a messages that in future version PageRank will return only DataFrame with scores - Add the same argument to scala parts
Component
- Scala Core Internal
- Scala API
- Spark Connect Plugin
- Infrastructure
- PySpark Classic
- PySpark Connect
Additional context
We can plan it for the future 1.0 release to follow a semantic versioning. Feel free to ask me about details.
Are you planning on creating a PR?
- I'm willing to make a pull-request
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
good first issuepyspark-classicGraphFrames on PySpark ClassicGraphFrames on PySpark Classicpyspark-connectGraphFrames on PySpark ConnectGraphFrames on PySpark Connectscala