[SPARK-52440] Add python install extra for declarative pipeline - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 4.1.0
Fix Version/s: None
Component/s: Declarative Pipelines
Labels:
- pull-request-available

Description

Make it so that pip install pyspark[pipelines] will install all Declarative Pipelines Python dependencies, which include:

All SQL dependencies
All Spark Connect dependencies
pyyaml

Attachments

Issue Links

links to

GitHub Pull Request #51138

Activity

People

Assignee:: Sandy Ryza

Reporter:: Sandy Ryza

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 10/Jun/25 23:14

Updated:: 11/Jun/25 15:04

Resolved:: 11/Jun/25 15:04