Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Mar 23, 2026

• [SPARK-56135][DOCS] Add option to use venv in PySpark docs

  Show description for a5a7588
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  a5a7588

  Copy full SHA for a5a7588

Commits on Dec 30, 2025

• [SPARK-54849][PYTHON] Upgrade the minimum version of `pyarrow` to 18.0.0

  Show description for f80b919
  zhengruifeng

  committed
  f80b919

  Copy full SHA for f80b919

Commits on Dec 25, 2025

• Revert "[SPARK-54839][PYTHON] Upgrade the minimum version of `numpy` to 2.0.0"

  Show description for 3cc3cc1
  zhengruifeng

  committed
  3cc3cc1

  Copy full SHA for 3cc3cc1

• [SPARK-54839][PYTHON] Upgrade the minimum version of `numpy` to 2.0.0

  Show description for 51c6649
  zhengruifeng

  committed
  51c6649

  Copy full SHA for 51c6649

Commits on Nov 14, 2025

• [SPARK-54194][CONNECT][FOLLOWUP] Spark Connect Proto Plan Compression - Scala Client

  Show description for 6cb88c1
  

  xi-db

  authored and

  hvanhovell

  committed
  6cb88c1

  Copy full SHA for 6cb88c1

Commits on Nov 5, 2025

• [SPARK-54177][BUILD] Upgrade gRPC to 1.76 and protobuf to 6.33

  Show description for 83e49b7
  

  pan3793

  authored and

  dongjoon-hyun

  committed
  83e49b7

  Copy full SHA for 83e49b7

Commits on Nov 4, 2025

• Revert "[SPARK-54177][BUILD] Upgrade gRPC to 1.76 and protobuf to 6.33"

  Show description for 4a1b7b2
  dongjoon-hyun

  committed
  4a1b7b2

  Copy full SHA for 4a1b7b2

• [SPARK-54177][BUILD] Upgrade gRPC to 1.76 and protobuf to 6.33

  Show description for e55333c
  

  pan3793

  authored and

  dongjoon-hyun

  committed
  e55333c

  Copy full SHA for e55333c

Commits on Aug 13, 2025

• [SPARK-52844][PYTHON] Update numpy to 1.22

  Show description for 43f650e
  

  eschcam

  authored and

  dongjoon-hyun

  committed
  43f650e

  Copy full SHA for 43f650e

Commits on Jul 25, 2025

• [SPARK-52928][PYTHON][INFRA] Upgrade the minimum version of pyarrow to 15.0.0

  Show description for e8015e9
  zhengruifeng

  committed
  e8015e9

  Copy full SHA for e8015e9

Commits on Jul 17, 2025

• [SPARK-52840][PYTHON][DOCS] Increase Pandas minimum version to 2.2.0

  Show description for a9da24c
  zhengruifeng

  committed
  a9da24c

  Copy full SHA for a9da24c

Commits on Jul 5, 2025

• [SPARK-52561][PYTHON][INFRA] Upgrade the minimum version of Python to 3.10

  Show description for a053c68
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  a053c68

  Copy full SHA for a053c68

Commits on Jun 11, 2025

• [SPARK-52440][DECLARATIVE PIPELINES] Add python install extra for declarative pipelines

  Show description for 8052660
  sryza

  committed
  8052660

  Copy full SHA for 8052660

Commits on May 28, 2025

• Small improvements to Python Spark Connect installation docs

  Show description for d152ae8
  

  sryza

  authored and

  HyukjinKwon

  committed
  d152ae8

  Copy full SHA for d152ae8

Commits on Feb 24, 2025

• [MINOR][DOCS] Clarify spark.remote and spark.master in pyspark-connect and pyspark-client at install.rst

  Show description for c6097c7
  HyukjinKwon

  committed
  c6097c7

  Copy full SHA for c6097c7

Commits on Feb 17, 2025

• [SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default

  Show description for f798e7a
  

  ueshin

  authored and

  cloud-fan

  committed
  f798e7a

  Copy full SHA for f798e7a

Commits on Jan 15, 2025

• [SPARK-50821][PYTHON] Upgrade Py4J from 0.10.9.8 to 0.10.9.9

  Show description for d792865
  HyukjinKwon

  committed
  d792865

  Copy full SHA for d792865

Commits on Jan 2, 2025

• [SPARK-50711][PS][DOCS] Upgrade the minimum version of Pandas in PS to 2.2.0

  Show description for 3c0824d
  zhengruifeng

  committed
  3c0824d

  Copy full SHA for 3c0824d

Commits on Dec 25, 2024

• [SPARK-50657][PYTHON] Upgrade the minimum version of `pyarrow` to 11.0.0

  Show description for 9c9bdab
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  9c9bdab

  Copy full SHA for 9c9bdab

Commits on Dec 18, 2024

• [SPARK-50596][PYTHON] Upgrade Py4J from 0.10.9.7 to 0.10.9.8

  Show description for cb84939
  HyukjinKwon

  committed
  cb84939

  Copy full SHA for cb84939

Commits on Oct 25, 2024

• [SPARK-50015][BUILD] Upgrade `grpcio*` to 1.67.0 and `grpc-java` to 1.67.1

  Show description for c086163
  dongjoon-hyun

  committed
  c086163

  Copy full SHA for c086163

Commits on Oct 24, 2024

• [SPARK-50098][PYTHON] Upgrade the minimum version of `googleapis-common-protos` to 1.65.0

  Show description for cfe14c9
  dongjoon-hyun

  committed
  cfe14c9

  Copy full SHA for cfe14c9

Commits on Sep 20, 2024

• [SPARK-49531][PYTHON][CONNECT] Support line plot with plotly backend

  Show description for 22a7edc
  

  xinrong-meng

  authored and

  dongjoon-hyun

  committed
  22a7edc

  Copy full SHA for 22a7edc

Commits on Aug 28, 2024

• [SPARK-49402][PYTHON][FOLLOW-UP] Manually load ~/.profile in Spark Connect notebook

  Show description for 1c9cde5
  HyukjinKwon

  committed
  1c9cde5

  Copy full SHA for 1c9cde5

Commits on Jul 11, 2024

• [SPARK-48763][CONNECT][BUILD] Move connect server and common to builtin module

  Show description for 4d13c22
  HyukjinKwon

  committed
  4d13c22

  Copy full SHA for 4d13c22

Commits on Jul 8, 2024

• [SPARK-48798][PYTHON] Introduce `spark.profile.render` for SparkSession-based profiling

  Show description for b062d44
  ueshin

  committed
  b062d44

  Copy full SHA for b062d44

Commits on Jun 25, 2024

• [SPARK-48638][CONNECT] Add ExecutionInfo support for DataFrame

  Show description for 9d4abaf
  

  grundprinzip

  authored and

  HyukjinKwon

  committed
  9d4abaf

  Copy full SHA for 9d4abaf

Commits on May 1, 2024

• [SPARK-46894][PYTHON] Move PySpark error conditions into standalone JSON file

  Show description for 991763c
  

  nchammas

  authored and

  HyukjinKwon

  committed
  991763c

  Copy full SHA for 991763c

Commits on Apr 26, 2024

• [SPARK-47993][PYTHON] Drop Python 3.8

  Show description for 3451e66
  HyukjinKwon

  committed
  3451e66

  Copy full SHA for 3451e66

Commits on Apr 23, 2024

• [SPARK-47864][FOLLOWUP][PYTHON][DOCS] Fix minor typo: "MLLib" -> "MLlib"

  Show description for e50737b
  

  itholic

  authored and

  xinrong-meng

  committed
  e50737b

  Copy full SHA for e50737b

• [SPARK-47948][PYTHON] Upgrade the minimum `Pandas` version to 2.0.0

  Show description for 2b01755
  

  itholic

  authored and

  dongjoon-hyun

  committed
  2b01755

  Copy full SHA for 2b01755

Commits on Apr 18, 2024

• [SPARK-47864][PYTHON][DOCS] Enhance "Installation" page to cover all installable options

  Show description for 564b238
  

  itholic

  authored and

  HyukjinKwon

  committed
  564b238

  Copy full SHA for 564b238

Commits on Apr 15, 2024

• [SPARK-47851][CONNECT][DOCS] Document pyspark-connect package

  Show description for b8354bb
  HyukjinKwon

  committed
  b8354bb

  Copy full SHA for b8354bb

Commits on Apr 8, 2024

• [SPARK-47737][PYTHON] Bump PyArrow to 10.0.0

  Show description for 04bf981
  

  itholic

  authored and

  dongjoon-hyun

  committed
  04bf981

  Copy full SHA for 04bf981

Commits on Mar 27, 2024

• [SPARK-47610][CORE] Always set `io.netty.tryReflectionSetAccessible=true`

  Show description for 5f392a2
  

  pan3793

  authored and

  LuciferYang

  committed
  5f392a2

  Copy full SHA for 5f392a2