Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Mar 27, 2026

• [SPARK-56262][PYTHON] Remove the unnecessary mypy check disable for types

  Show description for 8a83d2d
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  8a83d2d

  Copy full SHA for 8a83d2d

• [SPARK-56244][PYTHON] Refine benchmark class layout in bench_eval_type.py

  Show description for 80d9d47
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  80d9d47

  Copy full SHA for 80d9d47

• [SPARK-55827][PYTHON] Fix type hint for datasource workers

  Show description for 592e896
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  592e896

  Copy full SHA for 592e896

• [SPARK-56123][PYTHON] Refactor SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF

  Show description for bf02188
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  bf02188

  Copy full SHA for bf02188

• [SPARK-56247][PYTHON] Fix the fall back behavior and type hint of inheritable_thread_target

  Show description for 3bff8ca
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  3bff8ca

  Copy full SHA for 3bff8ca

• [SPARK-56242][PYTHON][TESTS] Add a test to ensure no 3rd party libraries are imported for "import pyspark"

  Show description for 52506bf
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  52506bf

  Copy full SHA for 52506bf

• [SPARK-54944][PYTHON][TEST] Add tests for pa.Array.to_pandas with default arguments

  Show description for d7d3ec5
  zhengruifeng

  committed
  d7d3ec5

  Copy full SHA for d7d3ec5

Commits on Mar 26, 2026

• [SPARK-56245][PS] Fix DataFrame.eval inplace assignment on pandas 3

  Show description for a059820
  

  ueshin

  authored and

  HyukjinKwon

  committed
  a059820

  Copy full SHA for a059820

• [SPARK-56221][SQL][PYTHON] Feature parity between spark.catalog.* vs DDL commands

  Show description for 91d62ce
  HyukjinKwon

  committed
  91d62ce

  Copy full SHA for 91d62ce

• [SPARK-56219][PS] Align groupby idxmax and idxmin skipna=False behavior with pandas 2/3

  Show description for 932f9f7
  

  ueshin

  authored and

  HyukjinKwon

  committed
  932f9f7

  Copy full SHA for 932f9f7

• [SPARK-56067][PYTHON] Lazy import psutil to improve import speed

  Show description for 6494991
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  6494991

  Copy full SHA for 6494991

• [SPARK-55950][PYTHON][CONNECT] Add PySpark support for CDC changes() API

  Show description for 91e21ee
  

  gengliangwang

  authored and

  zhengruifeng

  committed
  91e21ee

  Copy full SHA for 91e21ee

• [SPARK-56066][PYTHON] Lazy import numpy to improve import speed

  Show description for 533670b
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  533670b

  Copy full SHA for 533670b

• [SPARK-56085][PYTHON][TEST] Add ASV micro-benchmarks for SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF

  Show description for cc85ba1
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  cc85ba1

  Copy full SHA for cc85ba1

• [SPARK-56217][PYTHON] Fix bucketBy exceptions in connect

  Show description for 183086f
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  183086f

  Copy full SHA for 183086f

• [SPARK-56226][PS][CONNECT] Catch analysis errors before `InternalFrame.__init__` in `.loc`

  Show description for 1d30a64
  

  ueshin

  authored and

  zhengruifeng

  committed
  1d30a64

  Copy full SHA for 1d30a64

• [SPARK-56224][PYTHON] Polish type annotations for accumulators.py

  Show description for 6e3ea1c
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  6e3ea1c

  Copy full SHA for 6e3ea1c

• [SPARK-56166][PYTHON] Use ArrowBatchTransformer.enforce_schema to replace column-wise type coercion logic

  Show description for 5c83086
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  5c83086

  Copy full SHA for 5c83086

• [SPARK-55579][PYTHON] Rename PySpark error classes to be eval-type-agnostic

  Show description for 6fb96bc
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  6fb96bc

  Copy full SHA for 6fb96bc

• [SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 3

  Show description for 5adaeee
  zhengruifeng

  committed
  5adaeee

  Copy full SHA for 5adaeee

Commits on Mar 25, 2026

• [SPARK-55170][PYTHON][FOLLOWUP] Extract _read_arrow_stream to fix latent recursion in _load_group_dataframes

  Show description for b2abf57
  

  Yicong-Huang

  authored and

  HyukjinKwon

  committed
  b2abf57

  Copy full SHA for b2abf57

• [SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 2

  Show description for 524d7e2
  zhengruifeng

  committed
  524d7e2

  Copy full SHA for 524d7e2

• [SPARK-55700][PS][FOLLOW-UP] Use positional access when squeezing a single-element Series

  Show description for 106c186
  

  ueshin

  authored and

  dongjoon-hyun

  committed
  106c186

  Copy full SHA for 106c186

• [SPARK-56188][PS] Align Series.map({}) with pandas 3 empty-dict behavior

  Show description for f9b838b
  

  ueshin

  authored and

  dongjoon-hyun

  committed
  f9b838b

  Copy full SHA for f9b838b

Commits on Mar 24, 2026

• [SPARK-56186][PYTHON] Retire pypy

  Show description for d51b39b
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  d51b39b

  Copy full SHA for d51b39b

• [SPARK-56187][PS] Fix Series.argsort null ordering for pandas 3

  Show description for 81e8678
  

  ueshin

  authored and

  HyukjinKwon

  committed
  81e8678

  Copy full SHA for 81e8678

• [SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 1

  Show description for aa10a79
  zhengruifeng

  committed
  aa10a79

  Copy full SHA for aa10a79

• [SPARK-56167][PS] Align astype with pandas 3 default string behavior

  Show description for 992d932
  

  ueshin

  authored and

  HyukjinKwon

  committed
  992d932

  Copy full SHA for 992d932

• [SPARK-56168][PS][TESTS] Relax groupby diff-length assertions for pandas 3

  Show description for 005f2a3
  

  ueshin

  authored and

  HyukjinKwon

  committed
  005f2a3

  Copy full SHA for 005f2a3

• [SPARK-55600][PYTHON][TEST][FOLLOW-UP] Fix test to verify row count preservation with 0-column schema

  Show description for 66af041
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  66af041

  Copy full SHA for 66af041

• [SPARK-56165][PYTHON][TESTS] Use temporary directory instead of saveAsTable in test_data_source_segfault

  Show description for 3a9a5b7
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  3a9a5b7

  Copy full SHA for 3a9a5b7

• [SPARK-56075][PYTHON][FOLLOW-UP] Remove remaining dead python error classes

  Show description for 31e2227
  zhengruifeng

  committed
  31e2227

  Copy full SHA for 31e2227

Commits on Mar 23, 2026

• [SPARK-56135][DOCS] Add option to use venv in PySpark docs

  Show description for a5a7588
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  a5a7588

  Copy full SHA for a5a7588

Commits on Mar 22, 2026

• [SPARK-55610][PYTHON] Add getExecutorInfos to StatusTracker in Python

  Show description for 9518655
  

  WweiL

  authored and

  HyukjinKwon

  committed
  9518655

  Copy full SHA for 9518655

Commits on Mar 21, 2026

• [SPARK-56113][PS] Improve pandas 3 string restoration in pandas-on-Spark

  Show description for 7eebdae
  

  ueshin

  authored and

  HyukjinKwon

  committed
  7eebdae

  Copy full SHA for 7eebdae

Pagination

Previous

Next