Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Oct 17, 2025

• [SPARK-53149][CORE] Fix testing whether BeeLine process run in background

  Show description for d799aa7
  

  pan3793

  authored and

  LuciferYang

  committed
  d799aa7

  Copy full SHA for d799aa7

Commits on Sep 12, 2025

• [SPARK-53498][SDP] Correctly Reference `pyspark/pipelines/cli.py` from `spark-pipelines` Binary

  Show description for faa1aaa
  

  anishm-db

  authored and

  dongjoon-hyun

  committed
  faa1aaa

  Copy full SHA for faa1aaa

Commits on Jun 13, 2025

• [SPARK-52431][SDP] Finishing touches on Declarative Pipelines runner

  Show description for c4ffb7b
  sryza

  committed
  c4ffb7b

  Copy full SHA for c4ffb7b

Commits on May 30, 2025

• [SPARK-52238][PYTHON] Python client for Declarative Pipelines

  Show description for e3321aa
  sryza

  committed
  e3321aa

  Copy full SHA for e3321aa

Commits on Mar 24, 2025

• [SPARK-51146][INFRA][FOLLOW-UP] Explicitly disable Spark Connect in server side scripts

  Show description for 03b62c2
  HyukjinKwon

  committed
  03b62c2

  Copy full SHA for 03b62c2

Commits on Mar 20, 2025

• [SPARK-50416][CORE] A more portable terminal / pipe test needed for bin/load-spark-env.sh

  Show description for 8d26008
  

  philwalk

  authored and

  LuciferYang

  committed
  8d26008

  Copy full SHA for 8d26008

Commits on Feb 17, 2025

• [SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default

  Show description for f798e7a
  

  ueshin

  authored and

  cloud-fan

  committed
  f798e7a

  Copy full SHA for f798e7a

Commits on Jan 15, 2025

• [SPARK-50821][PYTHON] Upgrade Py4J from 0.10.9.8 to 0.10.9.9

  Show description for d792865
  HyukjinKwon

  committed
  d792865

  Copy full SHA for d792865

Commits on Dec 18, 2024

• [SPARK-50596][PYTHON] Upgrade Py4J from 0.10.9.7 to 0.10.9.8

  Show description for cb84939
  HyukjinKwon

  committed
  cb84939

  Copy full SHA for cb84939

Commits on Aug 12, 2024

• [SPARK-49195][CONNECT] Embed script level parsing logic into SparkSubmitCommandBuilder

  Show description for 1113029
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  1113029

  Copy full SHA for 1113029

Commits on Aug 11, 2024

• [SPARK-48936][CONNECT][FOLLOW-UP] Makes spark-shell with Spark connect work with SPARK_REMOTE environment variable

  Show description for 6e3b384
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  6e3b384

  Copy full SHA for 6e3b384

• [SPARK-48936][CONNECT] Makes spark-shell works with Spark connect

  Show description for dee53bb
  HyukjinKwon

  committed
  dee53bb

  Copy full SHA for dee53bb

Commits on Aug 6, 2024

• [SPARK-49117][K8S] Fix `docker-image-tool.sh` to be up-to-date

  Show description for d9c5902
  

  dongjoon-hyun

  authored and

  HyukjinKwon

  committed
  d9c5902

  Copy full SHA for d9c5902

Commits on Jul 11, 2024

• [SPARK-48763][CONNECT][BUILD] Move connect server and common to builtin module

  Show description for 4d13c22
  HyukjinKwon

  committed
  4d13c22

  Copy full SHA for 4d13c22

Commits on May 29, 2024

• [SPARK-23015][WINDOWS] Fix bug in Windows where starting multiple Spark instances within the same second causes a failure

  Show description for 56c65d5
  

  Rafnel

  authored and

  HyukjinKwon

  committed
  56c65d5

  Copy full SHA for 56c65d5

Commits on Jan 30, 2024

• [SPARK-46910][PYTHON] Eliminate JDK Requirement in PySpark Installation

  Show description for 83fad32
  

  asl3

  and

  HyukjinKwon

  committed
  83fad32

  Copy full SHA for 83fad32

Commits on Sep 22, 2023

• [SPARK-44113][BUILD][INFRA][DOCS] Drop support for Scala 2.12

  Show description for 3429202
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  3429202

  Copy full SHA for 3429202

Commits on Mar 7, 2023

• [SPARK-42656][CONNECT][FOLLOWUP] Spark Connect Shell

  Show description for 2e7207f
  

  zhenlineo

  authored and

  hvanhovell

  committed
  2e7207f

  Copy full SHA for 2e7207f

Commits on Feb 16, 2023

• [SPARK-42462][K8S] Prevent `docker-image-tool.sh` from publishing OCI manifests

  Show description for 2ac70ae
  dongjoon-hyun

  committed
  2ac70ae

  Copy full SHA for 2ac70ae

Commits on Jan 24, 2023

• [SPARK-42166][K8S] Make `docker-image-tool.sh` usage message up-to-date

  Show description for b5090f6
  dongjoon-hyun

  committed
  b5090f6

  Copy full SHA for b5090f6

Commits on Oct 28, 2022

• [SPARK-40941][K8S] Use Java 17 in K8s Dockerfile by default and remove `Dockerfile.java17`

  Show description for 5793e5f
  dongjoon-hyun

  committed
  5793e5f

  Copy full SHA for 5793e5f

Commits on Oct 24, 2022

• [SPARK-40739][SPARK-40738] Fixes for cygwin/msys2/mingw sbt build and bash scripts

  Show description for 880d9bb
  

  philwalk

  authored and

  srowen

  committed
  880d9bb

  Copy full SHA for 880d9bb

Commits on Oct 12, 2022

• [SPARK-8731] Beeline doesn't work with -e option when started in background

  Show description for cb0d6ed
  

  zhouyifan279

  authored and

  yaooqinn

  committed
  cb0d6ed

  Copy full SHA for cb0d6ed

Commits on Oct 11, 2022

• [SPARK-40735] Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

  Show description for efd9ef9
  

  huangxiaopingRD

  authored and

  srowen

  committed
  efd9ef9

  Copy full SHA for efd9ef9

Commits on Aug 30, 2022

• [SPARK-40256][BUILD][K8S] Switch base image from openjdk to eclipse-temurin

  Show description for c2d4c4e
  

  Yikun

  authored and

  gengliangwang

  committed
  c2d4c4e

  Copy full SHA for c2d4c4e

Commits on Aug 16, 2022

• [SPARK-40084][PYTHON] Upgrade Py4J to 0.10.9.7

  Show description for 74deefb
  

  panbingkun

  authored and

  xinrong-meng

  committed
  74deefb

  Copy full SHA for 74deefb

Commits on Mar 18, 2022

• [SPARK-38563][PYTHON] Upgrade to Py4J 0.10.9.5

  Show description for 97335ea
  HyukjinKwon

  committed
  97335ea

  Copy full SHA for 97335ea

Commits on Mar 17, 2022

• Revert "[SPARK-38563][PYTHON] Upgrade to Py4J 0.10.9.4"

  Show description for 54fdb88
  dongjoon-hyun

  committed
  54fdb88

  Copy full SHA for 54fdb88

Commits on Mar 16, 2022

• [SPARK-38563][PYTHON] Upgrade to Py4J 0.10.9.4

  Show description for 8193b40
  HyukjinKwon

  committed
  8193b40

  Copy full SHA for 8193b40

Commits on Dec 6, 2021

• [SPARK-37004][PYTHON] Upgrade to Py4J 0.10.9.3

  Show description for 72669b5
  HyukjinKwon

  committed
  72669b5

  Copy full SHA for 72669b5

Commits on Nov 15, 2021

• [SPARK-37319][K8S] Support K8s image building with Java 17

  Show description for bb9e1d9
  

  dongjoon-hyun

  authored and

  sarutak

  committed
  bb9e1d9

  Copy full SHA for bb9e1d9

Commits on Mar 11, 2021

• [SPARK-34688][PYTHON] Upgrade to Py4J 0.10.9.2

  Show description for 60e324a
  

  wankunde

  authored and

  srowen

  committed
  60e324a

  Copy full SHA for 60e324a

Commits on Jan 28, 2021

• [SPARK-32866][K8S] Fix docker cross-build

  Show description for 497f599
  holdenk

  committed
  497f599

  Copy full SHA for 497f599

Commits on Jan 4, 2021

• [SPARK-33984][PYTHON] Upgrade to Py4J 0.10.9.1

  Show description for 6b86aa0
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  6b86aa0

  Copy full SHA for 6b86aa0

Commits on Nov 30, 2020

• [MINOR] Spelling bin core docs external mllib repl

  Show description for 4851453
  

  jsoref

  authored and

  maropu

  committed
  4851453

  Copy full SHA for 4851453