Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Mar 10, 2026

• [SPARK-55899][PYTHON][TEST] Add ASV microbenchmark for SQL_ARROW_BATCHED_UDF

  Show description for 88846d7
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  88846d7

  Copy full SHA for 88846d7

• [SPARK-55904][PYTHON][CONNECT] Utilize _check_same_session to narrow down types

  Show description for faf094a
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  faf094a

  Copy full SHA for faf094a

• [SPARK-55390][PYTHON] Consolidate SQL_SCALAR_ARROW_UDF wrapper, mapper, and serializer logic

  Show description for 77628fc
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  77628fc

  Copy full SHA for 77628fc

• [SPARK-55502][PYTHON] Unify UDF and UDTF Arrow conversion error handling

  Show description for 35c115b
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  35c115b

  Copy full SHA for 35c115b

• [SPARK-55858][PYTHON][INFRA] Fix UDF logging tests under coverage

  Show description for 949f1cd
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  949f1cd

  Copy full SHA for 949f1cd

Commits on Mar 9, 2026

• Revert "[SPARK-54285][PYTHON] Cache timezone info to avoid expensive timestamp conversion"

  Show description for dc9f559
  zhengruifeng

  committed
  dc9f559

  Copy full SHA for dc9f559

• [SPARK-55164][TESTS][FOLLOW-UP] Correct the error message for mismatched output

  Show description for 4f9ce6f
  zhengruifeng

  committed
  4f9ce6f

  Copy full SHA for 4f9ce6f

• [SPARK-55867][PS] Fix StringMethods with pandas 3

  Show description for 364ff27
  

  ueshin

  authored and

  HyukjinKwon

  committed
  364ff27

  Copy full SHA for 364ff27

• [SPARK-55754][PYTHON][TEST] Add ASV microbenchmarks for scalar Arrow UDF eval types

  Show description for 4f6ae84
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  4f6ae84

  Copy full SHA for 4f6ae84

Commits on Mar 5, 2026

• [SPARK-54665][PS] Fix boolean vs string comparison to match pandas behavior

  Show description for 5075ea6
  

  devin-petersohn

  authored and

  ueshin

  committed
  5075ea6

  Copy full SHA for 5075ea6

• [SPARK-55821][PYTHON] Enforce keyword-only arguments in serializer __init__ methods

  Show description for ac46ea6
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  ac46ea6

  Copy full SHA for ac46ea6

• [SPARK-55465][PYTHON] Support GeometryType in convert_numpy

  Show description for fa66d28
  

  fangchenli

  authored and

  zhengruifeng

  committed
  fa66d28

  Copy full SHA for fa66d28

• [SPARK-55788][PYTHON] Support ExtensionDType for integers in Pandas UDF

  Show description for 1790508
  

  zhengruifeng

  authored and

  ueshin

  committed
  1790508

  Copy full SHA for 1790508

• [SPARK-55156][PS][FOLLOW-UP] Fix fallback functions

  Show description for e953cf2
  ueshin

  committed
  e953cf2

  Copy full SHA for e953cf2

• [SPARK-55843][PS] Handle the unit of datetime64 and timedelta64 dtypes

  Show description for e500c78
  ueshin

  committed
  e500c78

  Copy full SHA for e500c78

• [SPARK-55726][PYTHON][TEST] Add ASV microbenchmark for grouped map pandas UDF

  Show description for dcde7fa
  

  Yicong-Huang

  authored and

  ueshin

  committed
  dcde7fa

  Copy full SHA for dcde7fa

Commits on Mar 3, 2026

• [SPARK-46167][PS] Add axis implementation to DataFrame.rank

  Show description for d95d80f
  

  devin-petersohn

  authored and

  HyukjinKwon

  committed
  d95d80f

  Copy full SHA for d95d80f

• [SPARK-55799][PYTHON][TESTS] Add datasource tests with simple worker

  Show description for 50f9412
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  50f9412

  Copy full SHA for 50f9412

• [SPARK-55800][PYTHON] Remove the unused type check for datetime.date

  Show description for 1323ab5
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  1323ab5

  Copy full SHA for 1323ab5

• [SPARK-55801][PYTHON] Fix type hint of _SimpleStreamReaderWrapper.getCache

  Show description for be10dc0
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  be10dc0

  Copy full SHA for be10dc0

• [SPARK-55621][PYTHON] Fix ambiguous and unnecessary unicode usage

  Show description for 7b404cb
  

  gaogaotiantian

  authored and

  HyukjinKwon

  committed
  7b404cb

  Copy full SHA for 7b404cb

• [SPARK-55326][PYTHON][CONNECT] Release remote session when SPARK_CONNECT_RELEASE_SESSION_ON_EXIT is set

  Show description for 854628f
  

  wbo4958

  authored and

  HyukjinKwon

  committed
  854628f

  Copy full SHA for 854628f

Commits on Mar 2, 2026

• [SPARK-55583][PYTHON] Validate Arrow schema types in Python data source

  Show description for b38e8ea
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  b38e8ea

  Copy full SHA for b38e8ea

• [SPARK-55663][PYTHON] Unify __module__ for data source functions

  Show description for 1cc5916
  

  gaogaotiantian

  authored and

  zhengruifeng

  committed
  1cc5916

  Copy full SHA for 1cc5916

• [SPARK-37711][PS] Reduce pandas describe job count from O(N) to O(1)

  Show description for f612cd0
  

  devin-petersohn

  authored and

  zhengruifeng

  committed
  f612cd0

  Copy full SHA for f612cd0

• [SPARK-55464][PYTHON] Support GeographyType in convert_numpy

  Show description for 56faeb4
  

  fangchenli

  authored and

  zhengruifeng

  committed
  56faeb4

  Copy full SHA for 56faeb4

Commits on Feb 27, 2026

• [SPARK-55730][PYTHON] Not make timezone lower case

  Show description for e2cd90b
  ueshin

  committed
  e2cd90b

  Copy full SHA for e2cd90b

• [SPARK-55691][CONNECT] GetStatus client

  Show description for a83eec8
  

  terana

  authored and

  hvanhovell

  committed
  a83eec8

  Copy full SHA for a83eec8

• [SPARK-55736][PYTHON][TESTS] Add tests for mismatched batch sizes in scalar iter UDFs

  Show description for 3f64bca
  zhengruifeng

  committed
  3f64bca

  Copy full SHA for 3f64bca

• [SPARK-55743][PYTHON][TESTS] Add `python/benchmarks` in python linter

  Show description for 61c87b2
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  61c87b2

  Copy full SHA for 61c87b2

• [MINOR][DOCS] Document how to run a specified benchmark

  Show description for e52dfc5
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  e52dfc5

  Copy full SHA for e52dfc5

• [SPARK-55405][PYTHON][TESTS][FOLLOW-UP] Add macOS ARM overrides for float-to-int unsafe cast golden file mismatches

  Show description for 1b1904e
  

  Yicong-Huang

  authored and

  zhengruifeng

  committed
  1b1904e

  Copy full SHA for 1b1904e

• [SPARK-55463][PYTHON][FOLLOW-UP] Delete unnecessary `date_as_object=True` in VariantType conversion

  Show description for 7182a79
  zhengruifeng

  committed
  7182a79

  Copy full SHA for 7182a79

• [SPARK-55713][PYTHON][TESTS] Add `LongArrowToPandasBenchmark` for long type conversions

  Show description for 3b343b4
  zhengruifeng

  committed
  3b343b4

  Copy full SHA for 3b343b4

Commits on Feb 26, 2026

• [SPARK-55700][PS] Fix handling integer keys on Series with non-integer index

  Show description for 9e6b257
  ueshin

  committed
  9e6b257

  Copy full SHA for 9e6b257

Pagination

Previous

Next