[SPARK-56472] Fix MERGE schema evolution with WHEN MATCHED THEN DELETE by johanl-db · Pull Request #55340 · apache/spark

johanl-db · 2026-04-14T15:27:09Z

Fixes a small bug in MERGE INTO schema evolution so that MERGE statements that contain a DELETE clause correctly trigger schema evolution:

MERGE INTO target
USING source
ON target.id = source.id
WHEN MATCHED THEN DELETE
WHEN NOT MATCHED THEN INSERT SET *;

Added a test, confirmed that the test fails without this fix.

szehon-ho · 2026-04-14T22:18:20Z

sql/core/src/test/scala/org/apache/spark/sql/connector/MergeIntoSchemaEvolutionBasicTests.scala

      "`bonus` cannot be resolved"
  )
+
+  testEvolution("source has extra column with delete action")(


thanks! how about just DELETE, will it trigger?

Fix MERGE schema evolution with WHEN MATCHED THEN DELETE

fe6cf8a

szehon-ho approved these changes Apr 14, 2026

View reviewed changes

Provide feedback