Skip to content

[SPARK-43940][SQL] Test the error class: BATCH_METADATA_NOT_FOUND - #57926

Open
deepujain wants to merge 1 commit into
apache:masterfrom
deepujain:SPARK-43940-cannot-find-batch-test
Open

[SPARK-43940][SQL] Test the error class: BATCH_METADATA_NOT_FOUND#57926
deepujain wants to merge 1 commit into
apache:masterfrom
deepujain:SPARK-43940-cannot-find-batch-test

Conversation

@deepujain

Copy link
Copy Markdown
Contributor

Summary

Adds coverage for the missing batch metadata error path.

Change

HDFSMetadataLog.applyFnToBatchByStream now has a focused test that checks BATCH_METADATA_NOT_FOUND, the missing batch file parameter, and SQLSTATE 42K03.

Tests

JAVA_HOME=/opt/homebrew/opt/openjdk@17 PATH="/opt/homebrew/opt/openjdk@17/bin:$PATH" ./build/sbt "sql/testOnly org.apache.spark.sql.errors.QueryExecutionErrorsSuite -- -z SPARK-43940"

Fixes SPARK-43940

JIRA assignee for credit: deepujain

@deepujain
deepujain force-pushed the SPARK-43940-cannot-find-batch-test branch from 0857bbc to 5a956de Compare August 11, 2026 12:51
@deepujain

Copy link
Copy Markdown
Contributor Author

Fixed the commit author metadata and force-pushed the same test-only tree. Local check already passed: JAVA_HOME=/opt/homebrew/opt/openjdk@17 PATH="/opt/homebrew/opt/openjdk@17/bin:$PATH" ./build/sbt "sql/testOnly org.apache.spark.sql.errors.QueryExecutionErrorsSuite -- -z SPARK-43940". CI is running again on the updated head.

@deepujain
deepujain force-pushed the SPARK-43940-cannot-find-batch-test branch from 5a956de to 432f7ba Compare August 11, 2026 14:49
@deepujain

Copy link
Copy Markdown
Contributor Author

Rebased on current master. I reran JAVA_HOME=/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home PATH="/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home/bin:$PATH" SBT_OPTS="-Dspark.driver.bindAddress=127.0.0.1 -Dspark.driver.host=127.0.0.1" ./build/sbt "sql/testOnly org.apache.spark.sql.errors.QueryExecutionErrorsSuite -- -z SPARK-43940" locally; it passed. CI has restarted on the new head.

@uros-b

uros-b commented Aug 11, 2026

Copy link
Copy Markdown
Member

Thank you @deepujain!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants