Skip to content

Improve integration CI diagnostics for surefire fork startup failures#17843

Merged
xiangfu0 merged 1 commit intoapache:masterfrom
xiangfu0:codex/surefire-fork-debug-integration-ci
Mar 15, 2026
Merged

Improve integration CI diagnostics for surefire fork startup failures#17843
xiangfu0 merged 1 commit intoapache:masterfrom
xiangfu0:codex/surefire-fork-debug-integration-ci

Conversation

@xiangfu0
Copy link
Copy Markdown
Contributor

@xiangfu0 xiangfu0 commented Mar 9, 2026

What

This updates the integration test runner script used in GitHub Actions to make surefire fork startup failures easier to diagnose and reduce fork startup memory pressure for set 2.

Changes

  • Add print_surefire_dumps() in .github/workflows/scripts/pr-tests/.pinot_tests_integration.sh
  • On integration-test failure, print surefire dump artifacts from target/surefire-reports (*.dump, *.dumpstream, *jvmRun*)
  • For RUN_TEST_SET=2, pass -DargLine="-Xms1g -Xmx2g -Dlog4j2.configurationFile=log4j2.xml" to lower fork JVM heap from default 4g/4g

Why

We saw CI fail with:

  • ExecutionException Error occurred in starting fork
  • SurefireBooterForkException

The dump files are the primary source of root-cause details for this class of error. Lowering surefire fork heap for set 2 should also reduce startup failures due to memory pressure on GitHub runners.

Validation

  • bash -n .github/workflows/scripts/pr-tests/.pinot_tests_integration.sh

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the GitHub Actions integration test runner script to improve diagnostics for Maven Surefire fork startup failures and reduce fork JVM heap size for integration test set 2 to lower CI memory pressure.

Changes:

  • Add a helper to print Surefire dump artifacts from target/surefire-reports on test failures.
  • Update integration test execution to print Surefire dump files when mvn test fails.
  • For RUN_TEST_SET=2, override Maven argLine to use a smaller heap (-Xms1g -Xmx2g) while retaining the log4j2 config setting.

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Mar 9, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 63.30%. Comparing base (b280619) to head (2ce4399).
⚠️ Report is 5 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff              @@
##             master   #17843      +/-   ##
============================================
+ Coverage     55.58%   63.30%   +7.72%     
- Complexity      727     1466     +739     
============================================
  Files          2497     3190     +693     
  Lines        141225   192002   +50777     
  Branches      22529    29412    +6883     
============================================
+ Hits          78499   121554   +43055     
- Misses        56072    60918    +4846     
- Partials       6654     9530    +2876     
Flag Coverage Δ
custom-integration1 100.00% <ø> (ø)
integration 100.00% <ø> (ø)
integration1 100.00% <ø> (ø)
integration2 0.00% <ø> (ø)
java-11 63.20% <ø> (+7.67%) ⬆️
java-21 63.28% <ø> (+7.72%) ⬆️
temurin 63.30% <ø> (+7.72%) ⬆️
unittests 63.30% <ø> (+7.72%) ⬆️
unittests1 55.58% <ø> (ø)
unittests2 34.30% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@xiangfu0 xiangfu0 merged commit 9401730 into apache:master Mar 15, 2026
53 of 54 checks passed
@xiangfu0 xiangfu0 added the ci/cd Related to CI/CD pipelines and automation label Mar 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci/cd Related to CI/CD pipelines and automation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants