Skip to content

[flink] orphan cleanup job support result audit - #4319

Open
platinumhamburg wants to merge 4 commits into
apache:mainfrom
platinumhamburg:feature-orphan-cleanup-result-audit
Open

platinumhamburg wants to merge 4 commits into
apache:mainfrom
platinumhamburg:feature-orphan-cleanup-result-audit

Conversation

@platinumhamburg

@platinumhamburg platinumhamburg commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Purpose

Closes #4318. Report orphan cleanup results with separate planned and actual counts and explicit scope coverage.

Changes

  • Emit a bounded, versioned text audit protocol with run identity, per-subtask results, rule counters, scope coverage, and terminal integrity.
  • Distinguish dry-run plans from successful deletions and failures.
  • Report incomplete coverage when metadata cannot be resolved or required scans fail. Confirmed empty references are scanned and do not count as active-reference failures.

This branch depends on #3590 and #3591. Its own changes cover result accounting and text audit output.

API and Format

Adds versioned text audit events and the audit cluster-id option. No storage or RPC format changes.

Validation

115 orphan focused tests passed on this branch. The public PR combination passed 120 focused tests and 21 Action integration tests each on Flink 1.18 and 1.20, with no failures or skips. JDK 11 reactor package, Spotless and Checkstyle passed.

Audit-only comparison: platinumhamburg/fluss@958ffb8...4c6f427

The confirmed-empty log and KV bucket integration cases also verify that result events report zero active-reference failures.

@platinumhamburg
platinumhamburg force-pushed the feature-orphan-cleanup-result-audit branch from 3ff0faf to 349c7ab Compare September 14, 2026 07:38
@platinumhamburg platinumhamburg changed the title Feature orphan cleanup result audit [flink] orphan cleanup job support result audit Sep 14, 2026
@platinumhamburg
platinumhamburg force-pushed the feature-orphan-cleanup-result-audit branch 4 times, most recently from d8370f3 to d401b5a Compare September 14, 2026 09:48
@platinumhamburg
platinumhamburg force-pushed the feature-orphan-cleanup-result-audit branch from d401b5a to 4c6f427 Compare September 14, 2026 13:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[flink] Add reliable cleanup result summaries to remove_orphan_files

1 participant