Skip to content

Document GlueJobOperator support for OpenLineage Spark injection#69652

Open
mobuchowski wants to merge 1 commit into
apache:mainfrom
mobuchowski:openlineage-doc-glue-spark-injection
Open

Document GlueJobOperator support for OpenLineage Spark injection#69652
mobuchowski wants to merge 1 commit into
apache:mainfrom
mobuchowski:openlineage-doc-glue-spark-injection

Conversation

@mobuchowski

@mobuchowski mobuchowski commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

The GlueJobOperator has supported automatic OpenLineage parent job and transport information injection since it was added to the operator, but the Spark integration guide never listed it.

Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

Generated-by: [Claude Code] following the guidelines

The GlueJobOperator has supported automatic OpenLineage parent job and
transport information injection since it was added to the operator, but
the Spark integration guide never listed it, leaving users unaware that
the same [openlineage] settings apply to Glue jobs.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants