Skip to content

Show Dag Run conf column by default in Dag Runs list#68904

Merged
pierrejeambrun merged 2 commits into
apache:mainfrom
ashutosh264:ui-show-dag-run-conf-column
Jul 8, 2026
Merged

Show Dag Run conf column by default in Dag Runs list#68904
pierrejeambrun merged 2 commits into
apache:mainfrom
ashutosh264:ui-show-dag-run-conf-column

Conversation

@ashutosh264

@ashutosh264 ashutosh264 commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Airflow 3 already exposed Dag Run conf in the API and defined a Conf column in the Dag Runs table, but the column was hidden by default (conf: false in columnVisibility). That broke AF2 parity for operators who trigger Dags with run conf and need to see it in the list without opening column settings.

This PR makes the Conf column visible by default. Rendering is unchanged — the existing inline RenderedJsonField (collapsed Monaco JSON), consistent with XCom, Assets, and other tables.

Applies to both Browse → Dag Runs (/dag_runs) and Dag → Runs (/dags/:dagId/runs).

closes: #53382

@boring-cyborg boring-cyborg Bot added the area:UI Related to UI/UX. For Frontend Developers. label Jun 23, 2026
@ashutosh264 ashutosh264 changed the title UI: Show Dag Run conf column by default in Dag Runs list UI: Show Dag Run conf in list with compact preview Jun 23, 2026
@ashutosh264

ashutosh264 commented Jun 23, 2026

Copy link
Copy Markdown
Contributor Author

UI Screenshots

  • In specific dag run
image
  • In global dag runs tab
image

@pierrejeambrun pierrejeambrun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR.

I'm fine with showing 'conf' column by default, but can you explain the motivation by replacing the monaco editor with a custom one and then a modal for monaco? (First it's inconsistent with how we display json content in the UI, and also it offers far less features, highlighting, expand/collapse etc...)

Maybe for performance reason (less monaco IDE mounted at once on the same page)? That still makes the content of the conf available through an extra click, and there are plenty of other tables with monaco columns (xcoms, assets, etc...) that currently work fine. If we want to change this, we probably need to change it for all tables and unless it's proven to be a performance bottleneck (with experiment and metrics) I wouldn't be in favor of going in that direction. Also if we want to explore it, I would create a separate PR because we probably want to discuss more about this and not block the 'display config column by default' part.

Also CI need fixing.

Comment thread airflow-core/newsfragments/68904.improvement.rst Outdated
@ashutosh264 ashutosh264 force-pushed the ui-show-dag-run-conf-column branch from 31cb329 to 3bf78bb Compare June 30, 2026 07:03
@ashutosh264

Copy link
Copy Markdown
Contributor Author

Maybe for performance reason (less monaco IDE mounted at once on the same page)? That still makes the content of the conf available through an extra click, and there are plenty of other tables with monaco columns (xcoms, assets, etc...) that currently work fine. If we want to change this, we probably need to change it for all tables and unless it's proven to be a performance bottleneck (with experiment and metrics) I wouldn't be in favor of going in that direction. Also if we want to explore it, I would create a separate PR because we probably want to discuss more about this and not block the 'display config column by default' part.

Thanks for the review, agreed on keeping Monaco inline for consistency with XCom/Assets/etc.

I've dropped the custom preview/dialog (DagRunConfCell) and reverted to the existing RenderedJsonField collapsed cell. The PR now only makes the Conf column visible by default.

Removed the newsfragment per your comment. Rebased onto the latest main to fix CI.

@ashutosh264 ashutosh264 force-pushed the ui-show-dag-run-conf-column branch from d915492 to ccc1704 Compare June 30, 2026 07:09

@pierrejeambrun pierrejeambrun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, can you please update the PR title and description. (And remove UI: that's against our policy).

A couple of suggestions and we should be good to merge.

Comment thread airflow-core/src/airflow/ui/src/pages/DagRuns/DagRuns.test.tsx
Comment thread airflow-core/src/airflow/ui/src/mocks/handlers/dag_runs.ts
@ashutosh264 ashutosh264 changed the title UI: Show Dag Run conf in list with compact preview Show Dag Run conf in list with compact preview Jul 3, 2026
Airflow 3 hid the conf column even though the API and column definition
already existed. Operators triggering Dags with run conf need that
context in the list view without toggling columns manually.

closes: apache#53382
@ashutosh264 ashutosh264 force-pushed the ui-show-dag-run-conf-column branch from 6b5148b to 7805859 Compare July 3, 2026 06:40
@ashutosh264

Copy link
Copy Markdown
Contributor Author

@pierrejeambrun Thanks for the thorough review!

All suggestions are addressed. Please take another look when you have a moment.

@ashutosh264 ashutosh264 changed the title Show Dag Run conf in list with compact preview Show Dag Run conf column by default in Dag Runs list Jul 3, 2026
@bbovenzi

bbovenzi commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

Could you update the screenshots please?

@ashutosh264

ashutosh264 commented Jul 7, 2026

Copy link
Copy Markdown
Contributor Author

Could you update the screenshots please?

@bbovenzi I have updated the screenshots, can you please check?

@ashutosh264

Copy link
Copy Markdown
Contributor Author

Thanks for the review.

One follow-up idea I'd like your take on: show conf content expanded by default in the Dag Runs list (i.e. drop collapsed on the conf cell), rather than the folded { ... } preview users have to open row by row. (If I am not wrong, this case is there in AF2)

Motivation: when I'm triaging or comparing runs, I often want to quickly scan or diff conf values across rows (env, batch id, feature flags, etc.). With the column visible but folded, I still have to expand each row manually, which doesn't help much for search/compare workflows.

Trade-off I'm aware of: expanded JSON will make rows taller and the table noisier, especially for large conf objects — which is probably why XCom/Assets use collapsed previews in list views. Conf might be different, though: it's usually smaller and more often the thing you're looking at on this page.

Questions:

Do you think unfolded conf by default is reasonable on Dag Runs, or should we keep collapsed for consistency with other JSON columns?
If it's worth pursuing, I feel it should be tracked as a separate issue.
Happy to prototype and share a screenshot if that would help the discussion.

@bbovenzi

bbovenzi commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

Looking better!

  1. I think we need to fix our monaco code to show some preview instead of two lines of just {}. But that should be a separate PR
  2. Good point. In other pages (like xcoms) we have an expand/collapse all code blocks button. Let's add that here.

@pierrejeambrun pierrejeambrun added this to the Airflow 3.3.1 milestone Jul 7, 2026
@pierrejeambrun pierrejeambrun added the backport-to-v3-3-test Backport to v3-3-test label Jul 7, 2026
@ashutosh264

Copy link
Copy Markdown
Contributor Author

Makes sense to add expand/collapse like XCom.

I'm working on a follow-up PR to add expand/collapse-all on the Dag Runs page. I'll tackle the Monaco collapsed preview ({...} instead of a useful preview) in a separate PR after that, as suggested.

Will link the follow-up here once it's up.

@ashutosh264

Copy link
Copy Markdown
Contributor Author

Follow-up is up in #69567 - expand/collapse-all on Dag Runs conf, with collapse/expand screenshots. Monaco preview improvement still planned as a separate PR.

@pierrejeambrun pierrejeambrun merged commit 50c44b5 into apache:main Jul 8, 2026
86 checks passed
@boring-cyborg

boring-cyborg Bot commented Jul 8, 2026

Copy link
Copy Markdown

Awesome work, congrats on your first merged pull request! You are invited to check our Issue Tracker for additional contributions.

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Backport successfully created: v3-3-test

Note: As of Merging PRs targeted for Airflow 3.X
the committer who merges the PR is responsible for backporting the PRs that are bug fixes (generally speaking) to the maintenance branches.

In matter of doubt please ask in #release-management Slack channel.

Status Branch Result
v3-3-test PR Link

github-actions Bot pushed a commit to aws-mwaa/upstream-to-airflow that referenced this pull request Jul 8, 2026
…che#68904)

Airflow 3 hid the conf column even though the API and column definition
already existed. Operators triggering Dags with run conf need that
context in the list view without toggling columns manually.
(cherry picked from commit 50c44b5)

Co-authored-by: Ashutosh Shaha <61512480+ashutosh264@users.noreply.github.com>
closes: apache#53382
aws-airflow-bot pushed a commit to aws-mwaa/upstream-to-airflow that referenced this pull request Jul 8, 2026
…che#68904)

Airflow 3 hid the conf column even though the API and column definition
already existed. Operators triggering Dags with run conf need that
context in the list view without toggling columns manually.
(cherry picked from commit 50c44b5)

Co-authored-by: Ashutosh Shaha <61512480+ashutosh264@users.noreply.github.com>
closes: apache#53382
potiuk pushed a commit that referenced this pull request Jul 8, 2026
) (#69604)

Airflow 3 hid the conf column even though the API and column definition
already existed. Operators triggering Dags with run conf need that
context in the list view without toggling columns manually.
(cherry picked from commit 50c44b5)


closes: #53382

Co-authored-by: Ashutosh Shaha <61512480+ashutosh264@users.noreply.github.com>
vatsrahul1001 pushed a commit that referenced this pull request Jul 9, 2026
) (#69604)

Airflow 3 hid the conf column even though the API and column definition
already existed. Operators triggering Dags with run conf need that
context in the list view without toggling columns manually.
(cherry picked from commit 50c44b5)


closes: #53382

Co-authored-by: Ashutosh Shaha <61512480+ashutosh264@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:UI Related to UI/UX. For Frontend Developers. backport-to-v3-3-test Backport to v3-3-test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Parity with Airflow2 run_conf displayed in dag run list

3 participants