Release/5.0.1

[aarthy-dk]

Features

• add standard generation set (46d0c11)
• monitors: add volume trend and metric trend tests (4c92f14)
• monitors: add test threshold prediction (20d0c77)
• monitor: use the new table component for the monitor list (ecbd0ea)
• add table monitor dialog and enable monitor suite (9b4f797)
• monitors: display volume trend chart (27c5c6c)
• monitors: display schema anomalies by table (caa52cd)
• monitors: add settings and delete dialogs (3da24e6)
• monitors: use SARIMAX to support excluding weekends and holidays (c2584e8)
• table groups: add standard and monitor suite wizard steps (5cad913)
• connections: add standard and monitor suite steps to wizard (ab25af6)
• monitors: display prediction in volume trend chart (4b78b96)
• monitors: enable notification settings for monitors (edf41c1)
• freshness: add new test - regenerate monitors when needed (a1df201)
• notifications: warn users of duplicate notification deliveries (ae09a53)
• monitors: indicate training mode - display tables when no results (12c38d9)
• monitors: configuration for regenerating freshness (badb908)
• quick-start: Adding Monitoring features (8cc2b04)
• quick-start: Improving monitor data as QA feedback (5570cee)
• monitors: add Table Monitors dialog + misc fixes (cea61bb)
• charts: Replacing the bitnami charts and images (753a7cc)
• monitors: add metric monitors (50319d4)
• monitors: display predicted table freshness events (e1a3455)
• monitors: display threshold lines for volume and metric charts (3774dba)
• ui: add starting at/on offset to cron schedule editor (b975f6f)
• monitors: allow filtering by anomaly types (75533ee)
• monitors: add toggle to show more history in dialog (60ff579)
• monitors: add deep-link to table trends dialog (8c707a0)
• monitors: freshness monitor with gap-based thresholds and schedule inference (7b98b84)

Bug Fixes

• generation set: add dupe rows to standard (a2a47d0)
• monitors: miscellaneous fixes and enhancements (70ab739)
• css: make toolbar styles consistent (aea7e71)
• monitors: remove monitor schedules from test run schedules dialog (c3d3ced)
• monitors: bugs in cli, models and prediction (a10a6b3)
• monitors: update holiday codes and timezones (cfd3b92)
• charts: offset schema chart lines when too short (26e3081)
• security: Fix Docker Scout vulnerabilities (e87b017)
• quick-start: persist the SMTP settings (a210134)
• monitors: filter out undefined items in timestamps list (d043cb5)
• parse dates from int or str properly (c29a3f1)
• profiling: add missing column to CTE (c1b3cdb)
• monitors: sort the points to draw the volume chart path (ac1d0e2)
• monitors: freshness results used for prediction (136db77)
• monitors: misc display updates (9e5cd3d)
• quick-start: update monitor iterations (d3f3936)
• rendering errors in a couple pages (91f04aa)
• Fix Observability export (3283d83)
• monitors: improve tooltips in charts - fix state bug in threshold form (74f0412)
• monitors: improve loading and form (b5c75e3)
• monitors: fix charts height calculation (d9a22a0)
• monitors: configuration and quick start improvements (fce03aa)
• ui: improve loading performance (111fdca)
• monitors: update form states after saving (7318a53)
• ui: lazy load plugin components (a5f6203)
• test-types: update text strings to match docs (ec9c26d)
• monitors: misc style and quick start updates (904767c)
• monitors: conditionally display ticks decimals (74a3655)
• monitors: table trend chart x axis ticks overlap (751236b)
• freshness: numeric overflow errors (883016f)
• test result: history graph broken when NaN values present (50955af)
• emails: bugs in test run and monitor run templates (50666bb)
• add email source to mixpanel events (507c4bb)
• monitors: handle errored monitors (d2ac510)
• tests: fix 28 broken unit tests and restructure test suite (48ad053)
• monitors: handle dropped and re-added tables (80d40e4)
• ui: misc changes to hygiene issues and test results (b2f0381)
• monitors: widen prediction thresholds (09f3319)
• docs: update help links on all pages (74f6a21)
• monitors: reset pagination on filtering (9bc11bc)
• monitors: error on empty state (43e8156)
• data-catalog: display new table/column names in bold (74b4da1)
• monitors: tooltip position in dialog (3add174)
• tests: NULL condition for tolerances applies to 0 values (a501c4f)
• monitors: match anomaly summary in email with UI (92e065d)
• quick-start: update data for freshness anomaly (225d268)
• monitors: constrain volume lower bound for cumulative tables (064ad0c)
• monitors: constrain prediction for volume monitor to be non-negative (5118316)
• monitors: prevent overconfident prediction bounds (67a1afb)
• upgrade script missing schema (075e557)

Refactors

• schedules: reuse logic to sample cron expressions (6ee5df8)
• monitors: add job key for monitor suites (b9765e1)
• wizards: update summary step (1e87866)
• autogeneration: generate volume and schema tests without profiling (087befe)
• table groups: display progress in creation wizard (b9dc4f2)
• notifications: reset form only on edit (de34c5e)
• notifications: sort alphabetically based on the scope (ace6f79)
• monitors: open table monitor charts from anomaly tags (05897cb)
• monitors: display markers on volume chart (91af3f4)
• monitors: expand schema chart markers clickable area (69970a9)
• monitors: visual changes to the table trend charts (8e818ca)
• monitors: use multi-barchart for schema changes (5441dd6)
• monitors: allow hiding changes columns (35c540a)
• monitors: allow sorting by anomalies count (f78c126)
• monitors: dynamic tick width for trends chart (7a04e44)
• monitors: add legend to table trends charts (8ab8065)

Miscellaneous

• move sql templates to yaml files (b2ecbc9)
• work around Streamlit loading of v2 components (26cc8e2)
• monitors: limit shown prediction points to <= lookback (d0c12d0)
• check changes in styling after st upgrade (f2f81cf)

[github-actions]

Coverage Report •

File	Stmts	Miss	Branch	BrPart	Cover	Missing
testgen
__main__.py	394	394	86	0	0%	1–797
testgen/commands
run_launch_db_config.py	27	27	0	0	0%	1–90
run_observability_exporter.py	156	124	38	0	16%	30–33, 37–68, 72–76, 80–102, 106–144, 148–192, 196–201, 205–249, 253–280, 284–298, 302–312, 317–323, 327–330
run_profiling.py	182	182	30	0	0%	1–336
run_quick_start.py	131	131	40	0	0%	1–265
run_test_execution.py	205	205	46	0	0%	1–372
test_generation.py	108	75	26	0	25%	42–68, 83–94, 107–118, 121–122, 128–138, 143–168, 171–197, 206–211
test_thresholds_prediction.py	118	89	34	0	19%	78–81, 84–134, 144–150, 166–255, 271–302
testgen/commands/queries
execute_tests_query.py	203	203	42	0	0%	1–415
profiling_query.py	129	129	28	0	0%	1–266
refresh_data_chars_query.py	68	37	8	0	41%	46–49, 57–65, 68–101, 105, 113–120, 124–131, 134, 153–154
testgen/common
freshness_service.py	278	232	126	0	11%	75–111, 115, 125–143, 166–184, 194–197, 229–280, 300–339, 343–345, 349–351, 355–360, 364–366, 391–401, 416–435, 447–473, 486–499, 512–564, 576–609
read_yaml_metadata_records.py	108	108	28	0	0%	1–270
time_series_service.py	87	74	22	0	12%	40–113, 118–137, 141–167
testgen/common/database
database_service.py	258	201	60	0	18%	51–65, 69–70, 75, 79–83, 98–128, 138–163, 178–233, 239–248, 254–261, 265–285, 289–291, 295–297, 301–321, 327–339, 349–351, 360–402, 406–438
testgen/common/models
entity.py	115	64	14	0	40%	26, 29–32, 44–49, 53, 63–77, 82–84, 88, 99–110, 114, 118–123, 127, 131, 135–136, 140, 143–144, 147–157, 160–164, 167–170
notification_settings.py	156	60	30	0	52%	101–128, 141–151, 154, 157–162, 165–166, 175, 179, 182–183, 201–209, 227–235, 246, 250, 254, 258, 262, 265–269, 280–291, 303, 307, 319–328
scheduler.py	76	33	0	0	57%	38–39, 43–61, 65–73, 77–85, 89, 93, 96–97, 101, 104–107
table_group.py	187	53	12	0	67%	147–148, 155–156, 161–191, 196–352, 356–373, 377–384, 388–424, 428–431, 434–448
test_definition.py	245	52	12	0	75%	116–120, 160–161, 240–249, 256–263, 270–277, 286–305, 316–341, 352–382, 386–387, 390–403
test_result.py	38	7	2	0	78%	48–66
test_run.py	181	62	14	0	61%	128–133, 137–147, 150–161, 165, 182–274, 277–322, 326–328, 332–342, 346–350, 354–361, 365–367, 370–378, 381–388
test_suite.py	120	31	4	0	72%	81–83, 91–92, 99–100, 105–207, 211–219, 223–230, 234–250, 254–257
testgen/common/notifications
monitor_run.py	86	61	28	0	22%	22, 29, 32, 120, 136, 173–250, 277–310
notifications.py	34	16	2	0	50%	13, 16, 19, 22–30, 33, 39, 42, 45–47, 50, 53, 56
profiling_run.py	51	29	10	0	36%	25, 33, 41, 151, 210, 237–327
score_drop.py	59	37	18	0	29%	20–26, 29, 35, 38, 91, 120–192, 201
test_run.py	63	43	24	0	23%	23, 33, 41, 155, 210, 248–357
testgen/ui
bootstrap.py	55	55	12	0	0%	1–94
testgen/ui/components/utils
component.py	32	20	6	0	32%	14–17, 21–37, 41, 45–52
testgen/ui/components/widgets
__init__.py	20	3	0	0	85%	39–51
page.py	64	42	10	0	30%	20–33, 37–60, 80, 84, 88, 92, 96, 100, 104, 108, 112, 116–119
paginator.py	18	12	8	0	23%	28–47
testgen/ui/navigation
router.py	90	67	16	0	22%	27–28, 32–41, 44–85, 88, 95–97, 100, 103–131, 134–137, 140–146
testgen/ui/pdf
hygiene_issue_report.py	53	53	10	0	0%	1–203
test_result_report.py	73	53	18	0	22%	48–164, 168–200, 204–219, 223–227, 231–253, 260–261
testgen/ui/queries
profiling_queries.py	80	80	14	0	0%	1–569
scoring_queries.py	39	39	10	0	0%	1–204
source_data_queries.py	126	96	36	0	19%	22–74, 82–105, 109–155, 163–185, 191–199, 207–228, 242–263, 269–278
test_result_queries.py	20	12	0	0	40%	19–112, 117–150
testgen/ui/scripts
patch_streamlit.py	92	92	34	0	0%	3–221
TOTAL	11595	8996	2536	2	18%

Tests	Skipped	Failures	Errors	Time
4	0 💤	0 ❌	4 🔥	1m 19s ⏱️