Observe

Get insights on every dbt™ schedule

Turn Bolt run history into insights on schedules, models, sources, and tests. See which schedules fail most and how long they take, and which models are slow or fragile. See which sources went stale and which tests keep failing.

nightly runRun #618SuccessCron
See what ran, how long it took and what changed
01Trigger
Scheduled0 4 * * * · UTC
On run completionAfter another schedule
On mergePR merged to main
TurboCIPR opened
On demandAPI · Airflow · Dagster
02Ingest
Sync sources
Fivetran1m 08s
Airbyte52s
dlt41s
Success · 2m 41s
Everything elseAirflow · ADF · Glue · custom
03Transform
Transform & code
dbt build4m 12s
Python script37s
DinoAI agent1m 20s
Success · 6m 09s
04Deliver
Refresh & activate
Tableau44s
PowerBI31s
Hightouch18s
Success · 1m 33s
05Notify
Alert the team
Slack#data-alerts
MS TeamsData platform
Emaildata-team
PagerDutyIncidents
On failure · SLA
Self-healingPipelines that fix themselves

When a run fails, a DinoAI agent diagnoses it in the failure thread, implements a fix, and opens a pull request. It never merges on its own.

bolt-pipeline-healer
Self-healing
DinoAI
fix: null order_total
PR #482 open
GitHub
Runs
Run #618Success
7m 42s · main
Run #614Failed
Self-healing · PR #482
iOSAndroid
Schedules6 active
nightly runCron · Next run in 6h 12m
Success
hourly ingestCron · Started 2m ago
Running
deploy on mergeOn Merge · Last run 3h ago
Success
turbo ciTurboCI · PR #212 · 1m 03s
Success
weekly financeCron · Self-healing · PR #482
Failed
reverse etlOn Completion · After nightly run
Success
./bolt/run_nightly.ymlSchedules as code
schedules:
- name: nightly run
environment: production
git_branch: main
schedule: "0 4 * * *"
timezone: UTC
commands:
- paradime run fivetran-sync
- paradime run airbyte-sync
- dbt build
- python scripts/score.py
- paradime run tableau-refresh
- paradime run hightouch-sync
notifications:
slack_channels:
- channel: '#data-alerts'
events: [failed, sla]
self_healing:
enabled: true
agent_name: bolt-pipeline-healer
Run #618 logs6 steps · 0 failed
04:02:11 Running with dbt=1.9.4
04:02:13 Found 148 models, 312 data tests, 12 sources
04:02:14 Concurrency: 4 threads (target='prod')
04:02:16 1 of 460 START sql table model analytics.stg_orders
04:02:19 1 of 460 OK created sql table model analytics.stg_orders [SUCCESS 1 in 2.41s]
04:06:21 460 of 460 PASS not_null_fct_orders_order_id [PASS in 0.38s]
04:06:23 Finished running 148 models, 312 data tests in 4m 12s
04:06:23 Done. PASS=460 WARN=0 ERROR=0 SKIP=0 TOTAL=460
Executed nodes460 nodes
Success 460Error 0Skipped 0
NodeTypeDuration
stg_ordersmodel2.4s
stg_customersmodel1.9s
fct_ordersmodel38.2s
dim_customersmodel12.6s
mart_revenuemodel21.0s
orders_snapshotsnapshot6.1s
not_null_fct_orders_order_idtest0.4s
unique_dim_customers_customer_idtest0.3s
country_codesseed0.9s
Model timeline4m 12s · 4 threads
CompileExecute
Thread 1
stg_orders
fct_orders
mart_revenue
Thread 2
stg_customers
dim_customers
rpt_customer_ltv
Thread 3
stg_products
fct_order_items
mart_inventory
Thread 4
stg_payments
fct_payments
data tests
0s1m2m3m4m
Schedule runtimeLast 14 runs
RuntimeAnomaly detected
Typical 7m 36sRun #614 · 16m 24s
Run #605Run #618
Lineage diffPR #212
models/staging/stg_orders.sql
- order_total
+ order_amount
5 downstream nodes impacted
fct_orders.order_totaldbt™ model
mart_revenue.total_revenuedbt™ model
Revenue overviewTableau dashboard
Exec KPIsLooker dashboard
Sales pipelineThoughtSpot liveboard

Features

Everything dbt™ monitoring gives you

Insights from your production runs so you can drive your roadmap what needs fixing

Executed Nodes

See what was executed in each dbt™ run and deep dive into models, and tests that failed.

Model timeline

Find which are your long-running and bottleneck models and how you can make your pipeline run faster.

Console logs

Get access to the logs of every command that was run and switch to the DinoAI summary to see what's broken and then fix with DinoAI agents.

Command artifacts

View every SQL and DDL statement that was executed on the warehouse or download logs for further analysis.

Schedule durations

Use the schedules dashboard to deep dive into your longest schedules, root cause and DinoAI recommended fixes to improve speed and reduce cost.

Execution time history

Find outliers in your schedule execution so that you can find what code changes drove that.

Workflows

What you answer with pipeline observability

The questions a data team gets asked, and where the answer lives.

Join industry leaders winning with DinoAI agents

Data engineers and analysts at the most AI-native startups and enterprises use Paradime's DinoAI agents everyday to become market leaders.