ECI Data Ecosystem ConsoleEnterprise Data Ecosystem
Enterprise tenantSigned in as J. Whitcomb, Data PlatformNov 04, 2026 02:05

Monitoring

Query, pipeline, freshness and cost monitoring across the virtualization engine, the ingestion pipelines and the transformation layer, so an administrator can tell whether a slowdown comes from a source system, a pipeline, the query engine or a workload.

Data freshness by layer

LayerLast successful refreshDetailSource of truth
Bronze2026-11-02 06:46211 loads, 1 failedPipeline load log
Silver2026-11-02 23:32:3310 of 10 models succeededdbt run results
Gold2026-11-02 23:32:3310 of 10 models succeededdbt run results
OMOP2026-11-02 23:32:337 of 7 models succeededdbt run results

Federated query activity by source

CatalogQueriesAverage secondsSlowest seconds
lakehouse360.111.28
mariadb360.111.28
mssql350.141.28

Pipeline runs (bronze ingestion)

run_idsourcetable_namerowsstartedfinishedstatusmessage
211mariadb.edwreport_registry452026-11-02 06:462026-11-02 06:46SucceededLoaded 45 rows
210mariadb.edwcost_center_actuals3,3902026-11-02 06:462026-11-02 06:46SucceededLoaded 3390 rows
209mariadb.edwdim_department152026-11-02 06:452026-11-02 06:45SucceededLoaded 15 rows
208mariadb.edwpayer_contract72026-11-02 06:452026-11-02 06:45SucceededLoaded 7 rows
207mariadb.edwclaim_line123,4102026-11-02 06:432026-11-02 06:45SucceededLoaded 123410 rows
206mariadb.edwclaim75,8942026-11-02 06:412026-11-02 06:42SucceededLoaded 75894 rows
205legacy_emr.dbopathology_report3,4222026-11-02 06:412026-11-02 06:41SucceededManual rerun by on-call data engineer after source timeout; batch size reduced to 250 rows. Loaded 3422 rows
204legacy_emr.dbopathology_report02026-11-02 02:132026-11-02 02:18FailedRead timed out after 300 s on legacy_emr.dbo.pathology_report while streaming nvarchar(max) column report_text; transaction rolled back, 0 rows committed
203legacy_emr.dbolab_result259,2342026-11-02 02:082026-11-02 02:13SucceededLoaded 259234 rows
202legacy_emr.dbomedication_order57,4842026-11-02 02:072026-11-02 02:08SucceededLoaded 57484 rows
201legacy_emr.dboprocedure_event131,4672026-11-02 02:042026-11-02 02:07SucceededLoaded 131467 rows
200legacy_emr.dbodiagnosis116,1512026-11-02 02:022026-11-02 02:04SucceededLoaded 116151 rows

Slowest recent queries

QueryCatalogsSecondsState
SELECT dd.service_line, c.payer, count(DISTINCT sp.enterprise_patient_id) AS patients, cou
eci-console-virtual-edw		lakehouse, mariadb, mssql1.28FINISHED
SELECT dd.service_line, c.payer, count(DISTINCT sp.enterprise_patient_id) AS patients, cou
eci-console-virtual-edw		lakehouse, mariadb, mssql1.12FINISHED
select count(*) from mssql.dbo.patient
eci-console		mssql0.38FINISHED
select count(*) from mssql.dbo.patient
eci-console		mssql0.34FINISHED
select count(*) from mssql.dbo.patient
eci-console		mssql0.24FINISHED
EXPLAIN SELECT dd.service_line, c.payer, count(DISTINCT sp.enterprise_patient_id) AS patie
eci-console		lakehouse, mariadb, mssql0.15FINISHED

Transformation models (dbt)

Last run 2026-11-02 23:32:34: 27 of 27 models built, 76 of 76 data tests passed.

ModelSchemaSecondsStatus
fact_encountergold0.05Succeeded
visit_occurrenceomop0.04Succeeded
dp_revenue_cyclegold0.04Succeeded
dim_departmentgold0.04Succeeded
claimsilver0.03Succeeded
procedure_occurrenceomop0.02Succeeded
measurementomop0.02Succeeded
diagnosissilver0.02Succeeded
dim_providergold0.02Succeeded
dp_longitudinal_oncology_recordgold0.02Succeeded

Workspace capacity and cost allocation, current month

WorkspaceDomainCapacityCapacity unit hoursShareBudget useStorage GBChargeback
Data EngineeringIngestion and transformationF64 shared1,760.034.4%
88%
 0.131$316.80
Enterprise ReportingFinance and revenue cycleF64 shared1,420.027.8%
89%
 0.127$255.60
Clinical OperationsClinical operations and qualityF64 shared980.019.2%
89%
 0.104$176.40
Conversion FactoryEHR conversion and reconciliationF32 conversion640.012.5%
71%
 0.001$115.20
Research: I-45678Hematologic Oncology researchF32 research310.06.1%
78%
 0.077$55.80
Research: I-34567GI Oncology researchF32 research0.00.0%
0%
 0.077$0.00

Capacity unit hours are allocated per workspace and charged back at $0.18 per unit hour; storage is measured live per lakehouse schema. Alerts fire at 85 percent of budget.

Recent queries

CreatedSourceCatalogsQuerySecondsState
2026-11-04 02:01eci-consolelakehouseselect count(*) from lakehouse.silver.patient0.02FINISHED
2026-11-04 02:01eci-consolemariadbselect count(*) from mariadb.edw.claim0.02FINISHED
2026-11-04 02:01eci-consolemssqlselect count(*) from mssql.dbo.patient0.07FINISHED
2026-11-04 01:20eci-consolelakehouseselect count(*) from lakehouse.silver.patient0.02FINISHED
2026-11-04 01:20eci-consolemariadbselect count(*) from mariadb.edw.claim0.02FINISHED
2026-11-04 01:20eci-consolemssqlselect count(*) from mssql.dbo.patient0.03FINISHED
2026-11-04 01:19eci-consolelakehouse, mariadb, mssqlEXPLAIN SELECT dd.service_line, c.payer, count(DISTINCT sp.enterprise_patient_id) AS patients, count(*) AS cla0.12FINISHED
2026-11-04 01:19eci-console-virtual-edwlakehouse, mariadb, mssqlSELECT dd.service_line, c.payer, count(DISTINCT sp.enterprise_patient_id) AS patients, count(*) AS claims, sum1.12FINISHED
2026-11-04 01:19eci-consolelakehouseselect count(*) from lakehouse.silver.patient0.02FINISHED
2026-11-04 01:19eci-consolemariadbselect count(*) from mariadb.edw.claim0.02FINISHED
2026-11-04 01:19eci-consolemssqlselect count(*) from mssql.dbo.patient0.05FINISHED
2026-11-04 01:04eci-consolelakehouseselect count(*) from lakehouse.silver.patient0.03FINISHED