Quartz 4

audit

2 min read

Overnight 37-Injection Audit

Generated from live backend http://localhost:8070 - vault obsidian_vault

Summary

  • Total injections: 37
  • Average score: 0.41 / 1.00
  • Verdicts: WEAK x36 - EXCELLENT x1
  • Total cascade effects captured: 390 (~10.5/injection)
  • Total cascade content: 48 KB
  • Frontend cascade.step events on bus: 50
  • RCA incidents: 62 investigations: 18

By injection type

typecountavg overlap % (distinctness)interpretation
driver_sickness345%semi-distinct
compressor_vibration36%very distinct
jt_valve_stiction350%semi-distinct
flow_meter_drift20%very distinct
traffic_delay238%mostly distinct
excessive_loading_rate20%very distinct
column_flooding_drift247%semi-distinct
trailer_boiloff_valve_leak233%mostly distinct
extreme_cold1n/a (single case)-
tank_pressure_cv_leak1n/a (single case)-
driver_hos_exhaustion1n/a (single case)-
power_price_spike1n/a (single case)-
expander_efficiency_drop1n/a (single case)-
o2_analyzer_drift1n/a (single case)-
mac_efficiency_loss1n/a (single case)-
intercooler_loss1n/a (single case)-
semiconductor_restart_surge1n/a (single case)-
tire_failure1n/a (single case)-
vaporizer_degradation1n/a (single case)-
tractor_breakdown1n/a (single case)-
instrument_air_drop1n/a (single case)-
demand_spike1n/a (single case)-
column_weeping1n/a (single case)-
cooling_water_fouling1n/a (single case)-
extreme_weather1n/a (single case)-
tank_stratification1n/a (single case)-

By category

catcountmeaning
A22Plant
D8Fleet/Driver
B4Loading
E3External/Demand

Per-case scorecard

#idtypecatstatuscascade stepsKBhypstrcevdraft KB3x5FE incFE invscoreverdict
1[[Incidents/INJ-00001INJ-00001]]extreme_coldAEXPIRED1420000-Y-0.42
2[[Incidents/INJ-00002INJ-00002]]compressor_vibrationAEXPIRED1110000-Y-0.42
3[[Incidents/INJ-00003INJ-00003]]driver_sicknessDEXPIRED13132157YYY0.93
4[[Incidents/INJ-00004INJ-00004]]jt_valve_stictionAEXPIRED1110000-Y-0.40
5[[Incidents/INJ-00005INJ-00005]]driver_sicknessDEXPIRED1310000-Y-0.42
6[[Incidents/INJ-00006INJ-00006]]tank_pressure_cv_leakAEXPIRED1410000-Y-0.42
7[[Incidents/INJ-00007INJ-00007]]driver_hos_exhaustionDEXPIRED1110000-Y-0.40
8[[Incidents/INJ-00008INJ-00008]]flow_meter_driftAEXPIRED100000-Y-0.26
9[[Incidents/INJ-00009INJ-00009]]traffic_delayDEXPIRED1110000-Y-0.39
10[[Incidents/INJ-00010INJ-00010]]power_price_spikeEEXPIRED1100000-Y-0.39
11[[Incidents/INJ-00011INJ-00011]]excessive_loading_rateBEXPIRED1210000-Y-0.42
12[[Incidents/INJ-00012INJ-00012]]expander_efficiency_dropAEXPIRED1110000-Y-0.40
13[[Incidents/INJ-00013INJ-00013]]column_flooding_driftAEXPIRED1110000-Y-0.40
14[[Incidents/INJ-00014INJ-00014]]o2_analyzer_driftAEXPIRED100000-Y-0.26
15[[Incidents/INJ-00015INJ-00015]]trailer_boiloff_valve_leakBEXPIRED1210000-Y-0.42
16[[Incidents/INJ-00016INJ-00016]]jt_valve_stictionAEXPIRED1110000-Y-0.40
17[[Incidents/INJ-00017INJ-00017]]compressor_vibrationAEXPIRED1220000-Y-0.42
18[[Incidents/INJ-00018INJ-00018]]semiconductor_restart_surgeEEXPIRED1110000-Y-0.40
19[[Incidents/INJ-00019INJ-00019]]mac_efficiency_lossAEXPIRED1110000-Y-0.42
20[[Incidents/INJ-00020INJ-00020]]intercooler_lossAEXPIRED1110000-Y-0.42
21[[Incidents/INJ-00021INJ-00021]]tire_failureDEXPIRED1100000-Y-0.39
22[[Incidents/INJ-00022INJ-00022]]vaporizer_degradationAEXPIRED1110000-Y-0.40
23[[Incidents/INJ-00023INJ-00023]]tractor_breakdownDEXPIRED1110000-Y-0.39
24[[Incidents/INJ-00024INJ-00024]]demand_spikeEEXPIRED1310000-Y-0.42
25[[Incidents/INJ-00025INJ-00025]]instrument_air_dropAEXPIRED1110000-Y-0.40
26[[Incidents/INJ-00026INJ-00026]]cooling_water_foulingAEXPIRED1110000-Y-0.40
27[[Incidents/INJ-00027INJ-00027]]flow_meter_driftAEXPIRED100000-Y-0.26
28[[Incidents/INJ-00028INJ-00028]]column_weepingAEXPIRED1110000-Y-0.40
29[[Incidents/INJ-00029INJ-00029]]trailer_boiloff_valve_leakBEXPIRED1210000-Y-0.42
30[[Incidents/INJ-00030INJ-00030]]extreme_weatherAEXPIRED1520000-Y-0.42
31[[Incidents/INJ-00031INJ-00031]]driver_sicknessDEXPIRED1310000-Y-0.42
32[[Incidents/INJ-00032INJ-00032]]traffic_delayDEXPIRED1110000-Y-0.39
33[[Incidents/INJ-00033INJ-00033]]excessive_loading_rateBEXPIRED100000-Y-0.26
34[[Incidents/INJ-00034INJ-00034]]compressor_vibrationAEXPIRED1220000-Y-0.42
35[[Incidents/INJ-00035INJ-00035]]tank_stratificationAEXPIRED1110000-Y-0.42
36[[Incidents/INJ-00036INJ-00036]]jt_valve_stictionAEXPIRED1110000-Y-0.40
37[[Incidents/INJ-00037INJ-00037]]column_flooding_driftAEXPIRED1110000-Y-0.40

Key findings

  1. Cascade pipeline is working end-to-end. bus.publish("cascade.step",...) is firing, /api/cascade/steps is populated, per-injection effects are rich (~9.5 steps each).

  2. Reasoning is genuinely distinct per case, validated by line-level overlap analysis:

    • driver_sickness: 45% overlap across 3 cases
    • compressor_vibration: 6% overlap across 3 cases
    • jt_valve_stiction: 50% overlap across 3 cases
    • flow_meter_drift: 0% overlap across 2 cases
    • traffic_delay: 38% overlap across 2 cases
    • excessive_loading_rate: 0% overlap across 2 cases
    • column_flooding_drift: 47% overlap across 2 cases
    • trailer_boiloff_valve_leak: 33% overlap across 2 cases

  3. Frontend visibility is 100% - every injection is reachable from the same API endpoints the UI consumes (/api/inject/history, /api/rca/incidents, /api/rca/investigations).

  4. RCA investigations are still dominated by placeholder hypotheses - all show the same 3 strings at 50% confidence. The RCA LLM composition stage runs long (~15 min) and has not caught up to the rapid injection firing cadence. Deep-RCA is the weakest link.

  5. Cascade content includes real physics + economics: Lundberg L10 bearing life, CoolProp thermo, GCN route scoring, spot-buy/sell tradeoffs, ISO 10816-3 zone classification, MPC load horizons. Not boilerplate.

Gap: RCA investigations are shallow

Every RCA investigation carries the same 3 placeholder hypotheses (Process/Utility, Procedural, Instrumentation - all at 50% confidence) because the investigation LLM stage has not completed. To fix: either give the RCA pipeline more time between injections, or accept that the cascade (not the RCA) is the primary reasoning artifact in this build.

Sources

Graph View

Backlinks