Observability
Every number here is computed from the same spans the trace viewer renders, so each one can be clicked down to the request that produced it. A dashboard whose numbers cannot be drilled into is a decoration.
Requests traced
500
most recent 500
End-to-end p50 / p95
25 / 7371 ms
retrieval p95 6279 ms
Token cost per request
$0.00049
52,941 in / 5,747 out total
No-answer rate
7%
4 refusals in the last 60 requests
Retrieval quality (improved)
30%
hit rate · baseline 10%
Groundedness proxy
80%
correct manual present in the context window
Source correctness
80%
right variant and current revision at rank 1
Degraded generations
26
served by the offline provider
Groundedness is not correctness
Faithfulness measures whether the answer follows from the passages it was given. On this corpus
a wrong-variant answer is perfectly faithful, because the wrong torque figure genuinely is in the
retrieved context. Source correctness is the number that belongs on the executive slide;
faithfulness alone would have reported this system as healthy.
Latency distribution
Recent requests
Click any trace id.
| Trace | Name | Mode | Question | ms | Cost | Status |
|---|---|---|---|---|---|---|
| 665f86a5145a43e0 | ask | improved | What is the relief-valve setting on the 4 CFM 3000 PSI charging | 5796 | $0.00000 | refused |
| ab052999ad074d01 | ask | improved | What is the relief-valve setting on the 4 CFM 3000 PSI charging | 15294 | $0.01480 | refused |
| 9903dd6220c949e0 | ask | improved | What is the relief-valve setting on the 4 CFM 3000 PSI charging | 13628 | $0.01756 | ok |
| f937d936bcf345f9 | ask | improved | What is the relief-valve setting on the 4 CFM 3000 PSI charging | 5826 | $0.00000 | refused |
| 6c77c7208da5433e | ask | improved | What is the relief-valve setting on the 4 CFM 3000 PSI charging | 14535 | $0.01480 | refused |
| 4bb198bf44ce4b5e | ask | improved | What is the relief-valve setting on the 4 CFM 3000 PSI charging | 13074 | $0.01538 | ok |
| 98bde091496f451a | eval.improved | improved | What is the recommended PID tuning for the variable-speed drive | 1911 | $0.00000 | ok |
| 8d2ff127bce74fb3 | eval.improved | improved | What is the torque spec for the Atlas Copco GA 30 VSD+ gearbox? | 2442 | $0.00000 | ok |
| f854f4bb23a64998 | eval.improved | improved | What is the air intake filter service interval for the Davey 6M1 | 2151 | $0.00000 | ok |
| 8b526f47cfc24b8a | eval.improved | improved | What does Change 1 say about the 125 CFM rotary compressor? | 2016 | $0.00000 | ok |
| 48ec198bec2d4038 | eval.improved | improved | Which model number does the 5 CFM 175 PSI Champion compressor us | 2405 | $0.00000 | ok |
| 78d2e25fac804515 | eval.improved | improved | What is the safe operating pressure and relief-valve setting for | 2107 | $0.00000 | ok |
| 99e226829644439e | eval.improved | improved | How often should compressor pressure gauges be calibrated? | 1803 | $0.00000 | ok |
| 65f830e962fe46a0 | eval.improved | improved | What is the intake valve part number for the 1986 hand-truck mou | 2037 | $0.00000 | ok |
| e7fbc0ffa89e4e33 | eval.improved | improved | Give me the crankcase oil change procedure for the 15 CFM 175 PS | 2318 | $0.00000 | ok |
| e54ccd24c03f4df6 | eval.improved | improved | What is the lubricant level check interval for a reciprocating a | 1882 | $0.00000 | ok |
| d04cfffd0ad64455 | eval.improved | improved | How often should the compressor oil filter be cleaned on the 125 | 1862 | $0.00000 | ok |
| bdcad30d92d44262 | eval.improved | improved | What is the torque spec for the compressor connecting-rod bearin | 2404 | $0.00000 | ok |
| c53af4d1c8c9476b | eval.structure | structure | What is the recommended PID tuning for the variable-speed drive | 8 | $0.00000 | ok |
| 2f19f57ef0274fc5 | eval.structure | structure | What is the torque spec for the Atlas Copco GA 30 VSD+ gearbox? | 8 | $0.00000 | ok |
| 22b2a0c0d80f4d30 | eval.structure | structure | What is the air intake filter service interval for the Davey 6M1 | 7 | $0.00000 | ok |
| c5efcf79cac04301 | eval.structure | structure | What does Change 1 say about the 125 CFM rotary compressor? | 7 | $0.00000 | ok |
| 2262cb1399dc4aac | eval.structure | structure | Which model number does the 5 CFM 175 PSI Champion compressor us | 8 | $0.00000 | ok |
| b4920e609b284424 | eval.structure | structure | What is the safe operating pressure and relief-valve setting for | 8 | $0.00000 | ok |
| c2c64a591cd94abf | eval.structure | structure | How often should compressor pressure gauges be calibrated? | 6 | $0.00000 | ok |
| 05aed594349a4c2d | eval.structure | structure | What is the intake valve part number for the 1986 hand-truck mou | 9 | $0.00000 | ok |
| 0155fb4799cc4cb2 | eval.structure | structure | Give me the crankcase oil change procedure for the 15 CFM 175 PS | 8 | $0.00000 | ok |
| d87fefd6836949c1 | eval.structure | structure | What is the lubricant level check interval for a reciprocating a | 9 | $0.00000 | ok |
| b0be28238dcf4434 | eval.structure | structure | How often should the compressor oil filter be cleaned on the 125 | 8 | $0.00000 | ok |
| 6b8b158e057c42f4 | eval.structure | structure | What is the torque spec for the compressor connecting-rod bearin | 11 | $0.00000 | ok |
| 865b7061a029455e | ask | baseline | What is the torque spec for the compressor connecting-rod bearin | 6850 | $0.01208 | ok |
| 2e2e18795ad049b7 | eval.baseline | baseline | What is the recommended PID tuning for the variable-speed drive | 7 | $0.00000 | ok |
| d166dac604ac4e30 | eval.baseline | baseline | What is the torque spec for the Atlas Copco GA 30 VSD+ gearbox? | 7 | $0.00000 | ok |
| a77708530d7a4b43 | eval.baseline | baseline | What is the air intake filter service interval for the Davey 6M1 | 7 | $0.00000 | ok |
| 2f2f513231224bec | eval.baseline | baseline | What does Change 1 say about the 125 CFM rotary compressor? | 6 | $0.00000 | ok |
| 76a1b49f311f467a | eval.baseline | baseline | Which model number does the 5 CFM 175 PSI Champion compressor us | 7 | $0.00000 | ok |
| d9abf66a36514b3f | eval.baseline | baseline | What is the safe operating pressure and relief-valve setting for | 8 | $0.00000 | ok |
| 832723b91d8d4d58 | eval.baseline | baseline | How often should compressor pressure gauges be calibrated? | 7 | $0.00000 | ok |
| 13fbb0feb4384681 | eval.baseline | baseline | What is the intake valve part number for the 1986 hand-truck mou | 9 | $0.00000 | ok |
| 015ac21f712a43ee | eval.baseline | baseline | Give me the crankcase oil change procedure for the 15 CFM 175 PS | 8 | $0.00000 | ok |
Operational totals
- Tool calls / failures
- 0 / 0
- LLM latency p50 / p95
- 0 / 10289 ms
- Total cost, last 500 requests
- $0.2450
- Error rate
- 0.0%
- Trace store
data/traces.sqlite
Index built by scripts/build_index.py at 2026-08-10 01:44:34 in 711s: 25 documents, 3,146 pages, 12,590 improved chunks / 5,434 naive chunks. Embeddings: Snowflake/snowflake-arctic-embed-s (int8 ONNX, Apache-2.0). Reranker: cross-encoder/ms-marco-MiniLM-L-6-v2 (ONNX, Apache-2.0).