Decisionless monitoring: the reports nobody acts on

VigilDesk engineering notes

A monitoring system that reports everything is indistinguishable from one that reports nothing: both train the reader to stop reading. The interesting question is not "how accurate are our alerts" but "what decision does this report change?"

Decisionless is not the same as wrong

When a team deletes most of its reports, the removed ones are usually not false - they are decisionless. Nothing anyone would do differently depended on them. That is a different and much more fixable property than accuracy: a false report can be argued about, a decisionless one can simply be moved to a dashboard.

The test is one sentence long: if this arrives and I do nothing, what have I lost? If the answer is "nothing", it is not an alert.

The two error types must be measured apart

ErrorCost in tradingCost on call
Missed event (false negative)Direct, sometimes terminalDepends entirely on the event
Useless page (false positive)Annoying, cheapExpensive - it trains people to ignore the channel the real event will use

Same system, opposite optimisation. Averaging the two into a single "precision" number hides which one you are trading away, which is why an alerting setup can look well-tuned while being useless in both directions at once.

The metric that actually describes protection

Not alert volume. Not detection latency. The number that corresponds to the thing you were buying is:

After a real breach, how long until the behaviour actually changes?

Time-to-detect is an engineering metric that is easy to instrument. Time-to-effect requires staging a real breach and timing the outcome - which is exactly why it is usually missing, and exactly why adding alerts feels like progress while protection does not move. If you only measure the first, you will look well-instrumented right up until the review.

Three questions to ask of any report

  1. What decision does this change? None -> dashboard, not an inbox.
  2. If it is wrong in each direction, what does each cost? If you cannot answer separately, you cannot tune it.
  3. Is it on the path that can act? A signal that no component consults is a log line with a notification attached.

The pattern behind all of this is the same one that turns risk guards into decoration: something that looks like protection, occupies the attention that protection would need, and does not sit on the path where the decision is actually made.


Related notes

Get the guard

Free MT5 daily-loss guard, source included: https://xuks124.github.io/vigildesk/free.html

Risk disclosure

Algorithmic trading carries both technical and market risk. No tool eliminates the possibility of loss. Nothing on this page is investment advice, and no performance is implied or promised.