Research Log #002

Can decision quality be measured?

Category: Research · Status: Published · June 2026

Question

Can decision quality be measured?

Most people evaluate decisions by their outcomes.

A successful result is often interpreted as evidence of a good decision.

A failed result is often interpreted as evidence of a bad one.

But is that actually true?

Observation

Outcomes and decisions are not always the same thing.

A driver may follow every safety rule and still become involved in an accident caused by another person.

The outcome is negative.

The decision process may still have been sound.

The opposite can also occur.

An investor may place all available capital into a single speculative position.

The position increases in value.

The outcome is positive.

The decision process may still have been poor.

These examples suggest that outcomes alone may not be sufficient to evaluate decision quality.

Interpretation

If outcomes can be influenced by factors outside the decision itself, then measuring decisions exclusively through results may be misleading.

A different possibility emerges:

Decision quality may depend on the information available at the moment the decision was made.

It may also depend on:

• the quality of available information
• the reasoning process
• the consideration of risk
• the existence of alternative options

Under this view, a good decision can produce a poor result.

And a poor decision can occasionally produce a good result.

Current Position

EdgeLab currently does not know whether decision quality can be measured objectively.

However, the observations above suggest that outcome quality and decision quality should not automatically be treated as identical.

Consider two people:

• Person A makes a careful decision and receives a poor outcome.
• Person B makes a reckless decision and receives a positive outcome.

If outcomes alone define decision quality, Person B made the better decision.

That conclusion appears questionable.

A working hypothesis emerges:

This hypothesis remains unvalidated.

Next Question

If decision quality is not identical to outcome quality, a further question follows:

This question will be explored in future research.