A New Measure for Decision-Making under Uncertainty

© 2025 EPFL

© 2025 EPFL

Decision-makers in business, finance, and policy frequently face situations where the best course of action is unclear—not because outcomes are risky in a probabilistic sense, but because essential information is missing. A new study by Prof. Thomas A. Weber (Chair of Operations, Economics and Strategy, EPFL) introduces a general metric to quantify such uncertainty based on observed decisions and outcomes. The paper, titled “A Measure of Decision-Based Payoff Uncertainty,” was presented at the 6th International Conference on Problems of Cybernetics and Informatics (PCI) and published by IEEE.

The proposed concept of decision-based payoff (DBP) uncertainty provides a practical way to assess how far real-world decisions deviate, on average, from what could have been achieved with full information. Unlike traditional measures of uncertainty that depend on subjective beliefs or probability models, DBP uncertainty relies purely on realized payoffs. It is defined as the average relative regret, which corresponds to the discrepancy of the optimal to the actual outcome, relative to the optimal outcome, yielding a performance indicator between zero and one. This makes it broadly comparable across different decision problems and application domains.

Importantly, the paper [1] shows that DBP uncertainty is consistent with the standard economic notions of first- and second-order stochastic dominance, which enables the comparison of decision quality across uncertain environments. A numerical application involving investment in a European call option demonstrates how the measure captures the informational limits of decision-making in financial markets.

Beyond its immediate analytical appeal, the new measure provides a decision-centered perspective on uncertainty: Rather than asking how well beliefs describe the world, it asks how well decisions perform given the information available. This approach can be used to evaluate managerial, engineering, or policy decisions made under ambiguity, where probabilistic models are either unavailable or unreliable.

This research builds on earlier work at the Chair of Operations, Economics and Strategy on relatively robust decision-making, which focuses on ensuring reliable performance under incomplete information [2–7].

Abstract: We introduce decision-based payoff (DBP) uncertainty as a novel measure of informational uncertainty in decision-making. It is defined over an observed sample of nonnegative payoffs from past decisions, evaluated as a fraction of an ex-post optimal payoff benchmark. The resulting distribution of relative payoffs is supported on a subset of the unit interval. DBP uncertainty, taking values between zero and one, quantifies the average deviation from optimality: It vanishes when optimal payoffs are always achieved and reaches one when observed payoffs are consistently zero despite the availability of strictly positive outcomes. The measure is compatible with first- and second-order stochastic dominance and enables meaningful comparisons across decision problems with nonnegative payoffs. It is equal to the average relative regret and vanishes for degenerate problems with singleton action sets, regardless of the observed outcomes. A numerical example involving investment in a call option under uncertain asset prices illustrates the concept's applicability and interpretability.

References

[1]  Weber, T.A. (2025) “A Measure of Decision-Based Payoff Uncertainty,” 6th International Conference on Problems of Cybernetics and Informatics (PCI), IEEE, pp. 1—5.        
[DOI: https://doi.org/10.1109/PCI66488.2025.11219738]

[2]  Weber, T.A. (2025) “Relatively Robust Multicriteria Decisions,” Management Science, Articles in Advance, pp. 1—29.      
[DOI: https://doi.org/10.1287/mnsc.2025.00510]*

[3] Weber, T.A. (2025) “Relatively Robust Economic Order Quantity with Optimal Laplacian Confidence Intervals,” International Research Conference on Smart Computing and Systems Engineering (SCSE), IEEE, pp. 1—6.          
[DOI: https://doi.org/10.1109/SCSE65633.2025.11030973]

[4]  Weber, T.A. (2025) “Monopoly Pricing with Unknown Demand,” Scandinavian Journal of Economics, Vol. 127, No. 1, pp. 235–285.           
[DOI: https://doi.org/10.1111/sjoe.12564]*

[5]  Weber, T.A. (2024) “Optimal Depth of Discharge for Electric Batteries with Robust Capacity-Shrinkage Estimator,” 4th International Conference on Smart Grid and Renewable Energy (SGRE), Doha, Qatar, pp. 1–5.   
[DOI: https://doi.org/10.1109/SGRE59715.2024.10428801]

[6]  Weber, T.A. (2023) “Relatively Robust Decisions,” Theory and Decision, Vol. 94, No. 1, pp. 35–62.
[DOI: https://doi.org/10.1007/s11238-022-09866-z]*

[7]  Han, J. and Weber, T.A. (2023) “Price Discrimination with Robust Beliefs,” European Journal of Operational Research, Vol. 306, No. 2, pp. 795–809.
[DOI: https://doi.org/10.1016/j.ejor.2022.08.022]*

(*Open Access)