Figures of merit for simultaneous inference and comparisons in simulation experiments

2015 John Wiley & Sons, Ltd. This article considers the traditional figures of merit, namely, bias and mean squared (prediction) error, which are typically used to evaluate simulation experiments. We propose functions of them that account for different variables' units; these alternative figures of merit are closely tied to simultaneous multivariate inference on an unknown parameter vector or unknown state vector. Their usefulness is illustrated in a simulation experiment, where the goal is to determine the statistical properties associated with prediction of a multivariate state.