A Loss Function for Box-Constrained Inverses Problems
DOI:
https://doi.org/10.7494/dmms.2008.2.2.79Keywords:
individual behavior, inverse problems, simultaneous equations, optimizationAbstract
A loss function is proposed for solving box-constrained inverse problems. Given causality mechanisms between inputs and outputs as smooth functions, an inverse problem demands to adjust the input levels to make the output levels as close as possible to the target values; box-constrained refers to the requirement that all outcome levels remain within their respective permissible intervals. A feasible solution is assumed known, which is often the status quo. We propose a loss function which avoids activation of the constraints. A practical advantage of this approach over the usual weighted least squares is that permissible outcome intervals are required in place of target importance weights, facilitating data acquisition. The proposed loss function is smooth and strictly convex with closed-form gradient and Hessian, permitting Newton family algorithms. The author has not been able to locate in the literature the Gibbs distribution corresponding to the loss function. The loss function is closely related to the generalized matching law in psychology.
References
Campbell R.C. & Hill R.C. (2006). Imposing parameter inequality restrictions using the principle of maximum entropy. Journal of Statistical Computation and Simulation, 76(11), pp. 985–1000. DOI: https://doi.org/10.1080/10629360600569584.
Golan A., Judge G.G. & Miller D. (1996). Maximum Entropy Econometrics: Robust Estimation with Limited Data. Chichester: John Wiley & Sons. ISBN: 978-0-471-14592-5.
Herrnstein R.J. (1997). The Matching Law: Papers in Psychology and Economics. Rachlin H. & Laibson D.I. (Eds.). Cambridge, MA: Harvard University Press; New York: Russell Sage Foundation.
Layard R. (2006). Happiness: Lessons from a New Science. London: Penguin Books. ISBN: 978-0-14-101690-0.
McCullagh P. & Nelder J.A. (1989). Generalized Linear Models. 2nd Edition. London: Chapman & Hall. DOI: https://doi.org/10.1007/978-1-4899-3242-6.
Prelec D. (1984). The assumptions underlying the generalized matching law. Journal of the Experimental Analysis of Behavior, 41(1), pp. 101–107. DOI: https://doi.org/10.1901/jeab.1984.41-101.
Wichers R. (1996). A Theory of Individual Behavior. San Diego, CA: Academic Press. DOI: https://doi.org/10.1016/B978-0-12-748450-1.X5000-3.
Yoneda K. (2006). A parallel to the least squares for positive inverse problems. Journal of the Operations Research Society of Japan, 49(4), pp. 279–289. DOI: https://doi.org/10.15807/jorsj.49.279.