This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Techniques to Avoid Pitfalls in Empirical Modeling
Technical Paper
1999-01-2045
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
The development of a mathematical model that adequately captures and describes the interactions among the various system components is critical to the understanding and control of physical, chemical or biological phenomena. This often involves developing a multivariate model that will be used to forecast future events. Once the model has been proposed, it must be validated to check its adequacy in terms of its ability to forecast future events.
However, such empirical models are subject to a number of pitfalls including overfitting, chance correlation, extrapolation, and lack of parsimony. In this paper, we describe the application of techniques to avoid these problems. The techniques described here are stratified data sampling, cross-validation, summed independent variables, and the use constraints to model complexity.
Although most of these techniques can be applied to any type of data model (e.g. linear, polynomial, non-linear, artificial neural network, etc.), we have studied their application for polynomial autoregressive models with exogenous variables (e.g. PARX). By using these techniques we are able to validate parsimonious models with reduced risk of overfitting, extrapolation, or chance correlation. As applied to PARX models we were able to develop higher order polynomials which significantly reduce forecast errors over traditional linear, autoregressive models.
Authors
Citation
Wojciechowski, E. and Vaccari, D., "Techniques to Avoid Pitfalls in Empirical Modeling," SAE Technical Paper 1999-01-2045, 1999, https://doi.org/10.4271/1999-01-2045.Also In
References
- Box, G.E.B Jenkins, Time Series Analysis, Forecasting and Control Holden Day 1976
- Christodoulatos, C. Vaccari, D.A. Predicting Performance using Multiple Regression with Autocorrelation Water Research 1 1993
- Harris, R.J. A Primer of Multivariate Statistics Academic Press 1975
- Hernandez, E. Arkun, Y. Control of Nonlinear Systems Using Polynomial ARMA Models” AIChE Journal 39 3 446 460 1993
- Tabachnick, B.G. Fidell, L.S. Using multivariate Statistics 2 Harper & Row 1989
- Vaccari, D.A. Christodoulatos, C. Generalized Multiple Regression with Interaction and Nonlinearity for System Identification in Biological Treatment Processes” Trans. Instr. Soc. Am 31 1 97 102 1992
- Vaccari, D.A. Levri, L.A. Multivariable Empirical Modeling of Complex Integrated Systems Biospherics and Life Sciences Conference Orlando, FL January, 1998