This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
A Model Validation Approach for Various Design Configurations with Insufficient Experimental Data for Model Accuracy Check
Technical Paper
2012-01-0228
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Analytical models (math or computer simulation models) are typically built on the basis of many assumptions and simplifications and hence model prediction could be inaccurate in intended applications. Model validation is thus critical to quantify and improve the degree of accuracy of these models. So far, little work considers model validation for various design configurations so that model prediction is accurate in the intended design space. Furthermore, there is a lack of effective approaches that can be used to quantify model accuracy considering different number of experimental data. To overcome these limitations, objective of this paper is to develop a model validation approach for various design configurations with a reference metric for model accuracy check considering different number of experimental data. Three technical components are proposed to accomplish this goal including: 1) a validation metric using the Bhattacharya distance (B-distance) for model accuracy check with different number of experimental data; 2) the Maximum Entropy Principle (MEP) method for accurate characterization of the model bias; and 3) an approach for constructing response surface of the model bias and accurately predicting system performances in the intended design space. Two examples including a modified vehicle side crash problem and a thermal challenging problem are used to demonstrate the effectiveness of the proposed approach.
Recommended Content
Citation
Xi, Z., Fu, Y., and Yang, R., "A Model Validation Approach for Various Design Configurations with Insufficient Experimental Data for Model Accuracy Check," SAE Technical Paper 2012-01-0228, 2012, https://doi.org/10.4271/2012-01-0228.Also In
References
- Youn, B.D. Jung, B.C. Xi, Z. Kim, S.B. Lee, W.R. A hierarchical framework for statistical model calibration in engineering product development Comput. Methods Appl. Mech. Engrg. 200 2011 1421 1431
- Buranathiti, T. Cao, J. Chen, W. Baghdasaryan, L. Xia, Z.C. Approaches for model validation: methodology and illustration on a sheet metal flanging process J. Mech. Des. 128 2006 588 597
- Yang, X.G. Taenaka, B. Miller, T. Snyder, K. Modeling validation of key life test for hybrid electric vehicle batteries Int. J. Energy Res. 34 2010 171 181
- Madsen, H. Automatic calibration of a conceptual rainfall-runoff model using multiple objectives Journal of Hydrology 235 2000 276 288
- Kennedy, M.C. O'Hagan, A. Bayesian calibration of computer models J. Roy. Statist. Soc., Ser. B 63 2001 425 464
- Xiong, Y. Chen, W. Tsui, K.L. Apley, D.W. A Better Understanding of Model Updating Strategies in Validating Engineering Models Comput. Methods Appl. Mech. Engrg. 198 2009 1327 1337
- Higdon, D. Nakhleh, C. Gattiker, J. Williams, B. A Bayesian calibration approach to the thermal problem Comput. Methods Appl. Mech. Engrg. 197 2008 2431 2441
- Liu, F. Bayarri, M.J. Berger, J.O. Paulo, R. Sacks, J. A Bayesian analysis of the thermal challenge problem Comput. Methods Appl. Mech. Engrg. 197 2008 2457 2466
- McFarland, J. Mahadevan, S. Multivariate significance testing and model calibration under uncertainty Comput. Methods Appl. Mech. Engrg. 197 2008 2467 2479
- Chen, W. Tsui, K. Wang, S. A design-driven validation approach using bayesian prediction models J. Mech. Des. 140 2008 021101
- Hills, R.G. Truncano, T.G. Statistical validation of engineering and scientific models: a maximum likelihood based metric Sandia National Laboratories Albuquerque, NM 2002
- Hill, R.G. Trucano, T.G. Statistical validation of engineering and scientific models: Background Sandia National Laboratories 1999
- Thacker, B.H. Doebling, S.W. Hemez, F.M. Anderson, M.C. Pepin, J.E. Rodriguez, E.A. Concepts of model verification and validation Los Alamos National Lab. Los Alamos 2004
- Babuska, I. Oden, J.T. Verification and validation in computational engineering and science: basic concepts Comput. Methods Appl. Mech. Engrg. 193 2004 4057 4066
- Li, J. Mourelatos, Z.P. Kokkolaras, M. Papalambros, P.Y. Validating designs through sequential simulation-based optimization ASME 2010 International Design engineering Technical Conferences & Computers and Information in Engineering Conference Aug. 15 18 2010 Montreal, Quebec, Canada
- Berger, J.O. Statistical decision theory and Bayesian analysis Springer-Verlag New York 1985
- Zhang, R. Mahadevan, S. Bayesian methodology for reliability model acceptance Reliab. Engrg. System Safety 80 2003 95 103
- Hill, R.G. Dowding, K.J. Multivariate approach to the thermal challenge problem Comput. Methods Appl. Mech. Engrg. 197 2008 2442 2456
- Brandyberry, M.D. Thermal problem solution using a surrogate model clustering technique Comput. Methods Appl. Mech. Engrg. 197 2008 2390 2407
- Rutherford, B.M. Computational modeling issues and methods for the “regulatory problem” in engineering - Solution to the thermal problem Comput. Methods Appl. Mech. Engrg. 197 2008 2480 2489
- Ferson, S. Oberkampf, W.L. Ginzburg, L. Model validation and predictive capability for the thermal challenge problem Comput. Methods Appl. Mech. Engrg. 197 2008 2408 2430
- Xi, Z. Hu, C. Youn, B.D. A Comparative Study of Probability Estimation Methods for Reliability Analysis Structural and Multidisciplinary Optimization 10.1007/s00158-011-0656-5 2011
- Youn, B.D. Xi, Z. Wang, P. The eigenvector dimension reduction (EDR) method for sensitivity-free uncertainty quantification Struct. Multidisc. Optim. 37 2008 13 28
- Lee, S.H. Chen, W. 2009 “A Comparative Study of Uncertainty Propagation Methods for Black-Box Type Problems,” Structural and Multidisciplinary Optimization 37 3 239 253
- Hu, C. Youn, B.D. 2009 “Adaptive-Sparse Polynomial Chaos Expansion for Reliability Analysis and Design of Complex Engineering Systems,” ASME 2009 IDETC-CIE San Diego, California, USA
- Grestner, T. Griebel, M. Dimension-adaptive tensor-product quadrature Computing 71 2003 65 87
- Ganapathysubramanian, B. Zabaras, N. Sparse grid collocation schemes for stochastic natural convection problems J Comput Phys 225 2007 652 685
- Ma, X. Zabaras, N. An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations J Comput Phys 228 2009 3084 3113
- Jaynes, E.T. Information Theory and Statistical Mechanics - I Physical Review 1957 620 630
- Mead, L.R. Papanicolaou, N. Maximum Entropy in the Problem of Moments Journal of Mathematical Physics 25 1984 2404 2417
- Dowding, K.J. Pilch, M. Hills, R.G. Formulation of the thermal problem Comput. Methods Appl. Mech. Engrg. 197 29-32 2008 2385 2389
- Youn, Byeng D. Choi, K.K. Gu, L. Yang, Ren-Jye 2004 “Reliability-Based Design Optimization for Crashworthiness of Side Impact,” Structural and Multidisciplinary Optimization 26 3-4 272 283
- Schwer, L.E. An overview of the PTC 60/V&V 10: guide for verification and validation in computational solid mechanics Engineering with Computers 23 2007 245 252
- Johnson, N.L. Kotz, S. Balakrishnan, N. Continuous univariate distributions New York Wiley 1994