This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Solution Verification Linked to Model Validation, Reliability, and Confidence
Technical Paper
2005-01-1774
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
The implementation of Verification and Validation (V&V) of a computational model of a physical system can be simply described as a 4-step process. One of the steps in the 4-step process is that of Solution Verification. Solution Verification is the process of assuring that a model approximating a physical reality with a discretized continuum (e.g. finite element) code converges in each discretized domain to a converged answer on the quantity of validation interest. The modeling reality is that often we are modeling a problem with a discretized code because it is neither smooth nor continuous spatially (e.g. contact and impact) or in relevant physics (e.g. shocks, melting, etc). The typical result is a non-monotonic convergence plot that can lead to spurious conclusions about the order of convergence, and a lack of means to estimate residual error or uncertainty. We offer one emerging technique that enables a quantification of solution verification uncertainty at confidence and order of convergence for monotonic and non-monotonic mesh convergence studies. The method offers insight into code development (convergence order versus that expected), and supplies the quantitative terms needed for inclusion into subsequent model validation, confidence, and reliability analyses.
We show an example of a mesh convergence study where the use of this new method gives results essentially identical to those of the Richardson Extrapolation method in the ideal case. We show a second example of how this method can offer a quantitative estimate of solution verification error and uncertainty in a case of unusually severe non-monotonic convergence.
We are currently developing this uncertainty estimate into a predictive capability estimate as a topic for the future. However, even the procedure we will demonstrate offers a way to quantify the ever present and sometimes severe non-monotonicity observed during mesh convergence studies. The resulting term enters directly into subsequent analyses of model+system assessments of reliability at confidence.
Recommended Content
Authors
Citation
Logan, R. and Nitta, C., "Solution Verification Linked to Model Validation, Reliability, and Confidence," SAE Technical Paper 2005-01-1774, 2005, https://doi.org/10.4271/2005-01-1774.Also In
SAE 2005 Transactions Journal of Passenger Cars: Mechanical Systems
Number: V114-6; Published: 2006-02-01
Number: V114-6; Published: 2006-02-01
References
- Logan, R. W. Nitta, C. K. “Verification & Validation: Process and Levels Leading to Qualitative or Quantitative Validation Statements” SAE Paper 2004-01-1752 , in Reliability and Robust Design in Automotive Engineering, SAE SP-1844, SAE, Warrendale, PA 2004
- Easterling, R. C. “Statistical Foundations for Model Validation: Two Papers” Sandia National Laboratories Feb 2003
- Nitta, C. K. Logan, R. W. “Qualitative and Quantitative Linkages from V&V to Adequacy, Certification, Risk, and Benefit/Cost Ratio” Oct 2004
- Pilch, M.
- Logan, R. W. Nitta, C. K. Chidester, S. K. “Risk Reduction as the Product of Model Assessed Reliability, Confidence, and Consequence” AIAA-2004-1175, 42nd AIAA Aerospace Sciences Meeting Jan 2004
- Richardson, L. F. “The Deferred Approach to the Limit” Trans. Royal Society of London Series A 226 299
- Roache, P. J. Verification and Validation in Computational Science and Engineering Hermosa Publishers Albuquerque, NM 1998
- Eca, L. Hoekstra, M. “An Evaluation of Verification Procedures for CFD Algorithms” 24 th Symposium on Naval Hydrodynamics, Fukuoka, Japan July 2002
- Roache, P. J. “Error Bars for CFD” AIAA-2003-408, 41 st AIAA Aerospace Sciences Meeting Jan 2003
- Oberkampf, W. L. DeLand, S. M. Rutherford, B. M. Diegert, K. V. Alvin, K. F. “Estimation of Total Uncertainty in Modeling and Simulation” Sandia National Laboratories Apr 2000
- Stern, F. Wilson, R. Shao, J. “Statistical Approach to CFD Code Certification” AIAA-2003-410, 41 st AIAA Aerospace Sciences Meeting Jan 2003
- th
- Glimm, J. Hou, S. Lee, Y. H. Sharp, D. Ye, K. “Prediction of Oil Well Production with Confidence Intervals” SPE 66350, Soc. Petroleum Engr. Feb 2001
- Coleman, H. W. Stern, F. DiMascio, A. Campana, E. “The Problem With Oscillatory Behavior in Grid Convergence Studies” ASME J. Fluids Engr 123 438 June 2001