Direct Quantile Function Estimation Using Information Principles and Its Applications in Reliability Analysis

Document Type : Original Research Article

Author

Department of Civil Engineering, Lakehead University, Thunder Bay, ON, P7B5E1 Canada

Abstract

Jaynes's information principle, i.e., maximum entropy principle (MEP), constrained by probability weighted moments (PWM), has been well established as an alternative method to directly estimate quantile functions (QF) from samples of a random variable. The existence, unbiasedness, and efficiency of the maximum entropy QFs have been illustrated in the literature. However, the issue of how many orders of PWMs is optimal for a given sample of data remains unsolved, and applications of the maximum entropy QFs to reliability analysis in civil engineering are still obscure. This paper serves four main purposes: (1) a new general formulation is developed for the PWM-based MEP without sample normalization; (2) the optimal order of PWMs in MEP is determined by another information principle, i.e., Akaike information criterion; (3) The feasibility of the proposed maximum entropy QFs is illustrated by two case studies in probabilistic modeling of the soil undrained shear strength and the flood frequency; (4) applications of the proposed maximum entropy QFs are substantiated in QF-based first order reliability analysis of a cantilever steel beam with uncorrelated random variables and with correlated random variables. The maximum entropy QFs are compared to common empirical probability distributions, such as normal and lognormal distributions, in reliability analysis to demonstrate the advantages and disadvantages of the method developed.

Keywords

Main Subjects

References

  1. Haldar and S. Mahadevan. Probability, Reliability and Statistical Methods in Engineering Design. John Wiley, New York, 2000.
  2. Holicky. Introduction to Probability and Statistics for Engineers, Springer, 2013.
  3. Paloheimo and M. Hannus. “Structural design based on weighted fractiles.” Journal of the Structural Division -ASCE, Vol. 100, No. ST7, pp. 1367-1378, 1974.
  4. Nishino, A. Hasegawa, C. Miki, and Y. Fujino. “A fractile-based reliability structural design.” Journal of Japan Society of Civil Engineers, No. 326, pp. 141-153, 1982.
  5. Moustapha, B. Sudret, J. Bourinet, and B. Guillaume. “Quantile-based optimization under uncertainties using adaptive kriging surrogate models.” Structural and Multidisciplinary Optimization, Vol. 54, No. 6, pp. 1403-1421, 2016.
  6. Zhang and A. Shafieezadeh. “A quantile-based sequential approach to reliability-based design optimization via error-controlled adaptive Kriging with independent constraint boundary sampling.” Structural and Multidisciplinary Optimization. Vol. 63, pp. 2231–2252, 2021.
  7. Li, H. Yang, and G. Zhao. “A new efficient decoupled reliability-based design optimization method with quantiles.” Structural and Multidisciplinary Optimization, Vol. 61, No. 2, pp. 635–647, 2020.
  8. He, H. Yang, G. Zhao, Y. Zeng, and G. Li. “A quantile-based sora method using maximum entropy method with fractional moments.” Journal of Mechanical Design, Vol. 143, No. 4, pp. 041702.
  9. Ching, and K.K. Phoon. “A quantile-based approach for calibrating reliability-based partial factors.” Structural Safety, Vol. 33, No. 4-5, pp. 275-285, 2011.
  10. Gilchrist. Statistical Modelling with Quantile Functions. Chapman & Hall/CRC, 2000.
  11. D. Pandey. “Direct estimation of quantile functions using the maximum entropy principle.” Structural Safety, Vol. 22, No. 1, pp. 61–79, 2000.
  12. Deng and M.D. Pandey. “Using partial probability weighted moments and partial maximum entropy to estimate quantiles from censored samples.” Probabilistic Engineering Mechanics, Vol. 24, No. 3, pp. 407-417, 2009.
  13. Holicky. Reliability Analysis for Structural Design. SUNN MeDIA, Stellenbosch, 2009.
  14. Sugiyama, Y. Fujino, and M. Ito. “A method to determine fractile values from statistical data.” Proc. of JSCE Structural Engineering /Earthquake Engineering, Vol. 2, No. 2, pp. 45-55, 1985.
  15. Schöbi and B. Sudret. “PC-Kriging: a new meta-modelling method and its applications to quantile estimation.” In: J. Li and Y. Zhao (eds). Proceedings of the 17th IFIP WG7.5 conference on reliability and optimization of structural systems, Taylor & Francis, New York, 2014.
  16. Razaaly, D. Crommelin, and P.M. Congedo. “Efficient estimation of extreme quantiles using adaptive kriging and importance sampling.” International Journal for Numerical Methods in Engineering, Vol. 121, No. 9, pp. 2086-2105, 2020.
  17. Shen, M. Ohsaki, and M. Yamakawa. “Quantile-based sequential optimization and reliability assessment for shape and topology optimization of plane frames using L-moments.” Structural Safety, Vol. 94, pp. 102153, 2022.
  18. Zhang, Y.M. Low, and C.G. Koh. “Maximum entropy distribution with fractional moments for reliability analysis.” Structural Safety, Vol. 83, pp. 101904, 2020.
  19. Cicirello and R.S. Langley. “Probabilistic assessment of performance under uncertain information using a generalized maximum entropy principle.” Probabilistic Engineering Mechanics, Vol. 53, pp. 143-153, 2018.
  20. A. Greenwood, J.M. Landwehr, N.C. Matalas, and J.R. Wallis. “Probability weighted moments: definition and relation to parameters of several distributions expressible in inverse form.” Water Resource Research, Vol. 15, No. 5, pp. 1049-1054, 1979.
  21. R.M. Hosking and J.R. Wallis. Regional Frequency Analysis: An Approach Based On L-Moments. UK: Cambridge University Press, 1997.
  22. D. Pandey. “Extreme quantile estimation using order statistics with minimum cross-entropy principle.” Probabilistic Engineering Mechanics, Vol. 16, No. 1, pp. 31-42, 2001.
  23. P. Singh. Entropy Theory in Hydrologic Science and Engineering. McGraw-Hill Education, 2015.
  24. P. Singh. Entropy Theory in Hydraulic Engineering: An Introduction. American Society of Civil Engineers, 2014.
  25. Deng and M.D. Pandey. “Derivation of sample-oriented quantile function using maximum entropy and self-determined probability weighted moments.” Environmetrics, Vol. 21, No. 2, pp.113–132, 2010.
  26. Deng and M.D. Pandey. “Estimation of quantile function from censored samples using partial minimum cross entropy and partial probability.” Journal of Hydrology, Vol. 363, No. 1–4, pp. 18–31, 2008.
  27. Deng and M.D. Pandey. “Optimal maximum entropy quantile function for fractional probability weighted moments and its applications in reliability analysis.” Applied Mathematical Modelling, Vol. 114, pp. 230–251, 2023.
  28. Haktanir and A. Bozduman. “A study on sensitivity of the probability-weighted moments method on the choice of the plotting position formula.” Journal of Hydrology, Vol. 168, No. 1–4, pp. 265-281, 1995.
  29. T. Jaynes. “On the rationale of maximum entropy methods.” Proceedings of IEEE, Vol. 70, pp. 939-952, 1982.
  30. P. Burnham and D.R. Anderson. Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach (2nd ed.), Springer-Verlag, 2002.
  31. N. Kapur and H.K. Kesavan. Entropy Optimization Principles with Applications. Academic Press, 1992.
  32. Akaike. “Information theory and an extension of the maximum likelihood principle,” In: B.M. Petrov and F. Caski (Eds.), Sec. Int. Symp. on Information Theory, Akademiai Kiado, Budapest, pp. 267-281, 1973.
  33. Sakamoto, M. Ishiguro, and G. Kitagawa. Akaike Information Criterion Statistics. Reidel, Dordrecht, 1986.
  34. R. Baker. “Probability estimation and information principles.” Structural Safety, Vol. 9, pp. 97-116, 1990.
  35. L. Novi Inverardi and A. Tagliani. “Maximum entropy density estimation from fractional moments.” Communications in Statistics - Theory and Methods, Vol. 32, pp. 2327-2345, 2003.
  36. B. Dodds, J.P. Burak, and K.D. Eigenbrod. “Nipigon River Landslide.” In: Proceedings of Third International Conference on Case Histories in Geotechnical Engineering. MSO: St. Louis; Paper No 2.49, 1993.
  37. Jay, S. Nagaratnam, and D. Braja. Correlations of Soil and Rock Properties in Geotechnical Engineering. New Delhi: Springer. 2016.
  38. F. Walker. “Vane shear strength testing.” In: M. Ervin (Ed.). In Situ Testing for Geotechnical Investigations. Rotterdam: A A Balkema. pp. 65-72, 1983.
  39. ASTM D2573-08. Standard Test Method for Field Vane Shear Test in Cohesive Soil. ASTM International (ASTM), 2008.
  40. R. Rao and K.H. Hamed. Flood Frequency Analysis. New York: CRC Press, 2000.
  41. C. Lind, H.P. Hong, and V. Solana. “A cross entropy method for flood frequency analysis.” Stochastic Hydrology and Hydraulics, Vol. 3, pp. 191-202, 1989.
  42. Hanief and A.E. Laursen. “Modeling the natural drainage network of the grand river in southern Ontario: agriculture may increase total channel length of low-order streams.” Geosciences, Vol. 9, pp. 46, 2019.
  43. Zhao. Reliability Theory and Applications for Engineering Structures. Dalian: Dalian University of Technology press, 1996.
  44. Zhang and F. Jin. Structural Reliability Computations. Beijing: Scientific Press, 2015.
  45. Yousefzadeh. “Nonparametric Estimation of the Family of Risk Measures Based on Progressive Type II Censored Data.” International Journal of Reliability, Risk and Safety: Theory and Application, Vol. 5, No. 1, pp. 69-75, 2022.
International Journal of Reliability, Risk and Safety: Theory and Application
Volume 5, Issue 2
December 2022
Pages 63-77

Files

History

  • Receive Date: 01 January 2023
  • Revise Date: 16 February 2023
  • Accept Date: 21 February 2023

Share

How to cite

Statistics