The Use of Expert Judgement Methods for Deriving Accident Probabilities in Aviation

  • Benedikt Badanik University of Zilina, Faculty of Operation and Economics of Transport and Communications
  • Martin Janossy Air Navigation Services of the Czech Republic
  • Arthur Dijkstra
Keywords: expert judgment, classical model, Excalibur software, accident probability


Improving safety has always been the top interest in the aviation industry. The outcomes of safety and risk analyses have become much more thorough and sophisticated. They have become an industry standard of safety investigations in many airlines nowadays. In the past, airlines were much more limited in answering the questions about hazardous situations, accident probabilities, and accident rates. Airlines try hard to cope with stricter safety standards. The objective of this paper is to find out and quantify the extent of the expert judgment in helping airlines in the evaluation of the Flight Data Monitoring (FDM) events. On top of that, the paper reveals the method for a careful choice of experts, so that their estimations will maximize the potential of an accurate and useful outcome. Also, the paper provides details of implementation of the classical model into this research, then continues with the calculations and visualization of the outcomes. The outcomes are probability distributions per each aircraft type, then per IATA accident type and finally per FDM event.


Ažaltovič V, Škvareková I, Pecho P, Kandera B. Calculation of the Ground Casualty Risk during Aerial Work of Unmanned Aerial Vehicles in the Urban Environment. In: Stopkova M, Bartuška L, Stopka O. (eds.) Transportation Research Procedia - Proceedings of the LOGI 2019 conference - Horizons of autonomous mobility in Europe, 14 – 15 November 2019, České Budějovice, Czech Republic. Amsterdam, NL: Elsevier; 2020. p. 271-275.

Unal R, Keating C, Conway B, Chytka T. Development of an expert judgment elicitation and calibration methodology for risk analysis in conceptual vehicle design. Old Dominion University. Report number: 130012, 2004.

Tyshenko MG, El Saadany S, Oraby T, Darshan S, Catford A, Aspinall W, Krewski D. Expert judgment and re-elicitation for prion disease risk uncertainties. International Journal of Risk Assessment and Management (IJRAM). 2012;6(1-3): 234-248. Available from: [Accessed 17th May 2014].

Galieriková A, Materna M, Sosedová J. Analysis of risks in aviation. In: Ostaševičius V. (ed.) Transport Means – Proceeding of the 8th International Scientific Conference, 30 September – 2 October 2008, Kaunas, Lithuania. Kaunas, LT University of Technology; 2008. p. 1427-1431.

Berlowitz I. Transport aircraft human errors quantification. In: Proceedings of the 59th Israel Annual Conference on Aerospace Sciences 2019. 6-7 March 2019, Tel-Aviv and Haifa, Israel. Technion Israel Institute of Technology; 2019. p. 693-786.

Sedláčková AN, Kurdel P, Mrekaj B. Synthesis criterion of ergatic base complex with focus on its reliability. In: Novitzká V, Korečko Š, Szakál A. (eds.) Proceedings of the 2017 IEEE 14th International Scientific Conference on Informatics – INFORMATICS´ 2017, 14-16 November 2017, Poprad, Slovakia. Košice, Slovakia: TU Košice; 2017. p. 318-321.

Bugaj M. Aircraft maintenance – New trends in general aviation. Promet – Traffic&Transportation. 2005;17(4): 231-234.

Guo Y, Sun Y. Flight safety assessment based on an integrated human reliability quantification approach. PLoS ONE. 2020;15(4). DOI: 10.1371/journal.pone.0231391 [Accessed 16th Sept 2020].

Novak A, Skultety F, Bugaj M, Jun F. Safety studies on GNSS instrument approach at Zilina airport. In: Andoga R. (ed.) Proceedings of the MOSATT 2019 International Scientific Conference, 28-29 November 2019, Košice, Slovakia. Piscataway, New Jersey; 2019. p. 122-125.

O'Hagan A, Buck CE, Daneshkhah A, Eiser JR, Garthwaite PH, Jenkinson DJ, Rakow T. Uncertain Judgements: Eliciting Experts' Probabilities. Sheffield, UK: John Wiley & Sons, Ltd.; 2006.

Meyer M, Booker J. Eliciting and analyzing expert judgment: A practical guide. Office of Nuclear Regulatory Research, Division of Systems Research. Report number: NUREG/CR-5424, 1990.

Burgman M, Fidler F, McBride M, Walshe T, Wintle B. Eliciting Expert Judgments: Literature Review. Australian Centre for Excellence in Risk Analysis. Report number: 1, 2006.

Cooke RM. Experts in uncertainty. New York, NY: Oxford University Press; 1991.

Aspinall W. Expert judgment elicitation using the classical model and excalibur, Briefing notes for Seventh Session of the Statistics and Risk Assessment Section´s International Expert Advisory Group on Risk Modeling. Willy Aspinall; 2008. Available from: [Accessed 17th March 2020].

Aspinall WP, Bailey L, Hincks TK, Poole M, Sparks RS. Development of a Bayesian Belief Network to assess variant Climate Change Scenarios. Bristol, UK: University of Bristol, 2008.

Kazda A, Caves R. Airport design and operation. 3rd ed. Bingley, UK: Emerald Group Publishing Limited; 2015.

Janossy M. Email sent to Cooke RM. 5th May 2015.

Cooke RM, Goossens LJ. Procedures guide for structured expert judgment. Delft University of Technology Delft. Report number: ETNU-CT93-0104-NL, 1999.

How to Cite
Badanik B, Janossy M, Dijkstra A. The Use of Expert Judgement Methods for Deriving Accident Probabilities in Aviation. Promet - Traffic&Transportation. 2021;33(2):205-16. DOI: 10.7307/ptt.v33i2.3634