A Genetic Algorithm-based BP Neural Network Method for Operational Performance Assessment of ATC Sector
Abstract
To assess operational performance of air traffic control sector, a multivariate detection index system consisting of 5 variables and 17 indicators is presented, which includes operational trafficability, operational complexity, operational safety, operational efficiency, and air traffic controller workload. An improved comprehensive evaluation method, is designed for the assessment by optimizing initial weights and thresholds of back propagation (BP) neural network using genetic algorithm. By empirical study conducted in one air traffic control sector, 400 sets of sample data are selected and divided into 350 sets for network training and 50 sets for network testing, and the architecture of genetic algorithm-based back propagation (GABP) neural network is established as a three-layer network with 17 nodes in input layer, 5 nodes in hidden layers, and 1 node in output layer. Further testing with both GABP and traditional BP neural network reveals that GABP neural network performs better
than BP neural work in terms of mean error, mean square error and error probability, indicating that GABP neural network can assess operational performance of air traffic control sector with high accuracy and stable generalization ability. The multivariate detection index system and GABP neural network method in this paper can provide comprehensive, accurate, reliable and practical operational performance assessment of air traffic control sector, which enable the frontline of air traffic service provider to detect and evaluate operational performance of air traffic control sector in real time, and trigger an alarm when necessary.
References
Ball M, Barnhart C, Nemhauser G, et al. Air transportation: irregular operations and control. Handbooks in Operations Research and Management Science. 2007;14(1):1-67.
Bennell JA, Mesgarpour M, Potts CN. Airport runway scheduling. 4OR–Quarterly Journal of Operations Research. 2011;4(2):115-138.
Reich PG. Analysis of long-range air traffic systems: separation standards I. Journal of Navigation. 1966;19(1):88-98.
Reich PG. Analysis of long-range air traffic systems: separation standards II. Journal of Navigation. 1966;19(2):169-186.
Reich PG. Analysis of long-range air traffic systems: separation standards III. Journal of Navigation. 1966;19(3):331-347.
Anderson D, Lin XG. Collision risk model for a crossing track separation methodology. Journal of Navigation. 1996;49(2):337-349.
Brooker P. Lateral collision risk in air traffic systems: a Post-Reich event model. Journal of Navigation. 2003;56(3):399-409.
Brooker P. Longitudinal collision risk for ATC track systems: a hazardous event model. Journal of Navigation. 2006;59(1):55-70.
Xu X, Li D, Li X. Research on safety assessment of flight separation. ACTA Aeronautica et Astronautica Sinica. 2008;29(6):1411-1418.
Li D, Xu X, Li X. Research on safety target levels of air collision. Chinese Journal of Ergonomics. 2008;14(2):41-44.
Brooker P. Aircraft collision risk in the North Atlantic region. Journal of the Operational Research Society. 1984;35(8):695-703.
Cox ME, Harrison D, Moek G, et al. European studies to investigate the feasibility of using 1000 ft vertical separation minima above FL 290, Part I. Journal of Navigation. 1991;44(2):171-183.
Cox M E, Harrison D, Moek G, et al. European studies to investigate the feasibility of using 1000 ft vertical separation minima above FL 290, Part II. Journal of Navigation. 1992;45(1):91-106.
Cox ME, Harrison D, Moek G, et al. European studies to investigate the feasibility of using 1000 ft vertical separation minima above FL 290, Part III. Journal of Navigation. 1993;46(2):245-261.
ICAO. Doc9689-AN/953(1st Edition)-1998. Manual on Airspace Planning Methodology for the Determination of Separation Minima. Montreal, Canada: ICAO; 1998.
Brooker P. P-RNAV, safety targets, blunders and parallel route spacing. Journal of Navigation. 2004;57(3):371-384.
ICAO. Doc9750-AN/963(3rd Edition)-2007. Global Air Navigation Plan. Montreal, Canada: ICAO; 2007. [18] ICAO. Doc9613-AN/937(3rd Edition)-2008. Performance-based Navigation Manual. Montreal, Canada: ICAO; 2008.
ICAO. Doc9883(1st Edition)-2009. Manual on Global Performance of the Air Navigation System. Montreal, Canada: ICAO; 2009.
Kuchar JK, Yang LC. A review of conflict detection and resolution modeling methods. IEEE Transactions on Intelligent Transportation Systems. 2000;4(1):179-189.
Barnhart C, Fearing D, Odoni A, et al. Demand and capacity management in air transportation. EURO Journal on Transportation and Logistics. 2012;1(1-2):135-155.
Pellegrini P, Rodriguez J. Single European sky and single European railway area: A system level analysis of air and rail transportation. Transportation Research – Part A: Policy and Practice. 2013;57(1):64-86.
Wu D. A new model to assess airspace capacity based on controller workload. Journal of Wuhan University of Technology (Transportation Science & Engineering). 2014;38(4):846-849.
Tian Y, Yang S, Wan L, Yang Y. Research on the method of sector dynamic capacity evaluation. System Engineering-Theory & Practice. 2014;34(8):2163-2169.
FAA, EUROCONTROL. 2012 Comparison of Air Traffic Management-Related Operational Performance: U.S./Europe. Washington D.C., U.S.A.: FAA Communications, 2013-AJR-887; 2013.
Li Y, Hu M, Xie H, Peng Y. Terminal area utilization rate evaluation based on extension multi-level state classification. System Engineering and Electronics. 2013;35(12):2533-2539.
Yan S, Yao L, Zhao Y. Research on the Methods of Air Traffic Congestion Measures. Journal of Transportation Engineering and Information. 2009;7(1):11-16.
Zhao Y, Chen K. Air traffic congestion assessment method based on evidence theory. Proceedings of the 2010 Chinese Control and Decision Conference (CCDC 2010). 2010 May 26-28; Xuzhou, China. Institute of Electrical and Electronics Engineers (IEEE); 2010. p. 426-429.
Air Traffic Management Bureau of CAAC. Statistical methods of civil aviation normal flights. Beijing, China: CAAC; 2012.
Samà M, D’Ariano A, Pacciarelli D. Rolling horizon approach for aircraft scheduling in the terminal control area of busy airports. Transportation Research-Part E: Logistics and Transportation Review. 2013;60(1):140-155.
Samà M, D’Ariano A, Pacciarelli D. Optimal aircraft scheduling and routing at a terminal control area during disturbances. Transportation Research-Part C: Emerging Technologies. 2014;47(1):61-85.
Radio Technical Commission for Aeronautics (RTCA). Final report of RTCA task force 3: free flight implementation. Washington D.C., U.S.A.: RTCA Inc.; 1995.
Laudman IV, Shelden SG, Branstrom R, et al. Dynamic density: an air traffic management metric. Washington, D.C., U.S.A.: NASA/TM-1998-112226; 1998.
Delahaye D, Puechmorel S, Hansman RJ, et al. Air traffic complexity map based on nonlinear dynamical systems. Air Traffic Control Quarterly. 2004;12(4):367-388.
Gianazza D, Guittet K. Selection and evaluation of air traffic complexity metrics. Portland, U.S.A.: 25th Digital Avionics Systems Conference; 2006.
Lee K, Feron E, Pritchett A. Describing airspace complexity: airspace response to disturbances. Journal of Guidance, Control and Dynamics. 2009;132(1):210-222.
Cong W, Hu M, Xie H. Research on refinement method of air traffic complexity metrics system. Journal of Wuhan University of Technology (Transportation Science & Engineering). 2014;38(3):611-618.
ICAO. Doc9426-AN/924 (1st Edition)-1984. Air Transport Service Planning Manual, Part II, Appendix C. Montreal, Canada: ICAO; 1999.
Arnab M, Washington YO. The factors affecting air traffic controller workload: a multivariate analysis based upon simulation modeling of controller workload. Transportation Research Record. 2002;1788:58-69.
Zhang J, Hu M, Liu W. Integrated Evaluation for Operation Performance of Air Traffic Control in Terminal Area. Journal of Southwest Jiaotong University. 2012;02:341-347.
Zhang J, Yu H, Zou G. Research on evaluation factors for operation performance of air traffic control in terminal area. Journal of Civil Aviation University of China. 2012;03:18-21.
Zhang J, Hu M, Wu Z, Zhang R. An Improved Integrated Evaluation Method on Operation Performance of Air Traffic Control Based on BP Network. Journal of Southwest Jiaotong University. 2013;03:553-558.
Wang L, Zeng Y, Chen T. Back propagation neural network with adaptive differential evolution algorithm for time series forecasting. Expert Systems with Applications. 2015;42(2):855-863.
Roudbari A, Saghafi F. Intelligent modeling and identification of aircraft nonlinear flight. Chinese Journal of Aeronautics. 2014;27(4):759-771.
Li Y, Wang R, Xu M. Rescheduling of observing spacecraft using fuzzy neural network and ant colony algorithm. Chinese Journal of Aeronautics. 2014;27(3):678-687.
Wang DM, Wang L, Zhang GM. Short-term wind speed forecast model for wind farms based on genetic BP neural network. Journal of Zhejiang University (Engineering Science). 2012;46(5):837-841.
Demuth H, Beale M. Neural Network Toolbox. User's Guide; 2015.
Yu Y-Y, Chen Y, Li T-Y. Improved genetic algorithm for solving TSP. Control and Decision. 2014;29(8):1483-1488.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
