Outcomes


NINA will deliver the following main tools and technologies:

NINA proposes a new approach to determine the appropriate degree of automation: developing a toolbox to monitor the internal state of the ATCOs through a combination of neurophysiologic measures (e.g. brain activity, eye movements, blink frequency and duration etc.).
The use of neurometrics makes possible a bidirectional communication between the machine and the human. This will consent to flexibly determine the best degree of automation considering not only the current traffic situation, but also the controller’s internal status.

References:
Borghini, G., Aricò, P., Graziani, I., Pozzi, S., Napoletano, L., Imbert, J.P., Granger, G., Benhacene, R., Babiloni, F. A neurophysiological training evaluation metric for Air Traffic Management. 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), At Chicago, 2014.

Click here to see the image gallery of the EEG recording sessions held in Toulouse, France at ENAC premises.

The project will develop an integrated set of physiological indicators to monitor and measure workload, fatigue, and other well-established cognitive concepts (like the Skill-Rule-Knowledge taxonomy of behaviour levels).
An objective physiological measurement will in turn cross-validate these cognitive concepts, allowing their quantitative measurement or clarifying some definitions. One of the expected results is, for instance, the possibility to trace the boundary between different levels of performances or to detect fatigue by using physiological measurements.
The development of a set of neurophysiologic measures and its integration and mapping onto concepts derived from cognitive psychology will serve as instruments for designing an adaptive interface.
The interface will be based on the key principles of an ecological interface, differentiating tasks at the skills, rules and knowledge levels of the cognitive control (as input from the previous element). The adaptation will be triggered by the described measures and by the current traffic situation.

The following list shows a selection of references:

Journals:

Aricò, P., Borghini, G., Di Flumeri, G., Bonelli, S., Golfetti, A., Graziani, I., Pozzi, S. Imbert, J-P., Granger, G., Benhacene, R., Schaefer, D., Babiloni, F. (2017) Human Factors and Neurophysiological Metrics in Air Traffic Control: a Critical Review, IEEE Reviews in Biomedical Engineering (Volume: PP, Issue: 99).

Borghini, G., Aricò, P., Di Flumeri, G., Cartocci, G. Colosimo, A., Bonelli, S., Golfetti, A., Imbert, J-P., Granger, G., Benhacene, R., Poszzi, S., Babiloni, F. (2017). EEG-Based Cognitive Control Behaviour Assessment: an Ecological Study with Professional Air Traffic Controllers. Nature Scientific Reports.

Aricò, P., Borghini, G., Di Flumeri, G., Colosimo, A., Bonelli, S., Golfetti, A., Pozzi, S. Imbert, J-P., Granger, G., Benhacene, R., Babiloni, F. (2016). Adaptive Automation Triggered by EEG-Based Mental Workload Index: A Passive Brain-Computer Interface Application in Realistic Air Traffic Control Environment. Frontiers in Human Neuroscience, 26 October 2016

Aricò, P., Borghini, G., Graziani, I., Imbert, J-P., Granger, G., Benhacene, R., Pozzi, S., Napoletano, L., Di Flumeri, G., Colosimo, A., and Babiloni, F. Air Traffic Controllers (ATCO): Neurophysiological Analysis of Training and Workload ATCO. Italian Journal of Aerospace Medicine.

Di Flumeri, G., Borghini, G., Aricò, P., Pozzi, S., Bonelli, S., Golfetti, A., Colosimo, A., and Babiloni, F. Mental workload evaluation of ATCOs during ecological ATM scenarios. Italian Journal of Aerospace Medicine,

Conferences:

Borghini, G., Aricò, P., Di Flumeri, G., Graziani, I., Colosimo, A., Salinari, S., Babiloni, F., Granger, G., Imbert, J-P., Benhacene, R., Golfetti, A., Bonelli, S., Pozzi, S. (2015). Skill, Rule and Knowledge-based Behaviors Detection during Realistic ATM Simulations by Means of ATCOs’ Brain Activity. Fifth SESAR Innovation Days.

Aricò, P., Borghini, G., Di Flumeri, G., Colosimo, A., Graziani, I., Granger, G., Imbert, J-P., Benhacene, R., Terenzi, M., Pozzi, S., and Babiloni, F., (2015). Reliability over time of EEG-based mental workload evaluation during Air Traffic Management (ATM) tasks. 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

Borghini, G., Aricò, P., Ferri, F., Graziani, I., Pozzi, S., Napoletano, L., Imbert, J-P., Granger, G., Benhacene, R., and Babiloni, F. (2014). A neurophysiological training evaluation metric for Air Traffic Management. 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

Borghini, G., Aricò, P., Salinari, S., Graziani, I., Pozzi, S., Napoletano, L., Terenzi, M., Imbert, J-P., Granger, G., Benhacene, R., and Babiloni, F. (2014). Analysis of neurophysiological signals for the training and mental workload assessment of ATCOs. The 4th SESAR Innovation Days, Madrid.

Borghini, G., Aricò, P., Babiloni, F., Granger, G., Imbert, J-P., Benhacene, R., Napoletano, L., Pozzi, S. (2013). NINA: Neurometrics Indicators for ATM. Third SESAR Innovation Days.

Aricò, P., Borghini, G., Graziani, I., Fumihiko, T., Sun, Yu., Bezerianos, A., Thakor, N., Cincotti, F., Babiloni, F. Towards a Multimodal Bioelectrical Framework for the Online Mental Workload Evaluation. 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), At Chicago, 2014.

Aricò, P., Aloise, F., Schettini, F., Salinari, S., Mattia, D., Cincotti, F., 2014. Influence of P300 latency jitter on event related potential-based brain-computer interface performance. J Neural Eng 11, 035008. doi:10.1088/1741-2560/11/3/035008

Borghini, G., Aricò, P., Astolfi, L., Toppi, J., Cincotti, F., Mattia, D., Cherubino, P., Vecchiato, G., Maglione, A.G., Graziani, I., Babiloni, F., 2013. Frontal EEG theta changes assess the training improvements of novices in flight simulation tasks. Conf Proc IEEE Eng Med Biol Soc 2013, 6619–6622. doi:10.1109/EMBC.2013.6611073

Bonelli, S., Napoletano, L., 2013. The Usability Evaluation of a Touch Screen in the Flight Deck. In Cases on Usability Engineering: Design and Development of Digital Products, IGI Global. Copyright © 2013. 28 pages.

Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F., 2012. Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci Biobehav Rev. doi:10.1016/j.neubiorev.2012.10.003

Bonelli, S., Napoletano, L., 2011. Flying with complexity. Proc. of the 9th ACM SIGCHI Conference on Computer-Human Interaction, New York.

Dreyer, D., Napoletano, L., 2011. ALICIA: All conditions operations and innovative cockpit infrastructure. Proceedings of the Aerodays 2011 Conference, Madrid.


 

Sesar wpe EU Logo HALA

The content of this website is produced under the EC contract 12-120610-C4. It is the property of the NINA Consortium and shall not be distributed or reproduced without the formal approval of the NINA Steering Committee. The content of this web site is protected by copyright.