This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Self-Affinity of an Aircraft Pilot’s Gaze Direction as a Marker of Visual Tunneling
ISSN: 0148-7191, e-ISSN: 2688-3627
Published September 16, 2019 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
Event: AeroTech Europe
For the last few years, a great deal of interest has been paid to crew monitoring systems in order to address potential safety problems during a flight. They aim at detecting any degraded physiological and/or cognitive state of an aircraft pilot or crew, such as visual tunneling, also called inattentional blindness. Indeed, they might have a negative impact on the performance to pursue the mission with adequate flight safety levels. One of the usual approaches consists in using sensors to collect physiological signals which are then analyzed. Two main families exist to process the signals. The first one combines feature extraction and machine learning whereas the second is based on deep-learning approaches which may require a large amount of labeled data. In this work, we focused on the first family. In this case, various features can be deduced from the data by different approaches: spectrum analysis, a priori modeling and nonlinear dynamical system analysis techniques including the estimation of the self-affinity of the signals. In this paper, our purpose was to uncover whether the self-affinity of the pilot gaze direction can be related to his cognitive state. To this end, an experiment was carried out on thirteen subjects in a pilot activity representative environment based on a modified version of the software MATB-II. The scenarios were designed to elicit different levels of mental workload eventually associated to attentional tunneling. A database to train the machine learning step was first created by recording the gaze directions of the subjects with an eye-tracker. The self-affinities of these signals were extracted with the Detrended Fluctuation Analysis method. They constituted the inputs of the classifier. Then, other signals were analyzed and classified. Preliminary results showed promising abilities to detect visual tunneling episodes for different levels of mental workload.
CitationBerthelot, B., Mazoyer, P., Egea, S., André, J. et al., "Self-Affinity of an Aircraft Pilot’s Gaze Direction as a Marker of Visual Tunneling," SAE Technical Paper 2019-01-1852, 2019, https://doi.org/10.4271/2019-01-1852.
Data Sets - Support Documents
|[Unnamed Dataset 1]|
|[Unnamed Dataset 2]|
|[Unnamed Dataset 3]|
|[Unnamed Dataset 4]|
- Fatal Airliner (14+ Passengers) Hull-Loss Accidents. n.d. https://aviation-safety.net/statistics/period/stats.php?cat=A1.
- Dekker, S. , “Reconstructing the Human Contribution to Accidents: The New View of Human Error and Performance,” Journal of Safety Research 33(3):371-385, 2002.
- Griffin, T., Young, M., and Stanton, N. , “Investigating Accident Causation through Information Network Modeling,” Ergonomics 53(2):198-210, 2008.
- Wickens, C. , “Attentional Tunneling and Task Management,” International Symposium on Aviation Psychology 812-817, 2005.
- Rock, I., Linnett, C., Grant, P., and Mack, A. , “Perception without Attention: Results of a New Method,” Cognitive Psychology 24:502-534, 1992.
- Simons, D. and Chabris, C. , “Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events,” Perception 28(9):1059-1074, 1999.
- Shappell, S. “A Human Error Analysis of General Aviation Controlled Flight into Terrain Accidents Occurring between 1990-1998,” 2003.
- Regis, N., Dehais, F., Tessier, C., and Gagnon, J.-F. , “Ocular Metrics for Detecting Attentional Tunnelling,” in Human Factors and Ergonomics Society Europe Chapter Conference, 2012.
- McAtee, A. et al. , “Pilot Cueing Synergies for Degraded Visual Environments,” in Proceedings of Society of Photo-Optical Instrumentation Engineers, 2016, 10197.
- Wilson, F., and Eggemeier F. . “Psychophysiological Assessment of Workload in Multi-Task Environments.” (1991).
- Posner, M. and Dehaene, S. , “Attentional Networks,” Trends in Neurosciences 17(2):75-79, 1994.
- Pourtois, G., De Pretto, M., Hauert, C.-A., and Vuilleumier, P. , “Time Course of Brain Activity during Change Blindness and Change Awareness: Performance Is Predicted by Neural Events before Change Onset,” Journal of Cognitive Neuroscience 18(12):2108-2129, 2006.
- Mathewson, K., Gratton, G., Fabiani, M., Beck, D., and Ro, T. , “To See or Not to See: Prestimulus α Phase Predicts Visual Awareness,” Journal of Cognitive Neuroscience 29(9):2725-2732, 2009.
- Régis, N. , “Toward the Real Time Estimation of the Attentional State through Ocular Activity Analysis,” PhD, Universite Toulouse 3 Paul Sabatier, 2014. English. PhD Supervisors: C. Tessier, F. Dehais.
- Liversedge, S. and Findlay, J. , “Saccadic Eye Movements and Cognition,” Trends in Cognitive Sciences 4:6-14, 2000.
- Inhoff, A. and Radach, R. , Definition and Computation of Oculomotor Measures in the Study of Cognitive Processes (Elsevier Science Ltd, 1998).
- Mandelbrot, B. and Van Ness, J. , “Fractional Brownian Motions, Fractional Noises and Applications,” SIAM Review 10(4):422-437, 1968.
- Abry, P. and Veitch, D. , “Wavelet Analysis of Long-Range-Dependant Traffic,” IEEE Transactions on Information Theory 44(2):2-15, 1998.
- Bardet, J.-M. , “Testing for the Presence of Self-Similarity of Gaussian Time Series Having Stationary Increments,” Journal of Time Series Analysis 21:497-515, 2000.
- Moulines, E., Roueff, F., and Taqqu, M. , “Central Limit Theorem for the Log-Regression Wavelet Estimation of the Memory Parameter in the Gaussian Semi-Parametric Context,” Fractals 15:301-313, 2007.
- Rilling, G., Flandrin, P., and Gonçalves, P. , “Empirical Mode Decomposition, Fractional Gaussian Noise and Hurst Exponent Estimation,” International Conference on Acoustics, Speech and Signal Processing 489-492, 2005.
- Taqqu, M., Teverovsky, V., and Willinger, W. , “Estimators for Long Range Dependence: An Empirical Study,” Fractals 3(4):785-788, 1995.
- Taqqu, M. and Teverovsky, V. , “On Estimating the Intensity of Long Range Dependence in Finite and Infinite Variance Time Series,” A Practical Guide to Heavy Tails: Statistical Techniques and Applications 177-217, 1996.
- Peng, C. et al. , “Long-Range Correlations in Nucleotide Sequences,” Nature 356:168-170, 1992.
- Peng, C., Buldyrev, S., Havlin, S., Simons, M. et al. , “Mosaic Organization of DNA Nucleotides,” Physical Review 49:1685-1689, 1994.
- Balljekar, P., and Patil H. , “A Comparison of Waveform Fractal Dimension Techniques for Voice Pathology Classification,” in International Conference on Acoustics, Speech and Signal Processing, 2012, 4461-4464.
- Navarro, X., Beuchée A., Porée F., and Carrault G. , “Performance Analysis of Hurst’s Exponent Estimators in Higly Immature Breathing Patterns of Preterm Infants,” in International Conference on Acoustics, Speech and Signal Processing, 2011, 701-704.
- Sanyal, S. et al. , “Detrended Fluctuation and Power Spectral Analysis of Alpha and Delta EEG Brain Rhythms to Study Music Elicited Emotion,” in International Conference on Signal Processing, Computing and Control, 2015, 206-210.
- Pranata, A., Adhane, G., and Kim, D. , “Detrended Fluctuation Analysis on ECG Device for Home Environment,” Consumer Communications and Networking Conference 4233-4236, 2017.
- Gilfriche, P., Deschodt-Arsac, V., Blons, E., and Arsac, L. , “Frequency-Specific Fractal Analysis of Postural Control Accounts for Control Strategies,” Frontiers in Physiology 9:293, 2018.
- Amor, T., Reis, S., Campos, D., Herrmann, H., and Jr, J.A. , “Persistence in Eye Movement during Visual Search,” Scientific Reports 6:20815, 2016.
- Menayo, R., Manzanares, A., and Segado, F. , “Complexity, Regularity and Non-Linear Behavior in Human Eye Movements: Analyzing the Dynamics of Gaze in Virtual Sailing Programs,” Symmetry 10:528, 2018.
- Osborne, D. , “Moving Average Detrending and the Analysis of Business Cycles,” Oxford Bulletin of Economic Statistics. 57:547-558, 1995.
- Wilson, G. and Russell, C. , “Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks,” Human Factors 45(4):635-644, 2003.
- Cinaz, B., Arnrich, B., Marca, R., and Tröster, G. , “Monitoring of Mental Workload Levels during an Everyday Life Office-Work Scenario,” Personal and Ubiquitous Computing 17(2):229-239, 2013.
- Fallahi, M., Heidarimoghadam, R., Motamedzade, M., and Farhadian, M. , “Psycho Physiological and Subjective Responses to Mental Workload Levels during n-back Task,” Journal of Ergonomics 6(181):2, 2016.
- Santiago-Espada, Y., Myer R., Latorella K., and Comstock J. Jr , The Multi-Attribute Task Battery Ii (Matb-Ii) Software for Human Performancea Workload Research: A User's Guide (2011).
- Regis, N. , Tunnélisation Attentionnelle: Définitions de Métriques Physiologiques et Comportementales Pour Diagnostiquer la Tunnélisation Attentionnelle chez un Opérateur Humain (2011). In French.
- Hart, S. and Staveland, L. , “Development of Nasa-Tlx (Task Load Index): Results of Empirical and Theoretical Research,” Advances in Psychology 52:139-183, 1988.
- Fisher, R. , “On the “Probable Error” of a Coefficient of Correlation Deduced from a Small Sample,” Metron 1:3-32, 1921.
- Quinlan, J. , “Induction of Decision Trees,” Machine Learning 1:81-106, 1986.
- Cover, T. , “Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition,” IEEE Transactions on Electronic Computers EC-14(3):326-334, 1965.
- Cortes, C. and Vapnik, V. , “Support-Vector Networks,” Machine Learning 20(3):273-297, 1995.
- Altman, N. , “An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression,” The American Statistician 46(3):175-185, 1992.
- Simpson, E. , “Measurement of Diversity,” Nature 163:688, 1949.