Cognitive Human-Machine Interfaces and Interactions for Aerospace and Defence Systems

This DL addresses the conceptual design, prototyping and verification of Cognitive Human- Machine Interfaces and Interaction (CHMI2) systems to provide adaptive automation in next- generation avionics and Air Traffic Management (ATM) systems. The adaptive automation capability offered by the CHMI2 system can provide a pathway towards higher levels of human- machine teaming to support trusted autonomous operations. Two potential applications are considered: (1) Ground Control Station (GCS) supporting Multi-Unmanned Aircraft Systems (UAS) operations; and (2) Virtual Pilot Assistant (VPA) system for commercial Single-Pilot operated aircraft. The core CHMI2 system comprises three modules, namely: sensing, estimation and adaptation. The sensing module consists of a suite of sensors and algorithms for observing and extracting suitable physiological features of the user. The estimation module contains models that translate the features from the sensing module into measures of the user’s cognitive state. The adaptation module contains the logics that drive adaptation in the Human-Machine Interface (HMI) and system automation modes based on the estimated cognitive states. Development and test activities are currently ongoing, focused on verifying the performance of each individual module in the intended operational environment and will be followed by Human-in-the-Loop (HITL) testing of the prototype systems.