Multimodal HumanMachine Interfaces for Coordinated Control of Heterogeneous Autonomous Systems

This PhD project explores a new paradigm for the control and supervision of heterogeneous autonomous systems, focusing on multimodal humanmachine interfaces (HMI) for coordinated operation of ground, aerial, and maritime (naval) drones. As autonomous systems are increasingly deployed in defence, security, policing, and emergency-response operations, the ability for human operators to intuitively and safely command multiple autonomous platforms becomes a critical challenge.

While autonomy has advanced significantly, current systems often rely on complex, fragmented interfaces that require operators to manage each platform separately through graphical interfaces, manual controllers, or domain-specific command languages. This leads to high cognitive workload, reduced situation awareness, and increased risk of errorparticularly in time-critical or safety-critic...