My research interests focus on engineering intelligent and autonomous systems for practical applications and lie at the intersection between different areas: AI, cognitive robotics and intelligent control.
My goal is to create robust, intelligent systems that have an impact on the real world and, to this end, I collaborate extensively with industry and end users. I have built technology for use in real scenarios in several fields: space mission operations, surveillance missions using both aerial and underwater vehicles, disaster response and assistive technology. In all these areas, I develop systems capable of adapting their behaviours to environments that are complex, rapidly changing, and uncertain.
(£6m, funded by Innovate UK and in collaboration with Barrnon, Ross Robotics, Tharsus, Jigsaw Structures, UK Atomic Energy Authority and University of Edinburgh)
There are many hostile working environments that require sophisticated tasks to be performed, such as the building of structures and deployment of tools where there is significant risk to the health and safety of any manual workers involved, high cost of deployment and significant timescales for completion. Examples are Nuclear Decommissioning, Oil and Gas, Mining and Space systems. Common to many of these environments is the extreme difficulty of effective deployment of the sophisticated kind of equipment that replaces human beings. These environments present the following challenges:
(£4.2m, funded by Innovate UK and in collaboration with Thales UK, Plant Integrity, Wootzano, ORE Catapult, Royal College of Art, University of Bristol and University of Manchester)
The MIMRee project will introduce a step-change in the Operations and Maintenance of offshore wind farms by removing humans from the loop during the inspection, maintenance and repair (IMR) of offshore wind turbine blades. The aim is to significantly reduce the costs and turbine downtime associated with these tasks and reduce the H&S risks of using rope access technicians. In this project, the multi autonomous platform approach will be demonstrated for a use case in offshore renewables; however, the developed autonomous vehicle surface vessel hub, Human-Machine Interface, robotic teaming and communications, and automated mission planning will also have applications in the offshore Oil & Gas, Search and Rescue and Defense sectors. The key objectives are:
(£2.2m, funded by Innovate UK and in collaboration with Thales UK, Headlight AI, Callen-Lenz, Network Rail, University of Bristol and University of Manchester)
The Prometheus project will develop a fully autonomous robot capable of geo-technical surveys in unknown voids for use in the mining, water infrastructure monitoring and offshore industries. This robot will be able to be automatically deployed and recovered through a standard restricted access bore of 150mm diameter, significantly increasing potential use cases over existing systems. The joint requirements of fully autonomous operation beyond visual line of sight (BVLOS) combined with deployment through a limited access 150-diameter borehole will be demonstrated both in a university lab environment and at key milestone demonstrations in conjunction with Network Rail. Further applications are within the water industry with aging water infrastructure. Prometheus will be an excellent illustration of robotics, autonomy and AI in extreme environments with widespread applications. The final system will demonstrate a step change in autonomous capability, highly flexible operation and deployment, meeting a real and existing industrial need for rapid inspection of areas that are difficult to access and complex to navigate.
(funded by EPSRC and in collaboration with MIT)
The overarching objective of this project is to endow autonomous systems with advanced decision-making capabilities and collaboration skills. We aim to build artificial systems that, in real-world environments, are capable of reasoning about high-level goals specified by human operators and formulating, in collaboration with them, a course of actions to successfully achieve such goals. Strategic reasoning and fluid teaming are fundamental skills of cognitive systems: they are needed in a variety of situations, from day-to-day tasks such as assisting humans in household chores, to extreme missions, such as space exploration. The techniques that we propose are general and can be used to support both robotic systems and software agents. We choose disaster response operations where unmanned aerial vehicles (UAVs) assist emergency responders as our demonstration arena. In this domain, in fact, it is crucial for the UAVs to think strategically to pursue goals efficiently and to act in concert with the human operators who are ultimately in charge of critical decisions.
(funded by the UK Industrial Strategy Uplift Fund and in collaboration with University of Toronto)
Search and tracking is the problem of locating a moving target and following it to its destination. In this project, we consider a scenario in which the target moves across a large geographical area by following a road network and the search is performed by a team of coordinated unmanned aerial vehicles (UAVs). We formulate search and tracking as a combinatorial optimisation problem and explore different optimisation techniques to solve it, from Greedy Algorithms to AI Planning and Constraint Programming (CP). We also study the formal properties of the objective function, which has lead us into an investigation of submodularity and how this feature can be exploited to improve our algorithms. Via an extensive experimental evaluation, we study the scalability of the different techniques and identifies the conditions under which one approach becomes preferable to the others.
(funded by EPSRC and in collaboration with BAE Systems and King's College London)
In this project, we investigate the use of automated planning technology to elicit high-level intelligent behaviour from autonomous unmanned aerial vehicles (UAVs) engaged in surveillance applications. We focus on search-and-tracking, which is the problem of searching for a mobile target and tracking it once it is found. Since search-and-tracking platforms face many sources of uncertainty and operational constraints, progress in the field has been restricted to simple and unrealistic scenarios. During the course of this project, we have devised a new approach to search-and-tracking that allows us to successfully address large-scale and complex search-and-tracking missions in which the target exhibits an intentional and evasive behaviour. We demonstrated our approach by using two different classes of vehicles, a fixed-wing UAV deployed in simulation and the “Parrot AR.Drone2.0” quadcopter deployed in a physical environment. Our experiments show that our unique way of leveraging deterministic planning to solve the search problem pays off when we tackle complex and realistic missions.
(funded by DSTL (ASUR programme) and in collaboration with Seebyte)
There are multiple contexts in which several diverse vehicles need to be deployed underwater to carry out search for targets (e.g. search and rescue, search and detect or search and track missions). Efficient use of assets in these missions requires planned coordination, sometimes using heterogeneous assets in a cooperative task, as well as sharing responsibilities and coverage of search areas. This project explores the problem of coordinating search underwater when facing intermittent communications. In this context, adaptive planning involves each asset of the search deciding its own activity in the face of prior commitments (both to other agents and from other agents) that underpin the cooperative achievement of the mission goals. We provide robust strategies for replanning, relying on the shared commitments that remain a priority for the agents, which are partners in activities that require coordination or synchronised behaviours.
(jointly funded by EPSRC and ESRC)
ECHOES is a serious game built for helping young children with Autism Spectrum Conditions (ASCs) acquire social communication skills. In ECHOES, children interact with an intelligent virtual character in socially realistic situations through a 42 inch multitouch LCD display with eye-gaze tracking. The character, which can act credibly both as a peer and as a tutor, inhabits a three-dimensional sensory garden populated by interactive objects that can change their shape and function when the agent or the child touch them. The interaction between the child and the character is structured around a number of different learning activities intended for real-world use in schools as part of the children's everyday activities. The character's decision making is driven by an autonomous agent based on automated planning techniques.
(unded by the European Union – FP7 ICT 2011-7)
TARDIS aims to build a serious-game simulation platform for young people (aged 18-25) at risk of exclusion to explore, practice and improve their social skills. TARDIS facilitates the interaction through the use of a virtual agent that acts as recruiters in job interviews scenarios. The agent is designed to deliver realistic socio-emotional interactions and acts as a credible, yet tireless interlocutor. TARDIS exploits the unique affordances of digital technology by creating an environment in which the quality and the quantity of emotional display by the agents can be modulated to scaffold the young trainees through a diverse range of possible interview situations. The scenarios are co-designed with experienced practitioners in several European countries in order to ensure their relevance to the different individuals across a number of cultural contexts.
EUROPA is a framework to model and tackle problems in planning, scheduling and constraint programming. It includes a plan database, a problem solver and a tool box. The plan database provides support for the storage and manipulation of plans as they are initialised and refined. It integrates a rich representation for actions, states, objects and constraints with powerful algorithms for automated reasoning, constraint propagation and plan manipulation. The problem solver is used to automatically find and fix flaws in the plan database. It can be configured to plan, schedule or both and can be customised to integrate specialised heuristics. The tool box includes a debugger for instrumentation and visualisation of applications and a very high-level, declarative modelling language, NDDL, for describing problem domains and partial-plans.
The Intelligent Distributed Execution Architecture (IDEA) is a real-time architecture that exploits AI planning as the core reasoning engine for interacting autonomous agents. Rather than enforcing separate deliberation and execution layers, IDEA unifies them under a single planning technology in so enabling a level of consistency, coordination and flexibility that is not possible in classical, three-layer approaches. The deliberative and reactive planners reason about and act according to a single representation of the past, present and future domain state. A single model unifies the entire domain description: the controlled subsystem and internal control logic, the coordination of control layers (e.g. how to interleave plan execution and deliberation) and the interactions with other agents. IDEA is also unified under the tenets of real-time control. Reactions to events are synchronised to a global clock, and must complete within a minimum time quantum.