Society is seeing enormous growth in the development and implementation of autonomous systems, which can offer significant benefits to citizens, communities, and businesses. The potential for improvements in societal wellbeing is substantial. However, this positive potential is balanced by a similar potential for societal harm through contingent effects such as the environmental footprint of autonomous systems, systemic disadvantage for some socio-economic groups, and entrenchment of digital divides. The rollout of autonomous systems must therefore be addressed with responsibilities to society in mind. This must include engaging in dialogue with society and with those affected, trying to anticipate challenges before they occur, and responding to them. One such anticipated challenge is the effect of change on autonomous systems. Autonomous systems are not designed to be deployed in conditions of perfect stasis, as they are unlikely to encounter such conditions in real-world environments. They are frequently designed for changing environments, like public roads, and may also be designed to change themselves over time, for instance by means of learning capabilities. Not only that, but these changes in deployed systems and in their operating conditions are also likely to take place against a shifting contextual background of societal alteration (e.g. other technologies, 'black swan' events, or simply the day-to-day operation of communities). The effects of such change, on the systems themselves, on the environments within which they are operating, and on the humans with which they engage, must be considered as part of a responsible innovation approach. The RAILS project brings together a team from UCL and the Universities of York, Leeds and Oxford, from multiple disciplines, with the aim of engaging with the challenges associated with the long-term operation of autonomous systems and the effects of change on these systems. In particular, we will explore how the notion of responsibility is affected by (i) open-ended dynamic environments - situations that change over time, and (ii) lifelong-learning systems - i.e. systems that are designed to adapt themselves to their circumstances and 'learn' over time. The RAILS project will focus on such independent long-term autonomous systems in different applications. These will include (i) autonomous vehicles and (ii) autonomous robot systems such as unmanned aerial vehicles (drones). RAILS will look at social and legal contexts, as well as technical requirements, in order to assess whether and how these systems can be designed, developed, and operated in a way that they are responsible, accountable, and trustworthy. The overall aim of the RAILS project is to bring together responsible development principles with governance mechanisms and technical understanding to create new understandings of how autonomous systems can adapt to change, how they can be deployed in a responsible and trustworthy way, and how such deployment can be framed by governance to ensure accountability and flexibility.

Imagine a future where autonomous systems are widely available to improve our lives. In this future, autonomous robots unobtrusively maintain the infrastructure of our cities, and support people in living fulfilled independent lives. In this future, autonomous software reliably diagnoses disease at early stages, and dependably manages our road traffic to maximise flow and minimise environmental impact. Before this vision becomes reality, several major limitations of current autonomous systems need to be addressed. Key among these limitations is their reduced resilience: today's autonomous systems cannot avoid, withstand, recover from, adapt, and evolve to handle the uncertainty, change, faults, failure, adversity, and other disruptions present in such applications. Recent and forthcoming technological advances will provide autonomous systems with many of the sensors, actuators and other functional building blocks required to achieve the desired resilience levels, but this is not enough. To be resilient and trustworthy in these important applications, future autonomous systems will also need to use these building blocks effectively, so that they achieve complex technical requirements without violating our social, legal, ethical, empathy and cultural (SLEEC) rules and norms. Additionally, they will need to provide us with compelling evidence that the decisions and actions supporting their resilience satisfy both technical and SLEEC-compliance goals. To address these challenging needs, our project will develop a comprehensive toolbox of mathematically based notations and models, SLEEC-compliant resilience-enhancing methods, and systematic approaches for developing, deploying, optimising, and assuring highly resilient autonomous systems and systems of systems. To this end, we will capture the multidisciplinary nature of the social and technical aspects of the environment in which autonomous systems operate - and of the systems themselves - via mathematical models. For that, we have a team of Computer Scientists, Engineers, Psychologists, Philosophers, Lawyers, and Mathematicians, with an extensive track record of delivering research in all areas of the project. Working with such a mathematical model, autonomous systems will determine which resilience- enhancing actions are feasible, meet technical requirements, and are compliant with the relevant SLEEC rules and norms. Like humans, our autonomous systems will be able to reduce uncertainty, and to predict, detect and respond to change, faults, failures and adversity, proactively and efficiently. Like humans, if needed, our autonomous systems will share knowledge and services with humans and other autonomous agents. Like humans, if needed, our autonomous systems will cooperate with one another and with humans, and will proactively seek assistance from experts. Our work will deliver a step change in developing resilient autonomous systems and systems of systems. Developers will have notations and guidance to specify the socio-technical norms and rules applicable to the operational context of their autonomous systems, and techniques to design resilient autonomous systems that are trustworthy and compliant with these norms and rules. Additionally, developers will have guidance to build autonomous systems that can tolerate disruption, making the system usable in a larger set of circumstances. Finally, they will have techniques to develop resilient autonomous systems that can share information and services with peer systems and humans, and methods for providing evidence of the resilience of their systems. In such a context, autonomous systems and systems of systems will be highly resilient and trustworthy.