Algorithmic Accountability Through the “Human over the Loop” in Interoperable and EU AI-reliant Large-scale IT Systems for Migration and Security

Printer-friendly version

Table of Contents: I. Introduction. – II. Interoperability of large-scale IT systems for third-country nationals: a synopsis. – II.1. The road. – II.2. The interoperability regulations. – III. Searching for AI in terminologically ambiguous texts. – III.1. The pivotal role of the CRRS. – III.2. sBMS: motor for biometric recognition. – III.3. MID: an AI-powered interoperability component. – IV. Algorithmic accountability through the “human over the loop”. – VI.1. DPAs and EDPS. – VI.2. Harvesting the potential of the ETIAS and VIS Fundamental Rights Guidance Boards. – VI.3. The AI Act’s market surveillance authorities. – V. Conclusion: supervising interoperability as a mission impossible for the human over the loop?

Abstract: Interoperability of large-scale IT systems and the deployment of Artificial Intelligence (AI) systems in the field of migration, asylum and border management have been two parallel developments at EU level. Legal scholarship has not yet addressed in detail the potential interplay of these two initiatives and this Article stressed that various interoperability components are either pre-requisites or enablers for the deployment of AI in the EU IT systems. The Article analyses how these AI-powered components are dealt with by the AI Act and highlights potential challenges in classifying them as high-risk AI systems. In this highly complex and opaque legal framework, the Article argues that algorithmic accountability through supervision, framed as the “human over the loop”, is particularly important. Such supervision so far has focused on data protection-related matters, but the deployment of AI has implications beyond the contours of data protection law. The Article provides recommendations on how supervision of interoperable and AI-reliant IT systems should be reconceived to achieve algorithmic accountability. In this respect, the analysis focused not only on the role of national data protection authorities, but also on other actors with supervisory underpinnings.

Keywords: algorithmic accountability – interoperability – large-scale IT systems – artificial intelligence (AI) – supervision – migration.

-------------------
European Papers, Vol. 9, 2024, No 3, pp. 1228-1249
ISSN 2499-8249
- doi: 10.15166/2499-8249/807

* Associate Professor of Cyber Policy, University of Luxembourg, niovi.vavoula@uni.lu.

e-Journal

European Forum

e-Journal

Forum Européen

e-Journal

Forum europeo

e-Journal

Foro Europeo