Algorithms and values in justice and security

Published on Jan 11, 2020in Ai & Society
· DOI :10.1007/S00146-019-00932-9
Paul Hayes (TU Delft: Delft University of Technology), Ibo van de Poel24
Estimated H-index: 24
(TU Delft: Delft University of Technology),
M.G.D. Steen9
Estimated H-index: 9
This article presents a conceptual investigation into the value impacts and relations of algorithms in the domain of justice and security. As a conceptual investigation, it represents one step in a value sensitive design based methodology (not incorporated here are empirical and technical investigations). Here, we explicate and analyse the expression of values of accuracy, privacy, fairness and equality, property and ownership, and accountability and transparency in this context. We find that values are sensitive to disvalue if algorithms are designed, implemented or deployed inappropriately or without sufficient consideration for their value impacts, potentially resulting in problems including discrimination and constrained autonomy. Furthermore, we outline a framework of conceptual relations of values indicated by our analysis, and potential value tensions in their implementation and deployment with a view towards supporting future research, and supporting the value sensitive design of algorithms in justice and security.
  • References (81)
  • Citations (0)
📖 Papers frequently viewed together
1 Author (Charles B. Haley)
4 Citations
2006ICSE: International Conference on Software Engineering
131 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Paul B. de Laat (UG: University of Groningen)H-Index: 8
Big Data are increasingly used in machine learning in order to create predictive models. How are predictive practices that use such models to be situated? In the field of surveillance studies many of its practitioners assert that “governance by discipline” has given way to “governance by risk”. The individual is dissolved into his/her constituent data and no longer addressed. I argue that, on the contrary, in most of the contexts where predictive modelling is used, it constitutes Foucauldian dis...
1 CitationsSource
#1Rashida RichardsonH-Index: 1
#2Jason SchultzH-Index: 8
Last. Kate CrawfordH-Index: 26
view all 3 authors...
Law enforcement agencies are increasingly using predictive policing systems to forecast criminal activity and allocate police resources. Yet in numerous jurisdictions, these systems are built on data produced during documented periods of flawed, racially biased, and sometimes unlawful practices and policies (“dirty policing”). These policing practices and policies shape the environment and the methodology by which data is created, which raises the risk of creating inaccurate, skewed, or systemic...
16 Citations
#1Ninja MarnauH-Index: 1
The European Commission appointed the High-Level Expert Group on Artificial Intelligence (AI HLEG). The AI HLEG has the objective to support the implementation of the European strategy on Artificial Intelligence. This will include the elaboration of recommendations on future-related policy development and on ethical, legal and societal issues related to AI. In January 2019, the Commission asked stakeholders for comments on the AI HLEG’s “Draft Ethics Guidelines for Trustworthy AI”. CISPA submitt...
23 Citations
#1H.G. van der Voort (TU Delft: Delft University of Technology)H-Index: 2
#2A.J. Klievink (TU Delft: Delft University of Technology)H-Index: 1
Last. Albert Meijer (UU: Utrecht University)H-Index: 29
view all 4 authors...
Big data promises to transform public decision-making for the better by making it more responsive to actual needs and policy effects. However, much recent work on big data in public decision-making assumes a rational view of decision-making, which has been much criticized in the public administration debate. In this paper, we apply this view, and a more political one, to the context of big data and offer a qualitative study. We question the impact of big data on decision-making, realizing that b...
#1Paul B. de Laat (UG: University of Groningen)H-Index: 8
Decision-making assisted by algorithms developed by machine learning is increasingly determining our lives. Unfortunately, full opacity about the process is the norm. Would transparency contribute to restoring accountability for such systems as is often maintained? Several objections to full transparency are examined: the loss of privacy when datasets become public, the perverse effects of disclosure of the very algorithms themselves (“gaming the system” in particular), the potential loss of com...
7 CitationsSource
#1Bruno Lepri (fondazione bruno kessler)H-Index: 29
#2Nuria Oliver (Vodafone)H-Index: 41
Last. Patrick Vinck (Harvard University)H-Index: 20
view all 5 authors...
The combination of increased availability of large amounts of fine-grained human behavioral data and advances in machine learning is presiding over a growing reliance on algorithms to address complex societal problems. Algorithmic decision-making processes might lead to more objective and thus potentially fairer decisions than those made by humans who may be influenced by greed, prejudice, fatigue, or hunger. However, algorithmic decision-making has been criticized for its potential to enhance d...
25 CitationsSource
#1Luciano Floridi (University of Oxford)H-Index: 47
#2Josh Cowls (University of Oxford)H-Index: 7
Last. Effy Vayena (ETH Zurich)H-Index: 23
view all 13 authors...
This article reports the findings of AI4People, an Atomium—EISMD initiative designed to lay the foundations for a “Good AI Society”. We introduce the core opportunities and risks of AI for society; present a synthesis of five ethical principles that should undergird its development and adoption; and offer 20 concrete recommendations—to assess, to develop, to incentivise, and to support good AI—which in some cases may be undertaken directly by national or supranational policy makers, while in oth...
36 CitationsSource
#1Lyria Bennett Moses (CRCs: Cooperative Research Centre)H-Index: 10
#2Janet Chan (CRCs: Cooperative Research Centre)H-Index: 22
ABSTRACTThe goal of predictive policing is to forecast where and when crimes will take place in the future. The idea has captured the imagination of law enforcement agencies around the world. Many agencies are purchasing software tools with the goal of reducing crime by mapping the likely locations of future crime to guide the deployment of police resources. Yet the claims and promises of predictive policing have not been subject to critical examination. This paper provides a review of the theor...
25 CitationsSource
#1Francis D. Boateng (UMN: University of Minnesota)H-Index: 8
Police researchers have long argued that favorable evaluations of the police eventually lead to citizens’ willingness to cooperate with the police. However, this assumption has barely been studied empirically. The current study examines the association between attitudes toward the police and crime reporting behavior of victims. Furthermore, the study explores the influence of victims’ characteristics on their decisions to report crime to the police. Using field data originally collected in Ghana...
6 CitationsSource
#1Rik Peeters (CIDE: Centro de Investigación y Docencia Económicas)H-Index: 5
#2Marc SchuilenburgH-Index: 7
The use of algorithms to predict behaviour is becoming the gold standard in criminal justice in various countries. This article critically analyses the algorithm-driven risk assessment tools used in predictive policing and predictive justice. First, we propose to see algorithms as essentially bureaucratic instruments. They are the digital offspring of the classic bureaucratic procedure, creating classification through standardised and impersonal decision-making. Second, we argue that the applica...
2 CitationsSource
Cited By0