Hellina Hailu Nigatu and Lisa Pickoff-White and John F. Canny and Sarah Chasins

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2023-81

May 10, 2023

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2023/EECS-2023-81.pdf

Investigative journalists and public defenders conduct the essential work of examining, reporting, and arguing critical cases around police use-of-force and misconduct. In an ideal world, they would have access to well-organized records they can easily navigate and search. In reality, records can come as large, disorganized data dumps, increasing the burden on the already resource-constrained teams. In a cross-disciplinary research team of stakeholders and computer scientists, we worked closely with public defenders and investigative journalists in the United States to co-design an AI-augmented tool that addresses challenges in working with such data dumps. Our Document Organization Tool (DOT) is a Python library that has Data Cleaning, Data Extraction, and Data Organization features. Our collaborative design process gave us insights into the needs of under-resourced teams who work with large data dumps, such as how some domain experts became self-taught programmers to automate their tasks. To understand what type of programming paradigms could support our target users, we conducted a user study (n=18) comparing Visual, Programming-By-Example, and traditional Text-Based programming tools. From our user study, we found that once users passed the initial learning stage, they could use all three paradigms equally well. Our work offers insights for designers working with under-resourced teams who want to consolidate cutting-edge algorithms and AI techniques into unified, expressive tools. We argue that user-centered tool design can contribute to the broader fight for accountability and transparency by supporting existing practitioners in their work in domains like criminal justice.

Advisors: John F. Canny and Sarah Chasins

---

BibTeX citation:

@mastersthesis{Nigatu:EECS-2023-81,
    Author= {Nigatu, Hellina Hailu and Pickoff-White, Lisa and Canny, John F. and Chasins, Sarah},
    Title= {Co-Designing for Transparency: Lessons from Building a Document Organization Tool for the Criminal Justice Domain},
    School= {EECS Department, University of California, Berkeley},
    Year= {2023},
    Month= {May},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2023/EECS-2023-81.html},
    Number= {UCB/EECS-2023-81},
    Abstract= {Investigative journalists and public defenders conduct the essential work of examining, reporting, and arguing critical cases around police use-of-force and misconduct. In an ideal world, they would have access to well-organized records they can easily navigate and search. In reality, records can come as large, disorganized data dumps, increasing the burden on the already resource-constrained teams. In a cross-disciplinary research team of stakeholders and computer scientists, we worked closely with public defenders and investigative journalists in the United States to co-design an AI-augmented tool that addresses challenges in working with such data dumps. Our Document Organization Tool (DOT) is a Python library that has Data Cleaning, Data Extraction, and Data Organization features. Our collaborative design process gave us insights into the needs of under-resourced teams who work with large data dumps, such as how some domain experts became self-taught programmers to automate their tasks. To understand what type of programming paradigms could support our target users, we conducted a user study (n=18) comparing Visual, Programming-By-Example, and traditional Text-Based programming tools. From our user study, we found that once users passed the initial learning stage, they could use all three paradigms equally well. Our work offers insights for designers working with under-resourced teams who want to consolidate cutting-edge algorithms and AI techniques into unified, expressive tools. We argue that user-centered tool design can contribute to the broader fight for accountability and transparency by supporting existing practitioners in their work in domains like criminal justice.},
}

EndNote citation:

%0 Thesis
%A Nigatu, Hellina Hailu 
%A Pickoff-White, Lisa 
%A Canny, John F. 
%A Chasins, Sarah 
%T Co-Designing for Transparency: Lessons from Building a Document Organization Tool for the Criminal Justice Domain
%I EECS Department, University of California, Berkeley
%D 2023
%8 May 10
%@ UCB/EECS-2023-81
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2023/EECS-2023-81.html
%F Nigatu:EECS-2023-81