Abstract
Implicit tendencies and cognitive biases play an important role in how information is perceived and processed, a fact that can be both utilised and exploited by computing systems. The Implicit Association Test (IAT) has been widely used to assess people's associations of target concepts with qualitative attributes, such as the likelihood of being hired or convicted depending on race, gender, or age. The condensed version-the Brief IAT-aims to implicit biases by measuring the reaction time to concept classifications. To use this measure in HCI research, however, we need a way to construct and validate target concepts, which tend to quickly evolve and depend on geographical and cultural interpretations. In this paper, we introduce and evaluate a new method to appropriate the BIAT using crowdsourcing to measure people's leanings on polarising topics. We present a web-based tool to test participants' bias on custom themes, where self-assessments often fail. We validated our approach with 14 domain experts and assessed the fit of crowdsourced test construction. Our method allows researchers of different domains to create and validate bias tests that can be geographically tailored and updated over time. We discuss how our method can be applied to surface implicit user biases and run studies where cognitive biases may impede reliable results.
Original language | English |
---|---|
Title of host publication | Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems |
Editors | Steven Drucker, Julie Williamson, Koji Yatani |
Place of Publication | New York NY USA |
Publisher | Association for Computing Machinery (ACM) |
Number of pages | 16 |
ISBN (Electronic) | 9781450391573 |
DOIs | |
Publication status | Published - 2022 |
Externally published | Yes |
Event | International Conference on Human Factors in Computing Systems 2022 - New Orleans, United States of America Duration: 29 Apr 2022 → 5 May 2022 Conference number: 40th https://dl.acm.org/doi/proceedings/10.1145/3491102 (ACM Digital Library - proceedings) https://chi2022.acm.org/ (Website) https://dl.acm.org/doi/proceedings/10.1145/3491101 (Extended Abstracts) |
Conference
Conference | International Conference on Human Factors in Computing Systems 2022 |
---|---|
Abbreviated title | CHI 2022 |
Country/Territory | United States of America |
City | New Orleans |
Period | 29/04/22 → 5/05/22 |
Internet address |
|
Keywords
- Attitude-Aware Systems
- Brief Implicit Association Test
- Cognitive Biases