Friday Reading List. 06/01/2023. (Theme: Implicit Bias)

Bibliographies and Other Reference Material, EDI Language and Concepts, The University, Unconscious Bias/Implicit Bias 22 Minutes

Six subheadings in this entry:

1) About the overarching EDI initiative in Canadian universities

2) Canadian Universities, Implicit Bias & EDI, examples

3) Why are some reluctant to criticise EDI programmes?

4) Hunting Implicit Biases (e.g anonymous reporting and bias incident response teams)

5) Questions and Controversy Around the Accuracy of Tests, the Efficacy of Training, and the Autonomous Effects of Each

6) More on Implicit Bias from Previous Posts on this Blog

*Note that I use implicit bias and unconscious bias interchangeably.

Search any Canadian University and you’ll discover that implicit bias tests and training are broadly regarded by the architects of EDI programmes as a powerful tool for mitigating negative racial and gender stereotypes. However, not only have they overstated their claims about implicit bias and its possible remedies, but they may well be wholly dead wrong. I’m not here purporting to make a definitive case against implicit bias testing and training. Only that such worries are warranted.

One worry is that the designers of EDI programmes haven’t searched for possible disconfirming counter-evidence to their research, thereby eschewing scholarly rigour:

“Commitment to equity, diversity and inclusion …Through these means the agencies will work with those involved in the research system to develop the inclusive culture needed for research excellence and to achieve outcomes that are rigorous, relevant and accessible to diverse populations [bolding mine].”

“Best Practices in Equity, Diversity, and Inclusion in Research,” Canada Research Coordinating Committee, New Frontiers in Research Fund, Government of Canada,  https://www.sshrc-crsh.gc.ca/funding-financement/nfrf-fnfr/edi-eng.aspx, accessed Jan 6, 2023

Hence their claims that EDI leads to “research excellence” might be a performative contradiction.

Recruiting, Best Practices, “Have those involved in the hiring process complete EDI training, including instruction on how to recognize and combat unconscious, implicit, overt, prejudicial and any other kinds of bias (e.g., see the “dirty dozen” explained in chapter 11 of The Equity Myth).

Mentoring, Best Practices, “Ensure mentors receive unconscious bias training and/or other EDI training as necessary (e.g., microaggressions, antiracism training).”

“Best Practices in Equity, Diversity, and Inclusion in Research,” Canada Research Coordinating Committee, New Frontiers in Research Fund, Government of Canada,  https://www.sshrc-crsh.gc.ca/funding-financement/nfrf-fnfr/edi-eng.aspx, accessed Jan 6, 2023

About the overarching EDI initiative in Canadian universities:

EDI begins at the federal level under the granting agency for Canadian science and innovation research, the National Sciences and Engineering Research Council of Canada (NSERC), https://www.nserc-crsng.gc.ca/NSERC-CRSNG/Index_eng.asp, accessed Jan 6, 2023.

  • “We work with universities, colleges, businesses and not-for-profits to remove barriers, develop opportunities and attract new expertise to make Canada’s research community thrive.”

NSERC, along with two other federal granting agencies,  the Social Sciences and Humanities Research Council (SSHRC)  and the Canadian Institutes of Health Research (CIHR), together form the Tri-Agency Financial Administration. 

SSHRC. Social Sciences and Humanities Research Council: https://www.sshrc-crsh.gc.ca/home-accueil-eng.aspx, accessed Jan 6, 2023

  • “The Social Sciences and Humanities Research Council (SSHRC) is the federal research funding agency that promotes and supports research and training in the humanities and social sciences.”

CIHR: https://cihr-irsc.gc.ca/e/193.html, accessed Jan 6, 2023

  • “The Canadian Institutes of Health Research (CIHR) is Canada’s federal funding agency for health research. Composed of 13 Institutes, we collaborate with partners and researchers to support the discoveries and innovations that improve our health and strengthen our health care system.”

Tri -Agency:  https://www.nserc-crsng.gc.ca/InterAgency-Interorganismes/TAFA-AFTO/index_eng.asp, accessed Jan 6, 2023

  • About: “Collaborations between federal research funding organizations,” The tri-agencies, Canadian Institutes of Health Research, Government of Canada, https://cihr-irsc.gc.ca/e/46884.html, accessed Jan 6, 2023
  • Included with the Tri-agencies is the “ Canada Foundation for Innovation (CFI) …, a federally funded organization that enables this research, training and innovation through investments in state-of-the-art infrastructure.”

Grants and Awards: An overview of the grants and awards available under the EDI initiative, including a non-renewable Equity, Diversity, and Inclusion Institutional Capacity Building grant worth up to $200,000 per year, for up to 2 years. (*corrected 25 February 2022), https://www.nserc-crsng.gc.ca/NSERC-CRSNG/EDI-EDI/Grants-Awards_Subventions_et_Bourses_eng.asp, accessed Jan 6, 2023

A number of Canadian Colleges and Universities have received the full amount of the EDI Institutional Capacity Building Grant, including:

The Dimensions project is an chartered EDI initiative, one of a number of similar international programs, and is supported by the Tri-agencies,

  • “The [Dimensions] program is the result of cross-country consultations to make it uniquely adapted to the Canadian realities.”

NSERC, About, “Equity, Diversity, and Inclusion,” Government of Canada,   https://www.nserc-crsng.gc.ca/NSERC-CRSNG/EDI-EDI/Dimensions_Dimensions_eng.asp, accessed Jan 6, 2023

Dimensions Charter: 

Government of Canada 2019, Dimensions: equity, diversity and inclusion Canada, http://www.nserc-crsng.gc.ca/NSERC-CRSNG/EDI-EDI/Dimensions-Charter_Dimensions-Charte_eng.asp, accessed Jan 6, 2023

dimensions-charter-enDownload

The Canada Research Chairs (CRC) program is also a partner in the EDI initiative. 

The CRC site is too extensive to summarize here, but I draw your attention to the Bias in Peer Review Training Module which is recommended by almost every Canadian university:

  • (If anyone has 10-15 minutes to complete the training module, please share your impressions in the comment section.)  

Canadian Universities, Implicit Bias & EDI, examples:

Note most of these examples include links to the Harvard Implicit Association Test (IAT) – also known as Project Implicit — as well as to the CRC training module.

  1. University of British Columbia (UBC) 

“Unconscious bias in the workplace,” Equity and Inclusion Office, The University of British Columbia, September 24, 2021,  https://equity.ubc.ca/news-and-stories/unconscious-bias-in-the-workplace/, accessed Jan 6, 2023

2. Simon Fraser University (SFU)

“Implicit bias, hiring, and retention: Equity, diversity, and inclusion (EDI) resource guide,” Simon Fraser University, Library,  https://www.lib.sfu.ca/help/academic-integrity/edi/hiring-unconscious-bias, accessed Jan 6, 2023

  • “These pages are the result of extensive collaboration between the SFU Library, the SFU EDI Administrative group, and other SFU stakeholders, and this work is ongoing.”

3. University of Calgary (U of C)

“Unconscious/Implicit Bias,” EDI Workshops, University of Calgary,  https://www.ucalgary.ca/equity-diversity-inclusion/literacy-and-education/edi-workshops, accessed Jan 6, 2023

4. University of Alberta (U of A)

“Equity, Diversity and Inclusion Public Accountability and Transparency Requirements,” Research Services Office, University of Alberta,  https://www.ualberta.ca/research-services-office/funding-opportunities/canada-research-chairs/public-accountability.html, accessed Jan 6, 2023

  • See subheading: Equity,Diversity, and Inclusion Training

5. University of Manitoba (U of M, UM)

“Resources on Equity, Diversity and Inclusion in Health: Bias,” Libraries, University of Manitoba,    https://libguides.lib.umanitoba.ca/c.php?g=718710&p=5144069, accessed Jan 6, 2023

6. University of Waterloo (Waterloo, UW)

“EDII resources and guides,” Research>>Research Equity and Inclusion, University of Waterloo,    https://uwaterloo.ca/research/research-equity-and-inclusion/edii-resources-and-guides, accessed Jan 6, 2023

  • See subheading, “Understanding Unconscious Bias in Recruitment, Selection and Review.” 

7. Toronto Metropolitan University (TMU) Formerly: Ryerson University (Ryerson, RyeU, RU)

“Types of Unconscious Biases and How to Counteract,” Equity, Diversity and Inclusion, Ryerson University, PDF, ,  https://www.ryerson.ca/content/dam/equity/documents/Types-of-Unconscious-Biases-and-Ways-to-Counteract.pdf, accessed Jan 6, 2023

8. University of Toronto (U of T) 

  • “The Division of People Strategy” is not a typo, though perhaps it’s a Freudian slip. The strategy to divide people is ‘Equity and Culture’? Rather unfortunate name for a department.

9. Dalhousie University (Dal) 

“Equity, Diversity, and Inclusion (EDI) —Research Resources,” Office of Research Services (ORS), Dalhousie University,  https://www.dal.ca/dept/research-services/resources/equity–diversity–and-inclusion—research-resources.html, accessed Jan 6, 2023

10. Queen’s University (QueensU)

“Unconscious Bias,” Online Training, Human Rights and Equity Office, Queen’s University, https://www.queensu.ca/equity/public/bias/starthub.php, accessed Jan 6, 2023

Why some are reluctant to criticise EDI programmes?

Some fear being labelled a racist, bigot, Alt-Right, etc. for criticizing EDI. In many cases, their fears are justified.  

The following excerpt from a Brandon University news article states, “We cannot be fooled by vague language that hides divisiveness and hatred.” Apparently they can. “Divisiveness and hatred” are examples of vague language.

“No place is immune to objectionable and distasteful sentiments. We cannot be fooled by vague language that hides divisiveness and hatred. We are proud of the committed students, faculty and staff who stand together to support universal human rights.

We recognize that the hurtful or hateful actions of a small number of individuals can have an outsize effect on marginalized groups and we reiterate that white supremacy, racism, xenophobia, misogyny, hate speech and discrimination of all kinds have no place at Brandon University. We condemn it and it will not be tolerated.

We know that disturbing expressions can have emotional impacts that require care and attention. We remind our entire BU community that we have services here to support you.”

“Brandon University condemns hatred and divisiveness with reaffirmed support for inclusiveness and universal human rights,” Brandon University News, December 7, 2017,  https://www.brandonu.ca/news/2017/12/07/brandon-university-condemns-hatred-and-divisiveness-with-reaffirmed-support-for-inclusiveness-and-universal-human-rights/, accessed Jan 6, 2023

Also from Brandon University (BU), The BU Statement on Inclusion, https://www.brandonu.ca/diversity/bu-statement-on-inclusion/, accessed Jan 6, 2023

Excerpt: “Brandon University affirms an unwavering and unambiguous commitment to diversity, inclusion and universal human rights. We are stronger and richer together, and we celebrate the unique contributions brought to our community through everyone’s individual circumstances, perspectives and life experiences.

Around the globe, and occasionally here at home, we must sometimes face xenophobia and racism. This often masquerades as nationalism, pride, or concerns about cultural purity. Bigots may deliberately use vague language or misappropriate the struggles of marginalized groups to advance their offensive cause. Their language is couched in pretend innocence that is designed to convince the naïve and to provoke divisive reactions. We are not fooled. We condemn hate speech of all kinds.

The paradox of tolerance reminds us that no accommodations can be made for intolerance. Hate speech is not free speech. Prejudice is not pride. Bigotry is not up for debate.

These distasteful opinions are to be found everywhere, and the Brandon University campus is no exception…” 

Lee Jussim. “Is Implicit Bias Training Useless?”, Psychology Today, June 13, 2021, https://www.psychologytoday.com/us/blog/rabble-rouser/202106/is-implicit-bias-training-useless, accessed Jan 6, 2023

Jussim outlines six reasons why implicit bias training is so popular, notwithstanding it’s ineffective. Roughly, they are:

1) Overstated claims at the outset of implicit bias research

2) Implicit bias provides a simple explanation for continuing inequality (especially when appealing to ‘hidden forces’)

3) Virtue Signalling

4) It gives activists a veneer of scientific credibility

5) PR and Insurance

6) Consultants make big bucks 

Hunting Implicit Biases: 

Pamela Lindsay. “Uncovering an Implicit Bias,” Saturday Morning Pam-toons. https://pam-mentations.com/2021/01/11/saturday-morning-pam-toons-uncovering-an-implicit-bias/, accessed Jan 6, 2023

Institutions such as Queens University and the University of Toronto are collecting self-reported anonymous information as evidence for recurring patterns of harassment, discrimination, and bias/hate incidents. Hence these reports can’t be disconfirmed:

Queens University. Communications Staff, “Queen’s launches pilot of anonymous harassment and discrimination submission platform,” Queen’s Gazette, Queen’s University, October 12, 2021 (accessed February 19, 2022), https://www.queensu.ca/gazette/stories/queen-s-launches-pilot-anonymous-harassment-and-discrimination-submission-platform

University of Toronto.“Making a confidential disclosure,” Equity, Diversity & Inclusion, Faculty of Applied Science & Engineering, University of Toronto, https://www.engineering.utoronto.ca/about/equity-diversity-and-inclusion/disclosing-incidents-of-bias-discrimination-harassment-or-unprofessionalism/, accessed Jan 6, 2023

I’ve included two references about the Bias Incident Response Teams (BIRTS and, sometimes, BARTS) that have proliferated in the US:

 FIRE, “2017 Report Bias Reporting Systems,” https://www.thefire.org/research/publications/bias-response-team-report-2017/report-on-bias-reporting-systems-2017/ , accessed Jan 6, 2023

  • “Executive Summary: Over the past several years, the Foundation for Individual Rights in Education (FIRE) has received an increasing number of reports that colleges and universities are inviting students to anonymously report offensive, yet constitutionally protected, speech to administrators and law enforcement through so-called “Bias Response Teams.” These teams monitor and investigate student and faculty speech, directing the attention of law enforcement and student conduct administrators towards the expression of students and faculty members…”

Lukianoff, Greg & Adam Goldstein. Catching up with ‘Coddling’ part eleven: The special problem of bias response teams,” FIRE, March 11, 2021, https://www.thefire.org/catching-up-with-coddling-part-eleven-the-special-problem-of-bias-response-teams/, accessed Jan 6, 2023

Questions and Controversy Around the Accuracy of Tests, the Efficacy of Training, and the Autonomous Effects of Each

Recall that I’m not purporting here to make a definitive case against implicit bias testing and training. The following is a far from exhaustive bibliography of popular articles and technical papers.

I’ve made a few of my own comments, but I’ve largely drawn on quotes that will give you the gist of the article or technical paper.

Schimmack, Ulrich. “Invalid Claims About the Validity of Implicit Association Tests by Prisoners of the Implicit Social-Cognition Paradigm.” Perspectives on psychological science : a journal of the Association for Psychological Science vol. 16,2 (2021): 435-442. doi:10.1177/1745691621991860, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8167921/, accessed Jan 6, 2023

  • Abstract: In a prior publication, I used structural equation modeling (sic) of multimethod data to examine the construct validity of Implicit Association Tests. The results showed no evidence that IATs measure implicit constructs (e.g., implicit self-esteem, implicit racial bias). This critique of IATs elicited several responses by implicit social-cognition researchers, who tried to defend the validity and usefulness of IATs. I carefully examine these arguments and show that they lack validity. IAT proponents consistently ignore or misrepresent facts that challenge the validity of IATs as measures of individual differences in implicit cognitions. One response suggests that IATs can be useful even if they merely measure the same constructs as self-report measures, but I find no support for the claim that IATs have practically significant incremental predictive validity. In conclusions, IATs are widely used without psychometric evidence of construct or predictive validity.

Lonergan, Patricia.“A common test to evaluate people’s implicit bias has been ‘oversold,’ U of T researcher says”, U of T News, Nov. 26, 2019 https://www.utoronto.ca/news/common-test-evaluate-people-s-implicit-bias-has-been-oversold-u-t-researcher-says, accessed Jan 6, 2023

  • “Racial bias is a reality, Schimmack says, but the problem is too many discussions of the issue are based on research findings that rely on flawed IAT measures. For example, some argue implicit bias training is not useful because it doesn’t change IAT scores. But if IAT scores are not valid in the first place, they are not likely to be effective evaluation tools.”

Tiffany L. Green and Nao Hagiwara. “The Problem with Implicit Bias Training: It’s well motivated, but there’s little evidence that it leads to meaningful changes,”  Scientific American, August 28, 2020,  https://www.scientificamerican.com/article/the-problem-with-implicit-bias-training/, accessed Jan 6, 2023

  • “But while implicit bias trainings are multiplying, few rigorous evaluations of these programs exist. There are exceptions; some implicit bias interventions have been conducted empirically among health care professionals and college students. These interventions have been proven to lower scores on the Implicit Association Test (IAT), the most commonly used implicit measure of prejudice and stereotyping. But to date, none of these interventions has been shown to result in permanent, long-term reductions of implicit bias scores or, more importantly, sustained and meaningful changes in behavior (i.e., narrowing of racial/ethnic clinical treatment disparities).”
  • “Even worse, there is consistent evidence that bias training done the “wrong way” (think lukewarm diversity training) can actually have the opposite impact, inducing anger and frustration among white employees. What this all means is that, despite the widespread calls for implicit bias training, it will likely be ineffective at best; at worst, it’s a poor use of limited resources that could cause more damage and exacerbate the very issues it is trying to solve.” 

Dobbin, Frank, and Alexandra Kalev. “Why doesn’t diversity training work? The challenge for industry and academia.” Anthropology Now 10.2 (2018): 48-55, https://scholar.harvard.edu/files/dobbin/files/an2018.pdf, accessed Jan 6, 2023

Machery, Edouard. “Anomalies in implicit attitudes research.” Wiley Interdisciplinary Reviews: Cognitive Science 13, no. 1 (2022): e1569. https://wires.onlinelibrary.wiley.com/doi/epdf/10.1002/wcs.1569, accessed Jan 6, 2023

  • Abstract: In this review, I provide a pessimistic assessment of the indirect measurement of attitudes by highlighting the persisting anomalies in the science of implicit attitudes, focusing on their validity, reliability, predictive power, and causal efficiency, and I draw some conclusions concerning the validity of the implicit bias construct.

Brownstein, Michael, “Implicit Bias”, The Stanford Encyclopedia of Philosophy (Fall 2019 Edition), Edward N. Zalta (ed.), URL = <https://plato.stanford.edu/archives/fall2019/entries/implicit-bias/>. accessed Jan 6, 2023

  • Stanford entries, including this one, have extensive bibliographies and notes.

  • “One question crucial to the metaphysics of implicit bias is whether the relevant psychological constructs should be thought of as stable, trait-like features of a person’s identity or as momentary, state-like features of their current mindset or situation (§2.4). While current data suggest that implicit biases are more state-like than trait-like, methodological improvements may generate more stable, dispositional results on implicit measures.”

  • “Future research on epistemology and implicit bias may tackle a number of questions, for example: does the testimony of social and personality psychologists about statistical regularities justify believing that you are biased? “

  • “One noteworthy intersection of theoretical ethics with forthcoming empirical research will focus on the interpersonal effects of blaming and judgments about blameworthiness for implicit bias.”

Hermanson, Sean: ‘Rethinking implicit bias: I want my money back’ Leiter Reports: A Philosophy Blog, April 6, 2018, (accessed 19 February 2022) https://leiterreports.typepad.com/blog/2018/04/sean-hermanson-rethinking-implicit-bias-i-want-my-money-back.html, accessed Jan 6, 2023

  • It’s worth reading the comment section as well as the article, especially ‘Comment 15’ by Lee Jussim
  • And note the comment by an anonymous PhD:

Comment 2, Anon PhD: “I second much of Daniel Kaufman’s comment [1], with one exception. The reply is often not just “move along” [nothing to see here, re: comment 1] but something much more pernicious, e.g. an implication that your rejection of the IAT is indicative of deeper moral flaws (I can cite relevant examples, though anyone who has been keeping up with this “debate” is surely familiar). positively, it would be nice to see a discussion among /professional/ philosophers regarding retraction norms for philosophical work. If, for example, a published piece of philosophy relies heavily upon discredited and/or retracted empirical work, presumably the philosophical work should also be discredited and/or retracted. Presumably one justification for retracting discredited work is that this norm incentivizes scholarly care and precision, two qualities that are conspicuously lacking in much of the philosophical work that incorporates the IAT.”

Lopez, German. “For years, this popular test measured anyone’s racial bias. But it might not work after all,” Vox, March 7, 2017, https://www.vox.com/identities/2017/3/7/14637626/implicit-association-test-racism, accessed Jan 6, 2023

  • Lopez provides a thorough-going overview of the literature, researchers, and points of contention up to March, 2017. 

  • Lopez raises a critical point. Most EDI university websites encourage visitors to take the IAT (Harvard) test to determine whether they have an implicit bias. But, taking the test once by no means indicates that you have a bias (or not) as indicated by the results.

Goldhill, Olivia. “The world is relying on a flawed psychological test to fight racism,” Quartz, December 3, 2017, updated July 24, 2020, https://qz.com/1144504/the-world-is-relying-on-a-flawed-psychological-test-to-fight-racism/, accessed Jan 6, 2023

(This is a lengthy article that will take 10-15 minutes of your time.)

  • “I saw a similar reluctance to criticize implicit bias among friends and colleagues. Taking the test, and buying into the concept of implicit bias, feels both open-minded and progressive.”
  • “There’s little doubt we all have some form of unconscious prejudice. Nearly all our thoughts and actions are influenced, at least in part, by unconscious impulses. There’s no reason prejudice should be any different.”
  • “But we don’t yet know how to accurately measure unconscious prejudice. We certainly don’t know how to reduce implicit bias, and we don’t know how to influence unconscious views to decrease racism or sexism. There are now thousands of workplace talks and police trainings and jury guidelines that focus on implicit bias, but we still we have no strong scientific proof that these programs work.”
  • “A lot of folks see the IAT as a golden path to the unconscious, a tool that perfectly captures what’s going on behind the scenes and it’s not,” says Lai. “It’s a lot messier than that. The truth, as often, is a lot more complicated.”

Osman, M. (2021) UK Public Understanding of Unconscious Bias and Unconscious Bias Training. Psychology, 12, 1058-1069. doi: 10.4236/psych.2021.127063., https://www.scirp.org/journal/paperinformation.aspx?paperid=110586, accessed Jan 6, 2023

  • “First, there is very limited [IAT] test-retest reliability (Gawronski et al., 2017). What this means is that the relationship is very low between an individual’s score taking an IAT at one time, and then repeating the test at a later time. What this also implies is that, either the biases aren’t stable over time, or the test doesn’t reliably measure what it purports to measure, or potentially both depending on how sceptical one is about the status of unconscious bias as a phenomenon.”

  • “To the extent that the IAT might even detect unconscious biases, which from the earlier discussion is already under contention, the IAT doesn’t predictable discriminatory behaviours. This issue is particularly problematic for EDI training programmes for the reason that if the IAT doesn’t reliably detect unconscious biases, and doesn’t predict objective behaviours that might be assumed to be causally associated with harbouring unconscious biases towards a particular group, then it also cannot be used as an objective test of the efficacy of unconscious bias training.”
  • “By focusing on basic cognitive biases rather than specific social biases, can serve several useful functions, including decreasing inter-group tensions amongst those on DEI training methods. Here the evidence suggests that, in DEI training initiatives such as unconscious bias training, identifying a group that holds unconscious biases towards another group, can lead to backfiring effects, such as increased tensions between different groups.”

  • “As this pilot study hopefully shows, people can vary with respect to several core interpretations of core concepts, such as bias. If DEI methods, such as unconscious bias training are to be used, then it is important to recognise that recipients of the training ought not to be treated as a homogenous group with similar attitudes and opinions towards the training or their views on biases and where and how they appear. Finally, given that the biggest disconnect is between the evidence base regarding unconscious bias training and the public’s view of its efficacy, clearly this needs to be addressed.”

Harvard Implicit Association Test (IAT), aka Project Implicit, https://implicit.harvard.edu/implicit/canada/, accessed Jan 6, 2023

  • If you take the test, please leave your impressions in the comment section.
  • Note that the IAT was never intended for a one-of use by an individual to determine one’s implicit bias. But, universities encourage people to take the test in just this manner.

Branson, Adam. “UK government follows US with ban on unconscious bias training,” Global Government Forum, 16/12/2020, https://www.globalgovernmentforum.com/uk-government-follows-us-with-ban-on-unconscious-bias-training/, accessed Jan 6, 2023

  • This article includes a link to the Unconscious Bias Training Report by The Behavioural Insights Team.
  • The report is also available here:
20-12-14-unconscious-bias-training-bit-reportDownload

 

  • The report mentions some think Diversity training might serve to “raise awareness” about biases. My worry is that “raise awareness” requires an indexical”: Raise awareness in whom and about WHAT? And having done so, what are the autonomous effects – for better and worse? (E.g. make stereotypes more salient, thereby amplifying them.) This is the kind of worry that activists tend to miss.

Jussim, Lee. “Is Implicit Bias Training Useless?”, Psychology Today, June 13, 2021, https://www.psychologytoday.com/us/blog/rabble-rouser/202106/is-implicit-bias-training-useless, accessed Jan 6, 2023

  • “Claiming the mantle of “science” for false claims and misinformation, no matter how earnest or well-intended is bad. Misinformation is one harm; opportunity costs are another. The time and money spent on implicit bias training could surely be better spent doing more constructive things…A university could do more to reduce inequality simply by taking that fee and creating a fellowship for a student from a low-income background or marginalized group. Then, at least, they would know for a positive fact that one deserving person was actually helped.”
  • Jussim is a little loose here — who vets a “deserving person” and by which criteria? But I take his point. The money can be better used. How? A university student-cum-member of a marginalised group is privileged (in virtue of being a university student) with respect to a low-income person with no prospect for education, whether from a marginalised group or not. Maybe the money ought to be relegated to transportation, computers, meals, and so on — the things that gets you there and keeps you there. Suggestions?

Singal, Jesse. “Psychology’s favourite tool for measuring racism isn’t up to the job,” The Cut, New York Magazine, https://www.thecut.com/2017/01/psychologys-racism-measuring-tool-isnt-up-to-the-job.html , accessed Jan 6, 2023

  • This is a long article, so reserve 10-15 minutes of your time for the undertaking. It’s worth the read. And it’s worth noting that at the time EDI in Canada was getting off the ground, worries about the limits of implicit bias measures and training were already circulating.

Singal, Jesse. “The Creators of the Implicit Association Test Should Get Their Story Straight,” New York Intelligencer, December 5, 2017, https://nymag.com/intelligencer/2017/12/iat-behavior-problem.html, accessed Jan 6, 2023

  • The problem, as I showed in a lengthy rundown of the many, many problems with the test published this past January, is that there’s very little evidence to support that claim that the IAT meaningfully predicts anything. In fact, the test is riddled with statistical problems — problems severe enough that it’s fair to ask whether it is effectively “misdiagnosing” the millions of people who have taken it, the vast majority of whom are likely unaware of its very serious shortcomings. There’s now solid research published in a top journal strongly suggesting the test cannot even meaningfully predict individual behavior. And if the test can’t predict individual behavior, it’s unclear exactly what it does do or why it should be the center of so many conversations and programs geared at fighting racism.

Singal, Jesse. “Psychology’s favourite tool for measuring implicit bias is still mired in controversy,” Research Digest, The British Psychological Society, December 5, 2018, https://digest.bps.org.uk/2018/12/05/psychologys-favourite-tool-for-measuring-implicit-bias-is-still-mired-in-controversy/, accessed Jan 6, 2023

Chequer, S., & Quinn, M. G. (2021, May 1). More Error than Attitude in Implicit Association Tests (IATs), a CFA-MTMM analysis of measurement error. https://doi.org/10.31234/osf.io/afyz2 https://psyarxiv.com/afyz2, accessed Jan 6, 2023

(You will find other versions of this paper by searching Google Scholar.)

  • Excerpt from the conclusion: “Nosek and Greenwald (2009, p. 375) note that “the most important considerations in appraising validity of psychological measures are those that speak to the measure’s usefulness in research and application”. Whilst there have been many concerns regarding the IAT’s veracity and usefulness (see Blanton et al., 2009; Krause et al., 2010; Mitchell & Tetlock, 2017; Oswald et al., 2015; Rae & Olson, 2018), there has been no clear estimate for the component of error variance in IAT scores. The present study has provided clarity on this issue, demonstrating that the IAT effect scores were comprised of over 80% combined random and systematic error variance, allowing little opportunity for trait ‘implicit attitudes’ to be revealed through the noise, and requiring significant statistical modifications and processing to obtain even population-level ‘insights into our implicit biases’. To put it simply, the IAT was shown to be inadequately honed to provide insights into our implicit biases and its ‘usefulness in research and application’ is questionable, if not at times, potentially misleading. The sheer magnitude of error variance has serious implications for the use and interpretation of IAT effect scores.” 

Forscher, P. S., Lai, C. K., Axt, J. R., Ebersole, C. R., Herman, M., Devine, P. G., & Nosek, B. A. (2019). A meta-analysis of procedures to change implicit measures. Journal of Personality and Social Psychology, 117(3), 522–559. https://doi.org/10.1037/pspa0000160, accessed Jan 6, 2023

  • Using a novel technique known as network meta-analysis, we synthesized evidence from 492 studies (87,418 participants) to investigate the effectiveness of procedures in changing implicit measures, which we define as response biases on implicit tasks. We also evaluated these procedures’ effects on explicit and behavioral measures. We found that implicit measures can be changed, but effects are often relatively weak (|ds| < .30). Most studies focused on producing short-term changes with brief, single-session manipulations. Procedures that associate sets of concepts, invoke goals or motivations, or tax mental resources changed implicit measures the most, whereas procedures that induced threat, affirmation, or specific moods/emotions changed implicit measures the least. Bias tests suggested that implicit effects could be inflated relative to their true population values. Procedures changed explicit measures less consistently and to a smaller degree than implicit measures and generally produced trivial changes in behavior. Finally, changes in implicit measures did not mediate changes in explicit measures or behavior. Our findings suggest that changes in implicit measures are possible, but those changes do not necessarily translate into changes in explicit measures or behavior. (APA PsycInfo Database Record (c) 2019 APA, all rights reserved)

Tinna C. Neilsen and Lisa Kepinski. “Bias Awareness Is Not the Solution! It Might Backlash!,” The Inclusion Nudges Blog, Inclusion Nudges, https://inclusion-nudges.org/bias-awareness-is-not-the-solution-it-might-backlash/, accessed Jan 6, 2023

  • Tinna C. Neilsen and Lisa Kepinski argue that ‘awareness’ is not a reason for continuing unconscious bias testing and training. In fact, awareness is at best ineffective and at worst liable to create a backlash. 

Neilsen and Kepinski note that, “Over-reliance on unconscious bias awareness training as ‘the solution’ has created a multi-billion dollar-a-year industry that is profiting from many thinking this approach will ‘fix the problem’. Yet often, the outcomes of these bias trainings are not effective and the problem persists. It may even get bigger!” 

These authors detail a number of reasons awareness backfires, such as Mental Overload where, “Having to be consciously aware of the unconscious comes at the risk of creating mental overload, which has been proven to strengthen the impact of bias. Furthermore, when knowing (system 2) but not having the ability to act on that knowledge, it can paralyse us (system 1) and then we rely even more on default and biased behaviour. So, you see this creates a vicious circle.”

They suggest modes other than raising awareness for targeting and (re)-training the unconscious mind, which, on their view, “steers people to make better choices. This ‘pushes’ (nudges) the unconscious mind in a non-intrusive way to change behaviour without taking away the freedom to choose something else.” 

One example of a nudge these authors give is the practice of anonymising candidates for a symphony orchestra by having them audition behind a screen, and removing any subtle hints to their identities, such as having the women remove high heels that would tellingly clack across the floor as they walk to their audition positions. (This nudge is akin to the call to leave out language in academic letters of reference that would identify an applicant as female, such as “nice.” But as an applicant, I might want to identify as female if, in order to game the system, I believe that doing so advantages me in a quota system.) 

*Bibliographer’s Note: Neilsen’s and Kepinski’s “nudges” still rest upon certain assumptions, i.e. that backlash to implicit bias testing results from people, ‘old white males’, being pushed on their biases, and, in other literature, on a threat to their privileges. 

Missing from explications about backlash is the possibility that some academics are responding as scholars/researchers simpliciter worried about sound scholarship/research practices rather than feeling threatened or made uncomfortable in some way about racial and other such negative stereotypes. In other words, the bias is against stupidity and not against race, gender, or other designated disadvantaged group. 

More on Implicit Bias from Previous Posts on this Blog:

Open Science Framework OSF, Articles Critical of the IAT and Implicit Bias

Ethical Considerations of the Harvard Implicit Association Test. Are Canadian Universities Complying With These Guidelines?

Advertisement

Published by pammentations

I’ve completed all but defence of my thesis for a masters in philosophy. My disciplinary interest is in the acquisition and maintenance of our beliefs. But I also have a background in the study of rhetoric, linguistics, and philosophy of language. Political rhetoric particularly interests me.

Published

3 thoughts on “Friday Reading List. 06/01/2023. (Theme: Implicit Bias)”

  1. Pingback: Guest Post by Pamela Lindsay. Bibliography: Implicit Bias – Paulosophical Vimplications
  2. Pingback: Guest Post by Pamela Lindsay. Bibliography: Canadian Universities, EDI & Implicit Bias – Paulosophical Vimplications
  3. Pingback: Friday Reading List. 27/01/23 – Keeping An Eye On EDI

Leave a Reply

Fill in your details below or click an icon to log in:

Gravatar
WordPress.com Logo

You are commenting using your WordPress.com account. ( Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. ( Log Out /  Change )

Cancel

Connecting to %s