Part 1 - Rising Automation in Mental Health
Although ‘mental health’ is often presented as a purely technical or clinical issue, it is highly political. Controversies abound, including over the language used to describe the issue,25 the experts who should respond to it,26 the distribution of resources to help those in need,27 the use of forced psychiatric intervention by the state and other forced interventions in the name of care,28 the expansion of psychiatric and psychological ideas to public understandings of human distress and wellbeing,29 and the socio-political conditions that contribute to profound distress and mental health crises,30 to name a few contested issues. It is in these political, regulatory, and epistemic struggles that new ‘digital mental health technologies’ appear.
According to prominent reports, algorithmic and data-driven technology is expanding rapidly in mental health settings. Prominent mental health practitioners and professional associations present algorithmic and data-driven technologies as a way to address the ‘global mental health treatment gap’.31 It can bring about ‘radical change’, some argue, with the potential for ‘scalability’ of interventions and unconstrained reach that ‘can help reach billions of people.’32
Several governments have embraced digital technologies in mental healthcare as a cost-effective, accessible alternative or supplement to face-to-face support. In 2017 in the United Kingdom (UK), for example, former Prime Minister Theresa May announced ‘a £67.7million digital mental health package.’33 In the US between 2009-2015, the National Institute of Mental Health funded $445 million worth of projects concerned with ‘technology-enhanced mental health interventions’.34
Market interests also play a major role in advancing the proposed digital turn in mental health.
Thoughtforms by Dr Kellyann Geurts and Dr Indae Hwang in Science Gallery Melbourne’s MENTAL. Photo by Alan Weedon
Global digital health market [US]$118 billion worldwide
A White Paper published by the World Economic Forum states that: The global digital health market has been valued at [US]$118 billion worldwide, with mental health being one of the fastest-growing sectors.US$1.8 billion in venture-capital funding in 2020
Businesses in “digital behavioural health” reportedly raised $1.8 billion in venture-capital funding in 2020, compared to $609 million in 2019.35Gobal mental health software market: US$4,585m by 2027
According to market speculators, Zion Market Research, the ‘[g]lobal mental health software market [is] expected to generate revenue of around US$4,585 million by end of 2026.36Global digital health market expected to reach US$660 by 2026
This growth is mirrored in the ‘global digital health market’ more broadly, which Statista.com suggests will increase to around US$660 billion dollars by 2026.10,000+ mental health apps
Over 10,000 apps concerned with mental health are now available for download and use.37Major technology corporations – who happen to be also the largest corporations in the world – have increasingly turned their attention to healthcare activity, with each major firm now appointing chief medical officers and a large staff of physicians and clinicians. This financial activity concerns not just the monetisation of data concerning mental health and the expansion of mental health services online—but also in related areas concerning ‘wellness’, digitised social and health care, emotion and affect recognition, and so on.
The scale of activity across government and industry is reflected in an expanding body of research, much of which occurs at the intersection of commercial activity and scientific knowledge-making. Lines of accountability across these clinical and commercial domains are not yet clearly defined.38
Hence, caution is required in interpreting the global picture of digitised mental healthcare. There at least four reasons for this. First, speculated market value is precisely that— speculated. And those doing the speculating often have vested interests. Examples include technology developers wishing to attract capital, technology vendors seeking to sell products, and corporate services wishing to garner government contracts to build and deliver technological services. Narratives play a strong role in speculative bubbles around new technologies,39 and there are many who stand to gain by painting a picture of a rapid and inevitable technological expansion in mental health services and elsewhere. This hype can even be fuelled by humanities scholars who repeat sensational claims about technical feasibility to attract research funding.40>
Second, governments investing in ‘emerging technologies’ that are often described in terms of their groundbreaking and revolutionary potential, stand to gain from appearing innovative. Narratives of innovation can be misused in mental health sectors that are commonly painted as broken and crisis-ridden. Innovation-speak may distract from longstanding problems with existing mental health policies and practices and the potential need for major investment or restructuring to fix them.41 Narratives of technological innovation may also detract from broader policies that are toxic to public mental health, such as rising inequality, poor housing, unemployment or employment precarity, pollution and lack of green space. We discuss over-simplified narratives of technological problemsolving later in the report (page 77).
Third, many of the technological claims being made about algorithmic and data-driven technologies in mental healthcare are promissory – that is, they haven’t been proven. They lack robust evidence to back them up, particularly to show how they work in applied and real-world settings. In one of the largest surveys of the field, the James Lind Alliance concluded that ‘the evidence base for digital mental health interventions, including the demonstration of clinical effectiveness and cost effectiveness in real-world settings, remains inadequate’.42 Despite this sober finding, and others like it, the flurry of market, government and research activity may falsely suggest an inevitable march of progress toward highly effective and widely adopted digital tools
Finally, as we will discuss shortly, the very people who are supposed to gain from these technological developments – namely, people with lived experience and psychosocial disabilities – are concerningly absent from much of the research and discussion on these topics.43 Where input from this (diverse) group has been sought for mainstream research or where members of this group have led commentary, the general response appears to be one of ambivalence, with support in some areas through to serious concern in others—though by no means an outright rejection (page 37). As we stress throughout the report, the concerns they raise are not to dismiss the aspirations of those wishing to use technologies in good faith efforts to improve care, and nor is it to uncritically reject technology as necessarily bad or a sure path to a dystopian future. Instead, we aim to express concerns as clearly as possible and promote a sober view of the role of computer technology, with its capacity to simultaneously enable and threaten.
1.1 What are the different ways technology is used in crisis support and mental health care?
There are various uses for algorithmic and data-driven technology in the direct provision of mental health care. All are bound up in the contemporary communications eco-system of smartphones, linked devices, and the massive flows of data they enable. Functions within health systems include:
These categories are framed in terms of healthcare systems. There may be good reasons to advance other ways of categorising. For example, technologies that analyse data concerning mental health are appearing outside healthcare services; for example, in criminal justice agencies, online advertising firms, insurance companies, education settings, employer hiring practices, and so on.44 Case studies throughout the report will illustrate this expansion
Some technologies are well-established. Others are exploratory or experimental. Navigating these expanding technologies, including distinguishing which technologies are widely used, which are experimental, which ones are even technically feasible, and which ones are merely sensational and unrealistic, is not always easy. However, certain social, ethical, legal, political and economic themes tend to recur across the range of technology types and the conditions of their usage
1.2 Benefits Noted in Research
There are several benefits of digital initiatives in the mental health context that are broadly discussed in academic and ‘grey’ literature:
- Teletherapy, including web-based and other informational communication technology-based forms of support can break down geographical barriers and provide effective support to people in distress across large distances, or for those who require or prefer remote support.45 Hannah Zeavin highlights the way ‘care may take unexpected forms through technologies, enabling distanced intimacy and social change that transcends the psychology of the individual’.46
- In some cases, online mental health initiatives can facilitate confidential and anonymous help-seeking that is a clear social good. This might be extremely important for certain groups, particularly those from small or marginalised communities, for example, people in remote or rural communities, LGBTIQ+ young people, and Indigenous people who are wary of sharing personal information with state-based services,47 as well as those who may benefit from accessible, digitally facilitated support, including women facing intimate-partner and family violence, or those in sociodemographic groups who may be reluctant to seek traditional forms of care and support
- There are free web-based programs, some of which may help people to deal with their distress, or identify, name, and better understand their experiences, which can provide a quick, inexpensive and accessible resource for those with access to the internet.48
- Various kinds of digital technology can help improve the availability of quality information to help develop awareness of relevant forms of support. This may include formal services, but also services and organisations outside mental health systems that may be helpful, such as sexual assault services, financial counseling, environmental disaster relief, and informal peer-run support groups for people experiencing distress or addiction. There are examples of community-driven resources, such as online family violence resources and crisis support, created by members of specific cultural communities that are designed to respect their concerns around privacy and cultural respect, while meeting their unique needs.49
- There is also a positive role for data-driven digital technologies in the monitoring of services, and collection of vital statistics, including by civil society monitoring bodies, regulators, health system co-ordinators, managers and advocates. (For examples, page 87)
These are just some of the benefits advanced in the scholarly literature. Some clinically oriented research institutes espouse the benefits of digital forms of mental health care in addressing ‘serious access gaps [to mental health-related] education, prevention and treatment services’.50 We will elaborate on some of these apparent benefits throughout the report, while also attending the risks, challenges, issues, and so on, that may run counter to this optimistic picture of digitally-enabled support.
Photo by Efe Kurnaz on Unsplash.
- 25 Anne Cooke and Peter Kinderman, ‘But What about Real Mental Illnesses?” Alternatives to the Disease Model Approach to “schizophrenia’ (2018) 58(1) Journal of humanistic psychology 47.
- 26 Indigo Daya, Bridget Hamilton and Cath Roper, ‘Authentic Engagement: A Conceptual Model for Welcoming Diverse and Challenging Consumer and Survivor Views in Mental Health Research, Policy, and Practice’ (2020) 29(2) International journal of mental health nursing 299.
- 27 Dainius Pūras and Piers Gooding, ‘Mental Health and Human Rights in the 21st Century’ (2019) 18(1) World Psychiatry 42.
- 28 Dinah Miller and Annette Hanson, Committed: The Battle over Involuntary Psychiatric Care (John Hopkins University Press Baltimore, 2016).
- 29 Nikolas Rose, Our Psychiatric Future (John Wiley & Sons, 2018).
- 30 Nikolas Rose et al, ‘The Social Underpinnings of Mental Distress in the Time of COVID-19 – Time for Urgent Action’ (2020) 5 Wellcome Open Research https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7411522/
- 31 Vikram Patel et al, ‘The Lancet Commission on Global Mental Health and Sustainable Development’ (2018) 392(10157) The Lancet 1553.
- 32 Dinesh Bhugra et al, ‘The WPA-Lancet Psychiatry Commission on the Future of Psychiatry’ (2017) 4(10) The Lancet Psychiatry 775, p.803.
- 33 HM Government, ‘Prime Minister Unveils Plans to Transform Mental Health Support’, GOV.UK (9 January 2017) https://www.gov.uk/government/news/prime-minister-unveils-plans-to-transform-mental-health-support
- 34 National Institute of Mental Health, ‘NIMH » Technology and the Future of Mental Health Treatment’ (2017)
- 35 Molly Fischer, ‘The Therapy-App Fantasy’, The Cut (29 March 2021) https://www.thecut.com/article/mental-health-therapy-apps.html World Economic Forum in collaboration with Accenture, Empowering 8 Billion Minds: Enabling Better Mental Health for All via the Ethical Adoption of Technologies (28 October 2019) https://nam.edu/empowering-8-billion-minds-enabling-better-mental-health-for-all-via-the-ethical-adoption-of-technologies.
- 36 Zion Market Research, ‘Free Analysis: Mental Health Software Market’, Zion Market Research (2 January 2019) https://www.zionmarketresearch.com/market-analysis/mental-health-software-market
- 37 Jennifer Nicholas et al, ‘Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality’ (2015) 17(8) Journal of Medical Internet Research e198.
- 38 Nicole Martinez-Martin and Karola Kreitmair, ‘Ethical Issues for Direct-to-Consumer Digital Psychotherapy Apps: Addressing Accountability, Data Protection, and Consent’ (2018) 5(2) JMIR Mental Health e9423.
- 39 Brent Goldfarb and David A Kirsch, Bubbles and Crashes: The Boom and Bust of Technological Innovation (Stanford University Press, 2019).
- 40 Lee Vinsel, ‘You’re Doing It Wrong: Notes on Criticism and Technology Hype’, Medium (1 February 2021) https://sts-news.medium.com/youre-doing-it-wrong-notes-on-criticism-and-technology-hype-18b08b4307e5
- 41 Lee Vinsel and Andrew Russell have argued that fetishising innovation can serve to distract from ordinary problems of support infrastructure, including maintenance, repair, and mundane labour. Lee Vinsel and Andrew L Russell, The Innovation Delusion: How Our Obsession with the New Has Disrupted the Work That Matters Most a Book by Lee Vinsel and Andrew L. Russell (Currency, 2020).
- 42 Chris Hollis et al, ‘Identifying Research Priorities for Digital Technology in Mental Health Care: Results of the James Lind Alliance Priority Setting Partnership’ [2018] The Lancet Psychiatry http://www.sciencedirect.com/science/article/pii/S2215036618302967; Health Education England likewise raised concerns about ‘spurious claims and overhyped technologies that fail to deliver for patients’. Tom Foley and James Woollard, ‘The Digital Future of Mental Healthcare and Its Workforce: A Report on a Mental Health Stakeholder Engagement to Inform the Topol Review’ (National Health Service (UK), February 2019) p.31.
- 43 Piers Gooding and Timothy Kariotis, ‘A Scoping Review of Algorithmic and Data-Driven Technology in Online Mental Healthcare: What Is Underway and What Place for Ethics and Law?’ Journal of Medical Internet Research - Mental Health
- Kyo-Joong Oh et al, 'A Chatbot for Psychiatric Counseling in Mental Healthcare Service Based on Emotional Dialogue Analysis and Sentence Generation' in 2017 18th IEEE International Conference on Mobile Data Management (MDM) (2017) 371
- Paolo Corsico, ‘The Risks of Risk. Regulating the Use of Machine Learning for Psychosis Prediction’ (2019) 66 International Journal of Law and Psychiatry 101479; Mason Marks, Artificial Intelligence Based Suicide Prediction, SSRN Scholarly Paper, 29 January 2019 https://papers.ssrn.com/abstract=3324874.
- 44 Piers Gooding, ‘Mapping the Rise of Digital Mental Health Technologies: Emerging Issues for Law and Society’ (2019) 67 International Journal of Law and Psychiatry 101498.
- 45 Bhugra et al (n 32); Hannah Zeavin, The Distance Cure: A History of Teletherapy (MIT Press, 2021).
- 46 Zeavin (n 47).
- 47 See eg. Mission Australia, ‘Accessibility and quality of mental health services in rural and remote Australia Submission’ 80, p. 17 https:// www.aph.gov.au/DocumentStore.ashx?id=097bdfbe-91ff-44f8-b4ab-ce14217ba1f5&subId=612899 (accessed 9/06/2020); Paul Byron, Digital Media, Friendship and Cultures of Care (Routledge, 2021); Paul Byron, et al. ‘“You learn from each other”: LGBTIQ Young People’s Mental Health Help-seeking and the RAD Australia Online Directory’ (2016) Western Sydney University Young and Well Cooperative Research Centre, Sydney, p.51; see also https://burndawan.com.au/ (accessed 9/06/2020).
- 48 See generally, Productivity Commission, Mental Health, Draft Report, Canberra (2019) Ch 6.
- 49 See eg. https://burndawan.com.au/ (accessed 7/12/2021).
- 50 Black Dog Institute, ‘Saving Lives with Nationally Integrated e-Mental Health Services’ https://www.blackdoginstitute.org.au/docs/default-source/research/saving-lives-nationally-integrated-ehealth.pdf?sfvrsn=0 (accessed 7/12/2021)