2.2.1 Privatisation and Accountability
Private sector actors are playing a prominent role in designing, constructing, and operating algorithmic and data-driven technologies in the mental health context. Traditional accountability mechanisms are not always equipped to ensure these interests align with the public good, particularly where the divide between public and private entities becomes blurred.267 Philip Alston, former UN ‘Special Rapporteur on extreme poverty and human rights’, has written that ‘[a]ccountability is the linchpin of human rights, but privatization has rendered existing mechanisms increasingly marginal’.268 The information economy has arguably accelerated this process.
Accountability requires a clear definition of who is accountable and who can hold actors accountable, including effective oversight systems that can trace the conduct of actors and to assess whether standards and requirements are met. Privatisation of services, such as mental health and social services, can undermine this clarity and oversight. The rise of private sector actors in ‘social protection services’, according to Alston, has been accompanied by a ‘deeply problematic lack of information about the precise role and responsibility of private actors in proposing, developing and operating digital technologies in welfare states around the world’.269 Further:270
- This lack of transparency has a range of causes, from gaps in freedom of information laws, confidentiality clauses, and intellectual property protections, through a failure on the part of legislatures and executives to require transparency, to a general lack of investigation of these practices by oversight bodies and the media. The absence of information seriously impedes efforts to hold governments and private actors accountable
This lack of transparency has a range of causes, from gaps in freedom of information laws, confidentiality clauses, and intellectual property protections, through a failure on the part of legislatures and executives to require transparency, to a general lack of investigation of these practices by oversight bodies and the media. The absence of information seriously impedes efforts to hold governments and private actors accountable
The case study of ‘Serenity Integrated Monitoring’ (or ‘SIM’) in England (see Section 2.3.2), in which mental health legislation data was used to flag individuals for police intervention and exclusion from emergency psychiatric services in the UK, offers one such example. The SIM program was rolled out to 23 National Health Service mental health trusts in England despite a lack of evidence of its impact on patient safety or outcomes. Instead, the little research supporting its implementation simply demonstrated reduced costs to services. SIM was owned and run by the High Intensity Network, a private limited company that was financially supported by the ‘NHS Innovation Accelerator’ and ‘Academic Health Science Network’.271 This latter network comprises of the ‘NHS and academic organisations, local authorities, the third sector and industry’ and seeks to ‘spread innovation at pace and scale – improving health and generating economic growth’.272 After a coalition of activists called for an immediate halt to the program, the High Intensity Network appears to have closed permanently; its website was removed and its social media presence wiped.273 Activists raised concerns that the outsourcing of service provision to a private company meant the program fell between gaps of traditional accountability mechanisms. The ‘StopSIM Coalition’ wrote:274
- Usually when a new treatment is introduced into the NHS there is a careful process of checking that it is safe and effective before it is rolled out to patients. This includes trialling it with a small number of people and assessing how well it meets their needs as well as catching any unintended consequences or side effects. SIM bypassed this process by being sold as an ‘innovation’ or ‘quality improvement’ measure and so research into the safety and effects of SIM has not been done.
Following this statement, the Royal College of Psychiatrists (UK) called for an ‘urgent and transparent investigation’ not only into the SIM program and the High Intensity Network, but also into the ‘NHS Innovation Accelerator’ program that supported it.275 The ‘Innovation Accelerator’ program supports several digital mental health initiatives, including remote biometric monitoring of patients in acute psychiatric wards, which are being expanded through the NHS—arguably with a similar lack of robust supporting evidence.276
At a policy level, governance and regulatory discussions also risk being driven by private interests. In 2019, a ‘White Paper’ titled, Empowering 8 Billion Minds Enabling Better Mental Health for All via the Ethical Adoption of Technologies, was published by the World Economic Forum and authored by the multinational corporation, Accenture, which specialises in IT services and consulting.277 The authors urged:
- governments, policy-makers, business leaders and practitioners to step up and address the barriers keeping effective treatments from those who need them. Primarily, these barriers are ethical considerations and a lack of better, evidence-based research.278
Framing ethical consideration and sufficient evidence as barriers to digitally-enabled treatment reverses the typical academic method, in which ethical review and evidence are needed before determining whether a particular treatment is beneficial and effective. Reading generously, it is possible the authors were instead suggesting more research and ethical discussion are needed to expand on promising preliminary research. Yet clearly, vigilance is needed. There must be transparency about the business models of private firms, and the motives of brokerage organisations like the World Economic Forum. Many tech vendors and other private sector actors will be seeking lucrative government contracts or angling for a predetermined path to bringing certain technologies to market. The role of such actors in developing governance systems in the digital mental health context, and the growing economy and vested interests that surround them, must be made transparent, with consideration as to the appropriateness of that involvement.
The World Economic Forum has now published two prominent reports on digital technologies in mental health services. The other prominent report, a ‘Global Governance Toolkit’, was led by the multinational accountancy/professional services company, Deloitte.279 As an international body, the World Economic Forum is one of the primary agenda-setting organisations today. Yet, the Forum has been criticised for operating in ways that do not align with democratic values. Christina Garsten and Adrienne Sörbom conducted a detailed ethnographic study of the World Economci Forum and concluded that it operates using ‘discretionary governance’ at the transnational level, which entails ‘the exercise of a discreet form of power and control according to the judgment of the Forum and its members’ that operates in ‘ways that escape established democratic controls’.280
This is not to criticise the aspirations of everyone involved in these reports, whether as contributors or advisors, many who will hold their views on digital mental health care in good faith (even as others will have solely been interested in increasing company margins). Instead, it is to highlight the increasing role of private sector actors in pushing digital technologies, including growing efforts to shape governance frameworks and institutions, and steering regulatory attention in preferred directions to reproduce and protect their business model.
- 265 Amnesty International and Access Now (n 88); Fjeld et al (n 38), p.33.
- 266 See e.g. Center for Democracy and Technology, Algorithm-Driven Hiring Tools: Innovative Recruitment or Expedited Disability Discrimination? (December 2020) 25 https://cdt.org/; ‘Lowe’s Announces Changes to Online Application Process for Retail Employees’Letter from Lowes and Bazelon Center for Mental Health Law, 17 November 2017 http://www.bazelon.org/wp-content/uploads/2017/11/Joint-Statement-with-Lowes.pdf; Canada (n 73).
- 267 United Nations General Assembly, Report of the Special Rapporteur on Extreme Poverty and Human Rights 26 September (No A/73/396, 2018) [77]-[85] https://undocs.org/pdf?symbol=en/A/73/396.
- 268 Ibid [77].
- 269 United Nations General Assembly, Report of the Special Rapporteur on Extreme Poverty and Human Rights 11 October (A/74/493) https://undocs.org/pdf?symbol=en/A/74/493.
- 270 Ibid.
- 271 Royal College of Psychiatrists (UK) (n 75).
- 272 https://www.ahsnnetwork.com/about-academic-health-science-networks (accessed 9/09/21).
- 273 An archived version of the Network website is available here: https://web.archive.org/web/20201126102513/https://highintensitynetwork.org/ (accessed 25/08/21).
- 274 StopSIM Coalition (n 78).
- 275 Royal College of Psychiatrists (UK) (n 75).
- 276 Hamilton Kennedy et al. ‘Rapid Review of Digitally/Technologically Assisted Nursing Observations’ (forthcoming).
- 277 World Economic Forum in collaboration with Accenture (n 35).
- 278 Ibid. p.7
- 279 World Economic Forum in collaboration with Deloitte, Global Governance Toolkit for Digital Mental Health: Building Trust in Disruptive Technology for Mental Health (April 2021) https://www.weforum.org/whitepapers/global-governance-toolkit-for-digital-mental-health/.
- 280 Adrienne Sörbom and Christina Garsten, Discreet Power: How the World Economic Forum Shapes Market Agendas (Stanford University Press, 2018) ‘Introduction’. Garsten and Sörbom argue that the WEF must be viewed relationally as a “brokering organization” that is “strategically situated as an intermediary between markets and politics on the global arena”.