Australia | Publication | May 2022
“AlphaGo is the first computer program to defeat a professional human Go player, a landmark achievement that experts believe was a decade ahead of its time” AlphaGo | DeepMind.
The way governments are now operating is being transformed by technological innovation in ways that were not contemplated when State and Commonwealth parliaments established Australia’s administrative law systems. Transformation brings significant opportunities to improve public administration and make defensible data-driven decisions. One of those opportunities is the use of machines to assist in decision-making. However, as has been discussed in one of our earlier articles, there are challenges in implementing machine-assisted decision-making processes in a legally compliant manner.
At the end of last year, the NSW Ombudsman released a report titled “The new machinery of government: using machine technology in administrative decision-making” (Ombudsman Report) which outlines some of the challenges facing government. The Ombudsman Report uses “machine technology” to refer to a broad cluster of systems and processes which operate with limited or no human involvement to assist or displace human decision-making. These are generally associated with the terms “artificial intelligence” or “automated decision-making”.
While the Ombudsman Report is focused on NSW case studies, its findings are of broader relevance to all levels of government across Australia. We set out the key findings of the Ombudsman Report before outlining some key principles relevant to designing robust machine-assisted decision-making systems.
The Ombudsman Report was prompted by an investigation undertaken by the NSW Ombudsman into Revenue NSW, following complaints regarding Revenue NSW’s use of garnishee orders. Under statute, the Commissioner of Fines Administration (Commissioner) has the discretion to issue garnishee orders, if satisfied that certain circumstances exist. Garnishee orders allow a debt collector (the Commissioner) to recover debts directly from a financial institution (such as a bank).
Revenue NSW used automated technology to analyse and profile customers to enforce fines.
Between 2010 and 2019, the number of garnishee orders issued by Revenue NSW increased from 6,905 to 1.6 million. Its reported impact included completely depleting people’s accounts, which at times held the complainant’s only source of income from Centrelink. Prior notice was not given to account holders.
Although Revenue NSW cooperated with the NSW Ombudsman and made a number of modifications to its process (such as excluding particularly vulnerable persons from the process), external advice sought by the NSW Ombudsman confirmed that the automated process was not lawful because:
Revenue NSW’s process is only one of a number of recent examples where insufficient attention has been paid to administrative law principles in designing automated systems.
The Ombudsman Report emphasises that the powers and actions of government agencies and officials are “constitutionally unique” from that of the private sector. As such, although the use of machine technology raises a range of ethical, legal and privacy concerns, its use in the public sector must be assessed primarily from an administrative law perspective.
It is imperative to design systems which meet the essential requirements of good administrative decision-making. Those requirements, as summarised by the Ombudsman, are:
The legal and policy frameworks governing the implementation and use of machine-assisted decision-making systems are continually evolving. The challenge facing government is to establish legal frameworks that are future-focused and drafted in a manner that facilitates technological iterations.
While attention must be paid to the particular legal constraints that apply to each public sector function or program in designing systems, the following resources serve as helpful guidance:
Publication
EU Member States may allow companies from countries that have not concluded an agreement guaranteeing equal and reciprocal access to public procurement (public procurement agreement) with the EU to participate in public tenders, provided there is no EU act excluding the relevant country.
Subscribe and stay up to date with the latest legal news, information and events . . .
© Norton Rose Fulbright LLP 2023
