Socitm today calls on local authorities to think long and hard before using predictive algorithms.
Coming in the wake of the exam controversy and wider calls for more transparency on how such tools are used in public services, the issue will be discussed in detail at Socitm’s next Share National conference on 24 and 25 September.
The society says that if you don’t fully understand what a program is doing, when working with your data in your political and social setting, then you are running a huge risk in using it.
Socitm’s vice president Mark Lumley, Director Digital & IT at London Borough of Hounslow, recommends three crucial steps when assessing algorithm use – local authorities must demonstrate this is a forensic exercise not a tick box one:
- Is the proposed approach proportionate and ethical? This requires forensic questioning.
- Planning rigorous testing in the operational setting with relevant data is critical.
- Underpin questioning and testing with robust sets of checks and balances built into accountable governance, including political and executive scrutiny, due diligence, and appropriate standards.
“There can be positive benefits from appropriate and well-structured use of algorithms and smart information systems. These benefits include streamlining services and enabling better outcomes for individuals and places. But there are also serious questions to be considered regarding transparency and public trust. GDPR gives people the right to challenge any decisions made by AI and be shown how the conclusion was reached. This further emphasises that the application and impact of algorithms must be fully tested and understood before they are pressed into use.”
Algorithm use is not just a technical issue of programming and data quality. It is also about how the program interacts with its development data, and then what happens when you apply it in a specific local social and political environment.
The Share National conference is for members and public service employees only. It will be hosted and facilitated by Mark Lumley
About Mark Lumley
Director Digital & IT at London Borough of Hounslow
Mark was elected as Vice President, by members, to the Socitm President’s Team in June 2020. As part of his role with Socitm, he works with Martin Ferguson and William Barker to research and offer practical experience on the policy focus of ethical use of emerging technologies and data
For more details contact Communications Manager David Ogden: firstname.lastname@example.org