Meet us in London on 19 October for a conference tackling what, why and how to use technology and data

Digital ethics collection | Article

Emerging tools

The UK and partner organisations from around the world are playing a leading role in the development of tools and toolkits on the ethical use of emerging technologies and data. This section collates the various emerging ethical practice tools, toolkits and resources developed by government, public sector bodies, universities and other organisations. It focuses on the ethical aspects of technological design and use, together with the ethical impacts of digital technology on society as whole.

Ethics by design

These resources focus on ethical tools and resources that support the design phase of the use of emerging technologies and data analytics:

Consequence Scanning ManualDoteveryone.org

It introduces Consequence Scanning – an iterative development tool to help organisations think about the potential impact of their solutions or service on people and society.

AI Big Data Governance FrameworkCRO Forum

Guidance on how to apply a model risk framework in the use of Big Data and AI.

Oxford Governance of AI Centre ResourcesGovernance of AI (GovAI), at the Future of Humanity Institute

Resource compendium from the Centre for the Governance of AI (GovAI), at the Future of Humanity Institute at the University of Oxford, aimed at decision-makers in private industry, civil society, and policy.

Algorithmic Accountability Toolkit (AI Now)AI Now

Algorithmic Accountability Policy Toolkit setting out options for combatting bias in data analytics.

Responsible Machine Learning PrinciplesInstitute for Ethical AI & Machine Learning

A practical framework to develop AI responsibly the 8 principles of responsible ML development provide a practical framework to support technologists when designing, developing or maintaining systems that learn from data.

Ethical Operating System ToolkitInstitute for the Future

The Ethical Operating System Toolkit is designed to facilitate better product development, faster deployment, and more impactful innovation. The toolkit can help inform your design process and manage risks around emerging technologies.

Ethics Design Toolkit (Delft TU)Delft TU

These tools will help you uncover, explore and discuss the ethical aspects of your designs. The tools are grouped based on the skill they help you develop and can be used in different phases of the design process.

Algorithmic Equity Toolkit (OII)University of Oxford – Oxford Internet Institute

The AEKit includes four components that can be used to better understand artificial intelligence (AI) and surveillance technologies, and that can be used to support posing critical questions about those technologies: (1) a flowchart to identify AI, (2) a list of key definitions, (3) a worksheet to think through the stakeholders involved in a technology, and (4) a list of critical questions to ask about AI or surveillance software.

Responsible AI Policy Framework ITechlaw

Framework to support organisations that seek to develop, deploy or use AI systems and help ensure that such activity is consistent with the overall ethical purposes of beneficence and non-maleficence.

Fairness toolkitUnbias

The Fairness Toolkit aims to promote awareness and stimulate a public civic dialogue about how algorithms shape online experiences and to reflect on possible changes to address issues of online unfairness.

Practical guide to digital ethicsChartered Insurance Institute

The Digital Companion explains how the ethics remains relevant to all our roles in an increasingly digital world. These guidelines bring the code to life
with examples and case studies.

Data Justice Lab ResourcesData Justice Lab

Links to data literacy tools for anyone working directly or indirectly with data in the public sector, including data practitioners (statisticians, analysts and data scientists), policymakers, operational staff and those helping produce data-informed insight, to ensure the highest ethical standard of their projects.

Ethical ICT Assessment MethodologyBritish Computer Society BCS

The Chartered Institute for IT, Ethics Group ethical assessment of new technologies: meta-methodology designed to help diverse organisations and individuals conduct ethical assessments of new and emerging technologies.

Framework to operationalise AI ethicsAI Ethics Impact Group

Outlines the practical implementation framework for AI ethics focussing on: (1) the context-dependency of realising ethical values, (2) the sociotechnical nature of AI usage and (3) the different requirements of different stakeholders.

Data Ethics Decision Aid UtrechtUtrecht University

Data Ethics Decision Aid (DEDA) helps data analysts, project managers and policy makers to recognize ethical issues in data projects, data management and data policies.

Responsible Machine Learning PrinciplesInstitute for Ethical AI & Machine Learning

A practical framework to develop AI responsibly. The 8 principles of responsible ML development provide a practical framework to support technologists when designing, developing or maintaining systems that learn from data.

Ethics Kit | Methods & tools for ethics in the design processethicskit.org

Methods & tools for ethics in the design process.

Responsible Research and Innovation ToolkitResponsible Research and Innovation

Responsible Research and Innovation Toolkit looks at different aspects of the relationship between R&I and society: public engagement, open access, gender equality, science education, ethics, and governance.

Machine Learning Principles and PracticesFairness, Accountability, and Transparency in Machine Learning

Model Accountable Algorithms and a Social Impact Statement for Algorithms.

ADAPT Ethics CanvasDublin University

The Ethics Canvas helps you structure ideas about the ethical implications of the projects you are working on, to visualise them and to resolve them.

Guide for Ethical Data ScienceRoyal Statistical Society (RSS) and Institute and Faculty of Actuaries (IFoA)

Tools to complement existing ethical and professional guidance and is aimed at addressing the ethical and professional challenges of working in a data science setting.

Ethical, safe, lawful AI toolkitLinklaters

This toolkit provides a brief overview of the UK legal issues that arise when rolling out artificial intelligence within organisations.

Public Sector Data Analytics GuideNesta

This guide and its related tool are for public sector organisations who are interested in using data analytics to make better decisions and improve public services.

Institute for Ethics and Emerging Technologies tools and resourcesInstitute for Ethics and Emerging Technologies

Institute for Ethics and Emerging Technologies tools and resources focusing on which technologies, especially new ones, are likely to have the greatest impact on human beings and human societies in the 21st century and what are the ethical issues do those technologies and their application.

Toolkit for Centring Racial Equity Throughout Data IntegrationActionable Intelligence for Social Policy, University of Pennsylvania

This toolkit is designed to help guide partnerships, collaboratives, agencies, and community initiatives seeking to centre racial equity while using, sharing, and integrating administrative data.

The Machine Ethics ToolkitCopenhagen Institute of Interaction Design

Machine Ethics Toolkit is a DIY workshop for artificial intelligence and machine learning companies. Machine ethics is concerned with what machine intelligence should do when presented with ethical scenarios. With this toolkit, you can facilitate a workshop to learn philosophical moral theories and an ethical decision-making framework. This toolkit aims to encourage companies to integrate ethical considerations into their workflow and think critically about their work.

Guidelines for the Ethical Development of AI and Big Data SystemsSHERPA Project

Guidelines for the Ethical Development of AI and Big Data Systems: An Ethics by Design approach. They are intended to be actionable guidelines for systems and software development, rather than abstract principles that have no direct application in practice.

Exercise in a BoxNational Cyber Security Centre

Exercise in a Box is an online tool from the NCSC which helps organisations test and practise their response to a cyber-attack. The service provides exercises, based around the main cyber threats, which organisations can do in their own time, in a safe environment, as many times as they want. It includes everything you need for setting up, planning, delivery, and post-exercise activity, all in one place.

Ethics of use

These outlines sources on ethical tools and resources that that examine the impacts of emerging technologies and data analytics on wider society:

Ethical Tools overview – Open Rights Group

Provides an overview of ethical tools available in the field of data, technology and other related areas. It is not a comprehensive review, but an initial map

of initiatives and issues with further research being required in order to have a deep and systematic understanding of these tools

Ethical Tech Initiatives Directory – Doteveryone

This directory focuses on initiatives which help make more tech responsible/ethical, rather than individually ethical products or services.

Empowering AI Leadership ToolkitWorld Economic Forum

This resource for boards of directors consists of: an introduction; 13 modules intended to align with traditional board committees, working groups and oversight concerns; and a glossary of artificial intelligence (AI) terms.

Ethics Toolkit (CGE Johns Hopkins University) – John Hopkins University and partners

the main goal of the new algorithm toolkit is to ensure automated decisions are fair and the unintentional harm to constituents is minimized. The toolkit provides a risk management approach and helps users better understand the risks and benefits associated with algorithm-based decision making in local government.

Ethical Digital Policy Toolkit – Barcelona Region

An open source Policy Toolkit for cities to develop digital policies that put citizens at the centre and make Governments more open, transparent, and collaborative.

Ethical Data Patterns – Projectsbyif

Catalogue to help teams make decisions about how, when and why to collect and use data about people.

Digital Cities Toolkit – UN Habitat

An open source Policy Toolkit for cities to develop digital policies that put citizens at the centre, tackle Sustainable Development Goals and make Governments more open, transparent, and collaborative.

TOOLKIT Virtue Project – VIRT-EU

The Ethical Stack is a series of tools to support creators of new connected technology to reflect on their product’s ethical and social impacts.

Participatory Digital Mapping Ethics Tools – New York Technology Salon

Collection of Ethics and Responsibilities of Participatory Digital Mapping. Links and Resources.

Data, Communities and Ethical ResilienceRockefeller Foundation

The Framework address questions and issues that arise when conducting data-oriented community resilience projects, through emphasising six domains: Ethics, Governance, Science, Technology, Place, and Sociocultural context.

Digital Placemaking Institute Tools and Resources – Digital Placemaking Institute

Digital Placemaking Institute resources drawn emerging digital placemaking practitioners across arts, local government and institutions, public /private sectors, planning and development, and with academic research, engaged scholarship, and demonstration projects.

Calvium Digital Placemaking Resources – Calvium

Digital placemaking resources and case studies to boost the social, cultural, environment and economic value of places by using location-specific digital technology.

Markkula Centre Technology Ethics Resources – Markkula Centre for Applied Ethics

Markkula Centre for Applied Ethics resources addresses issues arising from issues such as human enhancement ethics, catastrophic risk and ethics and technology ethics. AI ethics and corporate tech ethics development and training are researched, created, and delivered in collaboration with Internet Ethics.

Democratising Decisions Technology Toolkit – Royal Society of Arts (RSA)

A toolkit for organisations seeking to support wider community engagement in the deploying their own ethical processes around the proliferation of AI.

Building Digitally Inclusive Communities Model – International City/County Management Association and partners

Model framework for people, businesses, and institutions will have access to digital content and technologies that enable them to create and support healthy, prosperous, and cohesive 21st-century communities.

Digital Ethics Guide for Social Workers – British Association of Social Workers (BASW)

Resources for social workers and social care organisations to consider in relation to their ethical responsibilities when using digital technology.

ODI Emerging Tech Resources – Open data institute

Emerging technologies, such as artificial intelligence and blockchain, are being proposed as tools to help organisations innovate and improve efficiencies. Open data institute tools and resources to help explore how these technologies can be best applied to help solve current and future problems.

Emerging Technologies and Freedom Expression Resources – Council of Europe

Resources and tools on the interaction of emerging technologies and data analytics with regards to Human Rights.

Digital Impact Toolkit – Stanford University

A curated collection of external tools and resources from around the world to help your organization use digital resources safely, ethically and effectively toward mission.

Guidelines for the Ethical Use of AI and Big Data System – Sherpa Project

Guidelines for the Ethical Use of AI and Big Data Systems: An Ethics by Design approach. They are intended to be actionable guidelines for systems and software development, rather than abstract principles that have no direct application in practice.

Civic Cyber Resilience Model – Think Cyber Think Resilience

Civic Cyber Resilience Model (CCRM) developed by the Think Cyber Think Resilience initiative in conjunction with the wider National Cyber Security Programme sets out the strategic headlines and provides relevant prompts for the actions civic organisations need to consider in devising their own cyber resilience strategy.

Societal ethics

These outlines sources on ethical tools and resources that that examine the impacts of emerging technologies and data analytics on wider society:

Doughnut Economics Action Lab (DEAL) ToolsDoughnut Economics Action Lab (DEAL)

Repository of Tools & Stories – How-to guides for others to use and adapt, and examples of Doughnut Economics in action

Ethics guidelines for trustworthy AI – High-Level Expert Group on Artificial Intelligence (AI HLEG)

EU Guidelines, that defines trustworthy AI as being (1) lawful – respecting all applicable laws and regulations (2) ethical – respecting ethical principles and values and (3) robust – both from a technical perspective and taking into account its social environment

Assessment List for Trustworthy Artificial Intelligence (ALTAI) for self-assessmentHigh-Level Expert Group on Artificial Intelligence (AI HLEG)

The tool supports the actionability the key requirements outlined by the Ethics Guidelines for Trustworthy Artificial Intelligence (AI)

OPSI Primer on AI for the Public SectorObservatory of Public Service Innovation

A guidance primer to equip public servants with tools and resources that can help them in exploring AI through a technical explainer, mapping of public sector landscape looking at implications for governance and emerging guidance.

AI Resources (Partnership on AI)Partnership on AI

Tools and resources based on Partnership on AI research that advances the understanding of AI technologies including machine perception, learning, and automated reasoning

Responsible Technology Resources – Omidyar Network

Responsible technology resources that support the concept of a global technological ecosystem that reaches and works for everyone: One that balances innovation with responsibility, regardless of whether technology is deployed by individuals, companies, or governments.

International AI Strategy PortalHoloniq

Curated collection of 50 national AI strategies

Tech Ethics Tools ListingSalesforce

Listing of Salesforce curated Ethical frameworks, tool kits, principles

ITU AI PortalITU

International Telecommunications Union listing of AI resources and tools

AI Ethics Toolkits ListingIntel Research

Intel curated AI ethics tools listing covering issues like fairness, accountability, transparency, privacy, human rights, and security.

ACM Code of EthicsACM

Association of Computer Machinery Code of Ethics and Professional Conduct

Public Voice AI universal guidelinesPublic Voice

Universal Guidelines to inform and improve the design and use of AI. The Guidelines are intended to maximise the benefits of AI, to minimise the risk, and to ensure the protection of human rights.

AI Ethics workshop ResourcesAI Ethics workshop

Virtual Workshop resources on Ethical, Social and Governance Issues in AI and Data Analytics.

Public Policy: Why ethics matters Australian National University

Outlines how ethical principles that can help to inform our behaviour, whether as citizens, voters, policy analysts, or decision makers, as well as the normative considerations that should guide our choices over the substantive content of public policy.

AI Governance DatabaseNESTA

This database is an information resource about global governance activities related to artificial intelligence. It is designed as a tool to help researchers, innovators, and policymakers better understand how AI governance is developing around the world.

Algorithm Watch AI Ethics Guidelines Global InventoryAlgorithm Watch

AI Ethics Guidelines Global Inventory, a project by Algorithm Watch that maps frameworks that seek to set out principles of how systems for automated decision-making (ADM) can be developed and implemented ethically.

AI Knowledge MapFrancesco Corea

An architecture model to access knowledge on AI and follow emergent dynamics, a gateway on pre-existing knowledge on the topic that will allow you to scout around for additional information and eventually create new knowledge on AI.

Applied AI Ethics Typology CollectionDigital Ethics Lab and partners

Applied AI Ethics typology based on the 7 stages of ML algorithm development, along the sides are the ethical principles and their requirements.

Applied AI Ethics ResourceDigital Ethics Lab and partners

Full reading and resource list compiled for the What to How of AI Ethics project.

IoT Resources – Petras

Resources and tools from the PETRAS National Centre of Excellence monitoring technological advances in the Internet of Things (IoT) so that they are developed and applied in consumer and business contexts, safely and securely.

AI Human Rights ToolsCouncil of Europe

Model framework built around emerging international practice on the AI Human Rights Tools.

AI and Human Rights Tools Australian Government

Model framework built around emerging international practice on the AI Human Rights Scrutiny Tools.

AI Governance and Compliance ResourcesFuture of Privacy Forum

FPF listing of artificial intelligence and machine learning ethics governance and compliance resources.

AIethicist ResourcesAIethicist

Collection of AI Frameworks, Guidelines and Toolkits.

Montreal AI Ethics research resourcesMontreal AI Ethics Institute

Montreal AI Ethics research resources defining humanity’s place in a world increasingly characterized and driven by algorithms. Focussing on the creating tangible and applied technical and policy research in the ethical, safe, and inclusive development of AI.

Building Resilience TogetherThink Cyber Think Resilience

Guidance and resources supporting cyber resilience capability building across the local public services and resilience organisations. For leaders, policy makers, professionals and officials working in the areas cyber security cyber security and community/organisational resilience.

Teaching Public Service in the Digital Age Teaching Public Service in the Digital Age

A new, international community of professors, teachers and practitioners who are worried about the modern skills shortfall inside of too many governments. They have come together to develop both a friendly community, and a set of practical initiatives with a shared goal: to increase the supply of digital-era public service skills into governments.

Interoperability AcademyInteroperability Academy

EU’s ‘Interoperability Academy’ that aims at contributing to advanced digital skills of public servants in the area of interoperability to support policy, service delivery and impact evaluation

Case Studies