Lesson two: Broad community building is crucial
Community building that emphasizes skills, communication, and diversity is crucial for ensuring that certification is reliable and accountable. Other sectors, like cybersecurity and healthcare, as well as cross-sector communities organized around ESG and sustainability principles, provide models for how this can work.
Building a wider community
A wider community of organizations and individuals within a sector can help address demand for the skills needed to assure AI systems, and feed a burgeoning profession of certification experts. These skills should not be limited to assurance professionals but must be embedded throughout the wider sector; challenges can surface when assurance knowledge is not available or accessible to those building the systems subject to assurance, for example, the engineering community in cybersecurity. With a basic knowledge of assurance embedded throughout a sector, individuals and organizations can more effectively work with assurance professionals to build, test, and deploy trustworthy systems.
Effective communication and knowledge exchange
Technical skills for assurance must be accompanied by effective communication and knowledge exchange. Translating technical jargon into findings understandable to organizations and individuals, and listening to feedback from users, are both critical to the success of certification systems. Public engagement to explore the language consumers are using could help organizations to understand what enables different groups to have confidence in trustworthy systems.
Mitigating systemic risks
Strong community structures can also help mitigate major systemic risks, and reduce the likelihood of harms occurring. The risk of loss or isolation of institutional knowledge in engineering systems, for example, in the aerospace industry, may contribute to serious accidents and even fatalities, but can be mitigated by providing mechanisms and promoting norms for knowledge exchange and sharing.
Lesson three: In a changing environment, balance between flexibility and robustness is essential
Managing change
Certification systems often operate in dynamic, rapidly changing environments and must be resilient to substantial and continual change to remain effective. This process of change brings both challenge and opportunity. If managed appropriately, change can play a positive role, sustaining and promoting justified trust, and increasing adoption of trustworthy systems over time. One common theme to emerge from a range of sectors was a tension between robustness and flexibility: certification must be resilient to changes that could undermine its effectiveness, but also be capable of modification and improvement when needed. Getting the balance right between these can be tricky, but is essential to mitigating the significant challenges posed by the process of change.
Robustness and flexibility
Certification must be robust, especially in light of the risks of failure or poor performance in safety-critical contexts like aerospace and nuclear safety. Effective governance, including grievance mechanisms and claims management like those in sustainability certification schemes, is seen as essential to ensure quality of certification and minimize the potential for false positives (e.g., a certificate granted in the absence of compliance with requirements). This is especially important in the case of a “race to the bottom” dynamic, which could enable low-quality or unfounded certification, not only risking unjustified trust in untrustworthy systems, but also undermining trust in trustworthy certification.
Handling competition and new entrants
Another related question is how competition, and in particular, new entrants, will be handled, and how high the bar is set for organizations offering certification services to become accredited. New entrants (e.g., AI assurance startups) could drive the use of more effective AI assurance techniques, and help ensure the AI assurance market keeps pace with continual technological change. The bar for accreditation should therefore be set appropriately to avoid stifling innovation and competition, while ensuring the quality, impartiality, and competence of certification services.
From influencing enabling conditions to building effective certification schemes
From these three lessons, we have learned that certain key enabling conditions are necessary for certification to succeed: wider governance structures and mechanisms like principles, standards, and conformity assessment techniques, a diverse stakeholder community, and appropriate management of change over time will all be needed for certification to be effective.
Enabling conditions are the starting point, but certification schemes themselves must also be designed and operated appropriately in order to succeed. We will consider some common features of successful certification schemes in part three.
Conclusion
In conclusion, building a broad community, managing change, and achieving a balance between flexibility and robustness are essential for certification to be effective. By learning from the experiences of other sectors and incorporating these lessons into the development of AI certification schemes, we can create a robust and reliable framework for ensuring the trustworthiness of AI systems.
FAQs
Q: What is the importance of community building in certification?
A: Community building is crucial for ensuring that certification is reliable and accountable. A diverse community of organizations and individuals within a sector can help address demand for the skills needed to assure AI systems, and feed a burgeoning profession of certification experts.
Q: How can certification schemes achieve a balance between flexibility and robustness?
A: Certification schemes must be resilient to changes that could undermine their effectiveness, but also be capable of modification and improvement when needed. Effective governance, including grievance mechanisms and claims management, is essential to ensure quality of certification and minimize the potential for false positives.
Q: What is the role of new entrants in the certification market?
A: New entrants, such as AI assurance startups, could drive the use of more effective AI assurance techniques, and help ensure the AI assurance market keeps pace with continual technological change. The bar for accreditation should be set appropriately to avoid stifling innovation and competition, while ensuring the quality, impartiality, and competence of certification services.
