CPSC Publishes Report on Artificial Intelligence and Machine Learning
June 3, 2021 | Cheryl A. Falvey, Monty Cooper, Jessica Gilbert
On May 21, 2021, the U.S. Consumer Products Safety Commission (“CPSC”) published a report on artificial intelligence (AI) and machine learning (ML) in consumer products. The report highlights recent CPSC staff activity concerning AI and ML, proposes a framework for evaluating the potential safety impact of AI and ML capabilities in consumer products, and makes several recommendations that the CPSC can take in identifying and addressing potential hazards related to AI and ML capabilities in consumer products.
Concerning staff activity, CPSC recently hired a Chief Technologist with a background in AI and ML to address the use of AI in consumer products. The CPSC also recently established an “AI/ML Working Group” and held a virtual forum on AI and ML in March 2021.
Informed by the discussions held with various stakeholders at this forum, the CPSC staff has proposed a framework in the report for evaluating the potential safety impact of AI and ML in consumer products. The framework’s first step involves screening products for AI and ML “components.” The CPSC and stakeholders have identified the following components to be essential to producing an AI capability: data sources, algorithms, computations, and connections. Likewise, the CPSC and stakeholders have found the following components to define ML capabilities: assessing and monitoring outputs, analyzing and modeling changes, and adjusting and adapting behavior over time. The framework’s second step involves assessing the functions and features of consumer products’ AI and ML capabilities. The third step involves understanding how products’ AI and ML capabilities may impact consumers, which can be accomplished by studying the nature of the technology, how it is implemented in the product, and how the consumer might use the product. The final step involves ascertaining if, and to what extent, AI and ML capabilities may transform the product and/or its use over time.
The framework demonstrates the CPSC’s focus on the impact AI may have on the long-term safety of products that may operate differently as they evolve over time. Identifying a defect that could present a safety risk can be challenging in an AI product because the product in the hands of consumers is not the same product that came off the manufacturing line. If those changes over time could result in emerging safety issues, those risks would need to be reported to the CPSC. The timing of those reports could be tricky if a defect emerges due to product transformations in only certain applications or use cases, but may not emerge in some or all products, or in all products at the same time given different usage patterns. The framework appears to be designed to explore these issues. It is also broad enough to allow the CPSC to do more than spot emerging defects and hazards. It should also allow them to identify safety advantages in AI and ML technologies that may enable products to identify and mitigate potential hazards before they manifest thereby eliminating risks and increasing the overall safety of products.
The report also outlines a set of recommendations for future steps the CPSC can take to address AI and ML-related product safety concerns. First, the CPSC should continue building upon the discussions it held with stakeholders at the March 2021 forum. Second, and arguably most significantly, the CPSC should focus on voluntary standards development with respect to AI and ML, as it has done with other technologies. And it should leverage private-public partnerships to do so.
The CPSC also plans to address product testing. Product testing is important because, in the past, the CPSC has faced the challenge of replicating product safety incidents due to the constant changes in AI and ML technologies. The CPSC is also exploring different collaborative efforts with various stakeholders, including interagency agreements. Additionally, the CPSC has expressed a desire to work with investigators, data scientists, and AI and ML subject matter experts, to develop tools for them so that they too can work with the CPSC’s partner stakeholders, and to hire new staff with AI, ML, or related technical backgrounds. Given these plans and efforts, the CPSC is likely to prioritize AI and ML in its fiscal year 2022 Operating Plan.
Thank you to Crowell & Moring summer associate, Helena Alvarez, for her contributions to this article.