White House and AI Companies to Test ChatGPT and Other AI Systems at DEF CON 31

Published On Sat May 13 2023
White House and AI Companies to Test ChatGPT and Other AI Systems at DEF CON 31

White House Supports Public Evaluation of AI Systems at DEF CON 31

The Biden administration has announced that it supports public assessments of generative AI systems such as ChatGPT to educate the public about whether these new systems align with the administration's "bill of rights" for AI aimed at preventing the new technology's misuse. These assessments will take place at DEF CON 31, a hacker convention in Las Vegas scheduled for August.

The White House has received a commitment from leading AI developers, including Anthropic, Google, Hugging Face, Microsoft, NVIDIA, OpenAI, and Stability AI, to participate in a public evaluation of AI systems, consistent with responsible disclosure principles. This will allow these models to be evaluated thoroughly by thousands of community partners and AI experts to explore how the models align with the principles and practices outlined in the Biden-Harris Administration's Blueprint for an AI Bill of Rights and AI Risk Management Framework.

This independent exercise will provide critical information to researchers and the public about the impacts of these models and will enable AI companies and developers to take steps to fix issues found in those models. Testing of AI models independent of government or the companies that have developed them is an important component in their effective evaluation.

New National Research Institutes Studying AI

The National Science Foundation will spend $140 million to open seven new national research institutes studying AI, which will expand the number of institutes to 25 across the country. These institutes will work with institutes of higher education, private companies, and the government to "pursue transformative AI advances that are ethical, trustworthy, responsible, and serve the public good."

"The new Institutes announced today will advance AI R&D to drive breakthroughs in critical areas, including climate, agriculture, energy, public health, education, and cybersecurity," read the statement from the White House.

Policy Guidance for Federal Agencies on AI Systems

The White House's budget office plans to make public a draft of the policy guidance it plans to provide federal agencies with regarding the use of AI systems that makes sure its use "centers on safeguarding the American people's rights and safety." The draft will be released this summer, and the Office of Management and Budget will open it up for public comment before it's finalized.

Meeting with CEOs of Major AI Companies

The Vice President will meet with the CEOs of Alphabet, Anthropic, Microsoft, and OpenAI to "underscore" their "responsibility" as they develop AI and to emphasize the importance of driving responsible, trustworthy, and ethical innovation with safeguards that mitigate risks and potential harms to individuals and society. The meeting will be closed to the press.