Rep Casar Leads Demand for Information on AI Security Incidents

Rep. Greg Casar (D-TX) led members of Congress in demanding additional information from the artificial intelligence companies Anthropic and OpenAI regarding incidents in which AI models have hacked into other organizations. The members demand that Anthropic CEO Dario Amodei \release the logs regarding the incident and answer a series of detailed oversight questions including: whether or internal or external actors wanted the company about the risk of such an incident; why Anthropic’s evaluation partner failed to detect the incident; at what point the company could have halted the incident; what steps Anthropic is taking to ensure another incident like this does not happen again; what is known about the objective of each model that hacked another company; and details about Anthropic’s disclosure that Claude “tried and failed” to get real money. They demand that OpenAI CEO Sam Altman elease the logs regarding the incident and answer a series of detailed oversight questions including: how many times the model or similar models obtained access to the open internet from a training environment without authorization; whether internal or external actors warned the company about risks of such an incident; at what point the company could have halted the incident; whether OpenAI has observed models attempting to cheat, game, or defeat its evaluations in other tests; whether any model has taken actions to undermine OpenAI’s ability to control, align, or oversee future models; and what steps OpenAI is taking to implement stronger misalignment safeguards.

The letter to Anthropic is co-led by Rep. Doris Matsui (D-CA) and signed by U.S. Representatives Gabe Amo (RI-01), Yassamin Ansari (AZ-03), Becca Balint (VT-AL), Joaquin Castro (TX-20), Jasmine Crockett (TX-30), April McClain Delaney (MD-06), Bill Foster (IL-11), Valerie P. Foushee (NC-04), Jesús G. "Chuy" García (IL-04), Sylvia R. Garcia (TX-29), Adelita S. Grijalva (AZ-07), Jonathan L. Jackson (IL-01), Pramila Jayapal (WA-07), Ro Khanna (CA-17), Summer L. Lee (PA-12), Stephen F. Lynch (MA-08), Jennifer L. McClellan (VA-04), James P. McGovern (MA-02), Delia C. Ramirez (IL-03), Patrick Ryan (NY-18), Lateefah Simon (CA-12), and Nydia M. Velázquez (NY-07).

The letter to OpenAI is co-led by Rep. Doris Matsui (D-CA) and signed by U.S. Representatives Gabe Amo (RI-01), Yassamin Ansari (AZ-03), Nanette Diaz Barragán (CA-44), Becca Balint (VT-AL), Joaquin Castro (TX-20), Angie Craig (MN-02), Jasmine Crockett (TX-30), April McClain Delaney (MD-06), Chris Deluzio (PA-17), Bill Foster (IL-11), Valerie P. Foushee (NC-04), Jesús G. "Chuy" García (IL-04), Sylvia R. Garcia (TX-29), Adelita S. Grijalva (AZ-07), Val Hoyle (OR-04), Jonathan L. Jackson (IL-01), Pramila Jayapal (WA-07), Ro Khanna (CA-17), Summer L. Lee (PA-12), Stephen F. Lynch (MA-08), Jennifer L. McClellan (VA-04), James P. McGovern (MA-02), Delia C. Ramirez (IL-03), Patrick Ryan (NY-18), Lateefah Simon (CA-12), Suhas Subramanyam (VA-10), Rashida Tlaib (MI-12), Paul D. Tonko (NY-20), Nydia M. Velázquez (NY-07), and George Whitesides (CA-27).