California Governor Gavin Newsom has established a panel tasked with developing safety regulations for artificial intelligence companies, including the exploration of a potential "kill switch" for rogue AI programs.
Governor Newsom issued an executive order to assemble a group of leading experts who will provide guidance for the state to strengthen its AI security laws. The panel is expected to consider proposals for independent third-party safety plan development and for companies to implement emergency shutdown mechanisms.
This initiative comes as some political leaders nationwide are urgently seeking AI safety proposals following recent warnings from AI company employees about the potential for catastrophic outcomes, including existential threats to humanity. One researcher from AI company Anthropic voiced concerns that the rapid advancement of AI, which could surpass human intelligence, represents a significant gamble with human lives.
State Senator Chris Cabaldon, who chairs the committee overseeing technology issues, indicated that upcoming hearings on artificial intelligence will be informed by these recent developments. He noted that current state regulations for AI are insufficient, stating that businesses like barber shops or sandwich vendors face more oversight than companies developing technologies that could pose an existential threat.
Any new legislation enacted by California could significantly impact the global tech industry, given that many prominent AI companies are headquartered in the state. Previously, Governor Newsom vetoed a bill that would have mandated an AI "kill switch," citing concerns that such a measure could stifle innovation and that smaller AI models, which would have been exempt, could also pose risks.
