OpenAI Co-founder Launches AI Firm
Ilya Sutskever, the former chief scientist and co-founder of OpenAI, has announced the establishment of a new AI company. The primary objective of the new company is to develop a “safe superintelligence.” Daniel Levy, a former member of OpenAI, and Daniel Gross, a former Apple AI director, are also co-founders of Safe Superintelligence Inc., as stated in the June 19 announcement.
Challenges and Objectives
The company considers the “ensured safety” of superintelligence as the “most significant technical challenge of our era” which is “within reach.” Safe Superintelligence Inc. aims to establish a “straight-shot safe superintelligence (SSI) lab” focusing solely on producing technology with a priority on safety. The firm is assembling a team of top engineers and researchers dedicated to this goal.
Development and Funding
The company aims to expedite the development of capabilities while maintaining a strong emphasis on safety. Safe Superintelligence Inc. has expressed that investors are on board with prioritizing secure development above all else. In an interview with Bloomberg, Sutskever refrained from disclosing financial sponsors or the total amount raised, while Gross expressed confidence in the company's ability to secure capital without difficulty.
Company Headquarters and Background
Safe Superintelligence Inc. is set to be headquartered in Palo Alto, California, with additional offices in Tel Aviv, Israel. The establishment of the company followed safety concerns at OpenAI, where a dispute led to the creation of Safe Superintelligence. Sutskever, a key figure involved in an attempt to remove OpenAI CEO Sam Altman, withdrew from the company in May, bringing attention to the importance of AI safety in the industry.
Recent departures of employees from OpenAI, including Jan Leike and Gretchen Krueger, have highlighted growing apprehensions regarding AI safety within the sector. Despite the disputes and transitions, Sutskever maintains a positive relationship with Altman and remains dedicated to advancing the field of AI safety through Safe Superintelligence Inc.
