Since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.5 month doubling time (by comparison, Moore's Law had an 18 month doubling period).
OpenAIWe've analyzed compute used in major AI results for the past decades and identified two eras in AI:
1) Prior to 2012 - AI results closely tracked Moore's Law, w/ compute doubling every two years.
2) Post-2012 - compute has been doubling every 3.4 months openai.com/blog/ai-and-co…pic.twitter.com/ILN5MRrWYH
We've trained a pair of neural networks to solve the Rubik’s Cube with a human-like robot hand.
OpenAIWe've trained an AI system to solve the Rubik's Cube with a human-like robot hand.
This is an unprecedented level of dexterity for a robot, and is hard even for humans to do.
The system trains in an imperfect simulation and quickly adapts to reality: openai.com/blog/solving-r…pic.twitter.com/8lGhU2pPck
OpenAINow accepting applications for our 3rd class of OpenAI Scholars: a 4 month full-time program for individuals from underrepresented groups to study deep learning and produce an open-source project. Mentors include @mcleavey, @natashajaques, @SabrinaOsmany
OpenAINow accepting applications for our 3rd class of OpenAI Scholars: a 4 month full-time program for individuals from underrepresented groups to study deep learning and produce an open-source project. Mentors include @mcleavey, @karlcobbe, @AlecRad
We’ve fine-tuned the 774M parameter GPT-2 language model using human feedback
for various tasks, successfully matching the preferences of the external human
labelers, though those preferences did not always match our own. Specifically,
OpenAIWe've fine-tuned GPT-2 using human feedback for tasks such as summarizing articles, matching the preferences of human labelers (if not always our own). We're hoping this brings safety methods closer to machines learning values by talking with humans.
We've observed agents discovering progressively more complex tool use while playing a simple game of hide-and-seek.
OpenAIWe've observed AIs discovering complex tool use while competing in a simple game of hide-and-seek. They develop a series of six distinct strategies and counterstrategies, ultimately using tools in the environment to break our simulated physics
We’ve developed a method to assess whether a neural network classifier can reliably defend against adversarial attacks not seen during training.
OpenAIWe're releasing a new method to test for model robustness against adversaries not seen during training, and open-sourcing a new metric, UAR (Unforeseen Attack Robustness), which measures how robust a model is to an unanticipated attack: openai.com/blog/testing-r…pic.twitter.com/8yJdd6oD5T
We’re releasing the 774 million parameter GPT-2 language model after the release of our small 124M model in February, staged release of our medium 355M model in May, and subsequent research with partners and the AI community into the model’s...
OpenAIGPT-2 6-month follow-up: we're releasing the 774M parameter model, an open-source legal doc organizations can use to form model-sharing partnerships, and a technical report about our experience coordinating to form new publication norms
At OpenAI, each Thursday is Learning Day: a day where employees have the option to self-study technical skills that will make them better at their job but which aren’t being learned from daily work.
OpenAIEach Thursday at OpenAI is Learning Day: a day where employees have the option to self-study technical skills that will make them better at their job but which aren't being learned from daily work.
Here's how it works
We've written a policy research paper identifying four strategies that can be
used today to improve the likelihood of long-term industry cooperation on safety
norms in AI: communicating risks and benefits, technical collaboration,
We present the OpenAI Remote Rendering Backend (ORRB), a system that allows
fast and customizable rendering of robotics environments. It is based on the
Unity3d game engine and interfaces with the MuJoCo physics simulation library.
ORRB was designed...
On Thursday, June 13, 2019 at 9:00 am, the House Permanent Select Committee on Intelligence will convene an open hearing on the national security challenges ...
OpenAIOur Policy Director, @jackclarkSF, will be testifying today to the House Intelligence Committee on "The National Security Challenge of Artificial Intelligence, Manipulated Media, and 'Deepfakes' " at 6amPT/9amET. Watch livestream
Our second class of OpenAI Scholars has concluded, with all eight scholars
producing an exciting final project showcased at Scholars Demo Day at OpenAI.
Over the past three months, we’ve seen how experienced engineers working in