ARC 1 was originally released in November 2019, and was the subject of a public Kaggle competition with a $20,000 prize in early 2020. The contest ended with the best entrant solving 20.6% of test tasks. Two years later, in mid-2022, the state-of-the-art on ARC 1 is nearly 30%.
ARC 1 featured 1,000 tasks split between 400 generally easier training tasks, 400 validation tasks, and 200 tasks forming the private test set. Half of the private test set was used as the test set in the original Kaggle competition.
While ARC 1 was the work of a single person, ARC 2 is intended to be the work of many: to ensure scale and task diversity, we are opening up the task-creation process to the crowd. You can create new tasks using the public ARC editor and submit them for inclusion in ARC 2. We look forward to as many contributions as possible and appreciate your submissions. ARC 2 is hosted by François Chollet and Lab42. If you have any questions, feel free to contact us any time.
Once the ARC 2 set is created, we will run a competition on ARC 2. The goal of the competition is to develop an AI that is able to solve over 90% of the tasks in the private test set, without advance knowledge of the tasks. We intend to run the competition until the goal is achieved. This time not only will there be prize money, but we will also engrave the winners' names for eternity (or almost), and the winners will be invited on a memorable trip to Davos, Switzerland.