An Approach to Solving the Abstraction and Reasoning Corpus (ARC) Challenge

06/06/2023
by   Tan John Chong Min, et al.
0

We utilise the power of Large Language Models (LLMs), in particular GPT4, to be prompt engineered into performing an arbitrary task. Here, we give the model some human priors via text, along with some typical procedures for solving the ARC tasks, and ask it to generate the i) broad description of the input-output relation, ii) detailed steps of the input-output mapping, iii) use the detailed steps to perform manipulation on the test input and derive the test output. The current GPT3.5/GPT4 prompt solves 2 out of 4 tested small ARC challenges (those with small grids of 8x8 and below). With tweaks to the prompt to make it more specific for the use case, it can solve more. We posit that when scaled to a multi-agent system with usage of past memory and equipped with an image interpretation tool via Visual Question Answering, we may actually be able to solve the majority of the ARC challenge

READ FULL TEXT

page 8

page 9

research
04/28/2022

Inferring Implicit Relations with Language Models

A prominent challenge for modern language understanding systems is the a...
research
05/26/2023

LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations

Can a Large Language Model (LLM) solve simple abstract reasoning problem...
research
12/01/2021

First Steps of an Approach to the ARC Challenge based on Descriptive Grid Models and the Minimum Description Length Principle

The Abstraction and Reasoning Corpus (ARC) was recently introduced by Fr...
research
03/14/2018

Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

We present a new question set, text corpus, and baselines assembled to e...
research
12/19/2022

KNIFE: Knowledge Distillation with Free-Text Rationales

Free-text rationales (FTRs) follow how humans communicate by explaining ...
research
03/15/2017

Neural Programming by Example

Programming by Example (PBE) targets at automatically inferring a comput...
research
10/13/2022

FOON Creation and Traversal for Recipe Generation

Task competition by robots is still off from being completely dependable...

Please sign up or login with your details

Forgot password? Click here to reset