Unraveling the ARC Puzzle: Mimicking Human Solutions with Object-Centric Decision Transformer
Abstract: In the pursuit of artificial general intelligence (AGI), we tackle Abstraction and Reasoning Corpus (ARC) tasks using a novel two-pronged approach. We employ the Decision Transformer in an imitation learning paradigm to model human problem-solving, and introduce an object detection algorithm, the Push and Pull clustering method. This dual strategy enhances AI's ARC problem-solving skills and provides insights for AGI progression. Yet, our work reveals the need for advanced data collection tools, robust training datasets, and refined model structures. This study highlights potential improvements for Decision Transformers and propels future AGI research.
- Communicating Natural Programs to Humans and Machines. In NeurIPS, 2022.
- An Approach for Solving Tasks on the Abstract Reasoning Corpus. arXiv:2302.09425, 2023.
- Global Overview of Imitation Learning. arXiv:1801.06503, 2018.
- Dreaming with ARC. In NeurIPS Workshop on Learning Meets Combinatorial Algorithms, 2020.
- Borji, A. A Categorical Archive of ChatGPT failures. arXiv:2302.03494, 2023.
- Language Models are Few-Shot Learners. In NeurIPS, 2020.
- End-to-End Object Detection with Transformers. In ECCV, 2020.
- Decision Transformer: Reinforcement Learning via Sequence Modeling. In NeurIPS, 2021.
- Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv:1706.05587, 2017.
- Chollet, F. On the Measure of Intelligence. arXiv:1911.01547, 2019.
- RandAugment: Practical Automated Data Augmentation with a Reduced Search Space. In NeurIPS, 2020.
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In ICLR, 2021.
- Dreamcoder: Bootstrapping Inductive Program Synthesis with Wake-Sleep Library Learning. In PLDI, 2021.
- A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. In KDD, 1996.
- Fast and Flexible: Human Program Induction in Abstract Reasoning Tasks. In CogSci, 2021.
- Deeply-Recursive Convolutional Network for Image Super-Resolution. In CVPR, 2016.
- Playgrounds for Abstraction and Reasoning. In NeurIPS Workshop on Neuro Causal and Symbolic AI, 2022.
- Building Machines that Learn and Think like People. Behavioral and Brain Sciences, 40, 2017.
- Feature Pyramid Networks for Object Detection . In CVPR, 2017.
- Object-Centric Learning with Slot Attention. In NeurIPS, 2020.
- Melo, L. C. Transformers are Meta-Reinforcement Learners. In ICML, 2022.
- The ConceptARC benchmark: Evaluating Understanding and Generalization in the ARC Domain. arXiv:2305.07141, 2023.
- Learning Compositional Rules via Neural Program Synthesis. In NeurIPS, 2020.
- Evaluating Understanding on Conceptual Abstraction Benchmarks. arXiv:2206.14187, 2022.
- You Only Look Once: Unified, Real-Time Object Detection. In CVPR, 2016.
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In NeurIPS, 2015.
- Structured World Representations Via Block Slot Attention. In ICLR, 2023.
- Behavioral Cloning from Observation. In IJCAI, 2018.
- Prompting Decision Transformer for Few-Shot Policy Generalization. In ICML, 2022.
- Graphs, Constraints, and Search for the Abstraction and Reasoning Corpus. In AAAI, 2023.
- LIMA: Less is More for Alignment. arXiv:2305.11206, 2023.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.