Universal Psychometrics Tasks: difficulty, composition and decomposition

03/26/2015
by   Jose Hernandez-Orallo, et al.
0

This note revisits the concepts of task and difficulty. The notion of cognitive task and its use for the evaluation of intelligent systems is still replete with issues. The view of tasks as MDP in the context of reinforcement learning has been especially useful for the formalisation of learning tasks. However, this alternate interaction does not accommodate well for some other tasks that are usual in artificial intelligence and, most especially, in animal and human evaluation. In particular, we want to have a more general account of episodes, rewards and responses, and, most especially, the computational complexity of the algorithm behind an agent solving a task. This is crucial for the determination of the difficulty of a task as the (logarithm of the) number of computational steps required to acquire an acceptable policy for the task, which includes the exploration of policies and their verification. We introduce a notion of asynchronous-time stochastic tasks. Based on this interpretation, we can see what task difficulty is, what instance difficulty is (relative to a task) and also what task compositions and decompositions are.

READ FULL TEXT
research
05/12/2020

Dynamic Models Applied to Value Learning in Artificial Intelligence

Experts in Artificial Intelligence (AI) development predict that advance...
research
07/30/2020

Modelos dinâmicos aplicados à aprendizagem de valores em inteligência artificial

Experts in Artificial Intelligence (AI) development predict that advance...
research
02/20/2022

Towards a Framework for Comparing the Complexity of Robotic Tasks

We are motivated by the problem of comparing the complexity of one robot...
research
11/24/2017

Identifying Reusable Macros for Efficient Exploration via Policy Compression

Reinforcement Learning agents often need to solve not a single task, but...
research
06/03/2021

Lifetime policy reuse and the importance of task capacity

A long-standing challenge in artificial intelligence is lifelong learnin...
research
03/02/2019

Discovering Options for Exploration by Minimizing Cover Time

One of the main challenges in reinforcement learning is solving tasks wi...
research
03/28/2014

Difficulty Rating of Sudoku Puzzles: An Overview and Evaluation

How can we predict the difficulty of a Sudoku puzzle? We give an overvie...

Please sign up or login with your details

Forgot password? Click here to reset