Sequential Language-based Decisions

07/11/2023
by   Adam Bjorndahl, et al.
0

In earlier work, we introduced the framework of language-based decisions, the core idea of which was to modify Savage's classical decision-theoretic framework by taking actions to be descriptions in some language, rather than functions from states to outcomes, as they are defined classically. Actions had the form "if psi then do(phi)", where psi and phi were formulas in some underlying language, specifying what effects would be brought about under what circumstances. The earlier work allowed only one-step actions. But, in practice, plans are typically composed of a sequence of steps. Here, we extend the earlier framework to sequential actions, making it much more broadly applicable. Our technical contribution is a representation theorem in the classical spirit: agents whose preferences over actions satisfy certain constraints can be modeled as if they are expected utility maximizers. As in the earlier work, due to the language-based specification of the actions, the representation theorem requires a construction not only of the probability and utility functions representing the agent's beliefs and preferences, but also the state and outcomes spaces over which these are defined, as well as a "selection function" which intuitively captures how agents disambiguate coarse descriptions. The (unbounded) depth of action sequencing adds substantial interest (and complexity!) to the proof.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/22/2021

Language-based Decisions

In Savage's classic decision-theoretic framework, actions are formally d...
research
11/06/2015

An Action Language for Multi-Agent Domains: Foundations

In multi-agent domains (MADs), an agent's action may not just change the...
research
06/23/2009

Constructive Decision Theory

In most contemporary approaches to decision making, a decision problem i...
research
06/27/2022

Utility Theory for Sequential Decision Making

The von Neumann-Morgenstern (VNM) utility theorem shows that under certa...
research
01/05/2017

Toward negotiable reinforcement learning: shifting priorities in Pareto optimal sequential decision-making

Existing multi-objective reinforcement learning (MORL) algorithms do not...
research
06/22/2021

A Deontic Stit Logic Based on Beliefs and Expected Utility

The formalization of action and obligation using logic languages is a to...
research
01/21/2021

Mechanism Design for Cumulative Prospect Theoretic Agents: A General Framework and the Revelation Principle

This paper initiates a discussion of mechanism design when the participa...

Please sign up or login with your details

Forgot password? Click here to reset