Unbounded dynamic programming via the Q-transform

B-Tier
Journal: Journal of Mathematical Economics
Year: 2022
Volume: 100
Issue: C

Score contribution per author:

0.670 = (α=2.01 / 3 authors) × 1.0x B-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

We propose a new approach to solving dynamic decision problems with unbounded rewards based on the transformations used in Q-learning. In our case, however, the objective of the transform is not learning. Rather, it is to convert an unbounded dynamic program into a bounded one. The approach is general enough to handle problems for which existing methods struggle, and yet simple relative to other techniques and accessible for applied work. We show by example that a variety of common decision problems satisfy our conditions.

Technical Details

RePEc Handle
repec:eee:mateco:v:100:y:2022:i:c:s0304406822000143
Journal Field
Theory
Author Count
3
Added to Database
2026-01-25