Close
This site uses cookies

By using this site, you consent to our use of cookies. You can view our terms and conditions for more information.

Mechanisms of Adaptation to Unsignaled Changes in Reinforcement Contingencies: A Bayesian Model Comparison

Authors
Luis Baroja
University of California, Irvine ~ Department of Cognitive Sciences
Joachim Vandekerckhove
University of California, Irvine ~ Department of Cognitive Sciences
Abstract

Adaptive behavior requires organisms to adjust their choices when environmental constraints change. The matching law is a widely established model of choice behavior, describing how organisms allocate their responses across different alternatives as a function of the relative rewards obtained from them. However, while matching describes behavior at equilibrium, there are still open questions regarding how animals reach such equilibrium and how they adjust and redistribute their choices when the relative payoff from each alternative suddenly changes. In this study, we examine the behavior of six pigeons responding to dynamic concurrent VI-VI schedules, in which the scheduled relative rates of reinforcement abruptly change within sessions. After such a change occurred, the birds started adjusting to the new equilibrium relatively quickly, but fully reaching the new matching prediction took them considerably longer. To account for these results, we compare different models of choice that consider different mechanisms, including the influence of previous reinforcers, the passage of time, and the tendency to repeat previous choices. We use a Bayesian approach to compare these models, with particular attention to whether the observed adjustments reflect gradual changes in learned preferences, persistence in responding, or some combination of both. We explore whether these mechanisms produce different predictions regarding the nature of the post-change adjustment and how well they account for the initial rapid adjustment and the slower convergence toward the new matching equilibrium. Our goal is to understand the processes underlying adaptation to changing environments and exploit the usefulness of the Bayesian framework in separating latent learning dynamics from observed choice behavior.

Tags

Keywords

Choice
matching law
change detection
Bayesian model comparison
Discussion
Must be registered to comment

There is nothing here yet. Be the first to create a thread.

Cite this as:

Baroja, L., & Vandekerckhove, J. (2026, November). Mechanisms of Adaptation to Unsignaled Changes in Reinforcement Contingencies: A Bayesian Model Comparison. Abstract published at MathPsych @Psychonomics Satellite Symposium 2026. Via mathpsych.org/presentation/2294.