Distinct contributions of lateral orbito-frontal cortex, striatum, and fronto-parietal network regions for rule encoding and control of memory-based implementation during instructed reversal learning

A key element of behavioral flexibility is to quickly learn to modify or reverse previously acquired stimulus-response associations. Such reversal learning (RL) can either be driven by feedback or by explicit instruction, informing either retrospectively or prospectively about the changed response requirements. Neuroimaging studies have thus far exclusively focused either on feedback-driven RL or on instructed initial learning of novel rules. The present study examined the neural basis of instructed RL as compared to instructed initial learning, separately assessing reversal-related instruction-based encoding processes and reversal-related control processes required for implementing reversed rules under competition from the initially learned rules. We found that instructed RL is partly supported by similar regions as feedback-driven RL, including lateral orbitofrontal cortex (lOFC) and anterior dorsal caudate. Encoding-related activation in both regions determined resilience against response competition during subsequent memory-based reversal implementation. Different from feedback-driven RL, instruction-based RL relied heavily on the generic fronto-parietal cognitive control network - not for encoding but for reversal-related control processes during memory-based implementation. These findings are consistent with a model of partly decoupled, yet interacting, systems of (i) symbolic rule representations that are instantaneously updated upon instruction and (ii) pragmatic representations of reward-associated S-R links mediating the enduring competition from initially learned rules.