Extrinsic reference frames modify the neural substrates of object-location representations

► The influence of extrinsic reference frames on spatial memory was examined using fMRI. ► Spatial information was either aligned or misaligned with a specified reference frame. ► Retrieval of aligned spatial information engaged ventral visual brain regions. ► Retrieval of misaligned spatial information engaged a prefrontal cortical network. ► Results provide neural support for the reference direction account of spatial memory.