An event-related potential study on cross-modal conversion of Chinese characters

In the current study, we explored the effects of ERPs (event-related potentials), related to the cross-modal transfer from visual input to phonological retrieval. Using Chinese single-character words, participants were asked to make orthographic (intra-modal) and phonological (cross-modal) responses to visually presented words. By comparing the cross-modal and intra-modal tasks, we found that both tasks evoke similar activity in the early stage of lexical processing, showing the same pattern of N2 effect (a negative component peaking around 220 ms) and P2 effect (a positive component peaking around 270 ms). However, the effect of the task was significant in the 300–700 ms time window, consisting of a frontal-based N400 effect and a parietal based late positive component (LPC) effect. These findings suggest that the frontal-based N400 is associated with orthography-to-phonology mapping in Chinese, and the LPC reflects greater requirement of maintaining retrieved information in working memory for the cross-modal processing.

► We used event-related potential technique to examine electrophysiological markers for cross-modal conversion in Chinese.
► N400 effect in prefrontal region was specifically associated with cross-modal conversion from orthography to phonology in Chinese.
► Late positive component (LPC) reflected the phonological maintenance in working memory when performing cross-modal conversion.