Behavioural divergence, interfertility and speciation: A review

Behavioural compatibility between mates is fundamental for maintaining species boundaries and is achieved through appropriate communication between males and females. A breakdown in communication will lead to behavioural divergence and reduced interfertility. In this review, we summarise the current knowledge on male signals and female perception of these signals, integrating the literature from several taxa. We advocate that signaller–perceiver coevolution, which is usually under strong stabilising selection to enable mating, forms the basis of species-specific mate recognition systems. The mechanisms (phylogeny, geography, ecology, biology) shaping signaller–perceiver systems are briefly discussed to demonstrate the factors underpinning the evolution of signaller–perceiver couplings. Since divergence and diversification of communication systems is driven by changes in the mechanical properties of sensory pathways and morphology of sensory organs, we highlight signal modalities (auditory, olfactory, visual, tactile) and their importance in communication, particularly in mate selection. Next, using available examples and generating a stylised model, we suggest how disruption (biological, ecological, stochastic) of signaller–perceiver systems drives behavioural divergence and consequently results in reduced interfertility and speciation. Future studies should adopt an integrative approach, combining multiple parameters (phylogeny, adaptive utility of communication systems, genetics and biomechanical/biochemical properties of signals and perception) to explore how disruption of signaller–perceiver systems results in behavioural divergence and reduced interfertility. Finally, we question the impact that rapid environmental change will have on disruption of communication systems, potentially interfering with signaller–perceiver couplings.

► Communication between males and females during courtship is required for mating (interfertility).
► Signals by one sex and the perception of these signals by the other sex are tightly coupled to ensure interfertility.
► We review the mechanics of signal transmission and reception (signaller–perceiver systems) for several communication cues.
► Disruption of signaller–perceiver systems results in behavioural divergence and can lead to speciation.
► Behavioural divergence studies require an integrated approach and should consider the role of rapid environmental changes.