A Structure-Enriched Neural Network for network embedding

Recent years have witnessed the importance of network embedding in many fields, as well as increased attention in academia. Although a number of algorithms have been proposed in this area, most existing models which only utilize the structure topology information of networks often suffer performance losses because of their insufficiency with regard to selecting structure similar patterns, handling noise data, and/or capturing non-linear or high-order structure information. To address these challenges, in this paper, we present a novel Structure-Enriched Neural Network (SENN) for network embedding. Specifically, SENN can not only capture the complex structure similar patterns observed in networks by introducing direction adjustment parameters of the transition probability, but also introduce a stacked denoise autoencoder to perform the dimension reduction for each order matrix independently. Therefore, SENN can preserve more useful structure information and make the embeddings more robust. Moreover, SENN can effectively integrate the multi-order structure information by the combining layer with attention mechanism. Finally, to compare with other state-of-the-art methods, we conduct extensive experiments with both synthetic and real-world datasets on various tasks (e.g.,node classification, visualization). The experimental results clearly demonstrate the effectiveness of our proposed model for network embedding.