Semantic embedding for indoor scene recognition by weighted hypergraph learning

•A novel approach to classify scenes by embedding semantic information.•A new hypergraph regularization by optimizing weights of hyperedges.•Constructing connectivity among images by using statistics of objects appearing in the same image.

Conventional methods for indoor scenes classification is a challenging task due to the gaps between images׳ visual features and semantics. These methods do not consider the interactions among features or objects. In this paper, a novel approach is proposed to classify scenes by embedding semantic information in the weighted hypergraph learning. First, hypergraph regularization is improved by optimizing weights of hyperedges. Second, the connectivity among images is learned by statistics of objects appearing in the same image. In this way, semantic gap is narrowed. The experimental results demonstrate the effectiveness of the proposed method.