Neural network implementation of inference on binary Markov random fields with probability coding

Markov random fields (MRF) underpin the solution to many problems in computational neuroscience. However, how the inference for MRF could be implemented with neural network is still an important open question. In this paper, we build the relationship between inference equation of MRF and the dynamic equation of the Hopfield network with probability coding. We prove that the membrane potential in the Hopfield network varying with respect to time can implement marginal probabilities inference on binary MRF. Theoretical analysis and experimental results show that our neural network can get comparable results as that of loopy belief propagation (LBP).