DropWeak: A novel regularization method of neural networks

We study all methods Dropout, DropConnect and DropWeak. We then evaluate DropWeak on a range of datasets, comparing to Dropout, and show results on MNIST image recognition dataset.