Improving learning by using artificial hints

In Multi-Task Learning (MTL), when several related tasks are learned at the same time considering one of them as the main task and the others as secondary ones, there is a transfer of positive information that improves the performance of the main one. However, not only does the difficulty of finding the relationship among different tasks pose a problem in real applications, but also knowing the kind of relationship among them. This paper presents a new method to generate artificial hints (subsets from the original data set) that helps the learning of the main task when all of them are learned simultaneously (as in a MTL scheme). Thus, although these hints cannot be strictly considered as secondary tasks, they will act as guides for the main one. The results obtained with toy and real problems show the advantages of the proposed method. In particular, a faster convergence, a very good performance, and a reduction in the likelihood of being trapped in a local minimum are achieved.