Interactive Learning of a FALCON for a Card Game

Among many reinforcement learning methods, FALCON is a machine learning method which is an extend fuzzy ART(Adaptive Resonance Theory), and can appropriately discretize a state space. FALCON is an on-line method proposed by Ah-Hwee Tan. It can discretize a state space and learn action rules simultaneously by learning relations among percepts, actions, and rewards. In this study, a learning agent using FALCON is interactively trained, and the learning effect is measured through experiments. In experiments, the learning agent learns by playing 50,000 card games of “Hearts” against three rule-based agents. Then, the interface that agents can interactively play the game with human cooperators is made so that human cooperators can play the game against the learning agent to strengthen it. It continues learning during games. The effectiveness of interactive learning is ascertained through the experiments.