SmartVisionApp: A framework for computer vision applications on mobile devices

• This is a framework for developing computer vision applications in mobile devices.
• This framework combines mobile devices, network technologies and computer vision.
• The framework performs object recognition through photos captured by a phone camera.
• Two plug-ins for landmark recognition and fashion shopping are presented.
• Experiments on several datasets shows that the system is efficient and robust.

In this paper a novel framework for the development of computer vision applications that exploit sensors available in mobile devices is presented. The framework is organized as a client–server application that combines mobile devices, network technologies and computer vision algorithms with the aim of performing object recognition starting from photos captured by a phone camera. The client module on the mobile device manages the image acquisition and the query formulation tasks, while the recognition module on the server executes the search on an existing database and sends back relevant information to the client. To show the effectiveness of the proposed solution, the implementation of two possible plug-ins for specific problems is described: landmark recognition and fashion shopping. Experiments on four different landmark datasets and one self-collected dataset of fashion accessories show that the system is efficient and robust in the presence of objects with different characteristics.