Beyond the mouse: Understanding user gestures for manipulating 3D objects from touchscreen inputs

Multi-touch interfaces have emerged with the widespread use of smartphones. Although a lot of people interact with 2D applications through touchscreens, interaction with 3D applications remains little explored. Most 3D object manipulation techniques have been created by designers who have generally put users aside from the design creation process. We conducted a user study to better understand how non-technical users tend to interact with a 3D object from touchscreen inputs. The experiment consists of 3D cube manipulations along three viewpoints for rotations, scaling and translations (RST). Sixteen users participated and 432 gestures were analyzed. To classify data, we introduce a taxonomy for 3D manipulation gestures with touchscreens. Then, we identify a set of strategies employed by users to perform the proposed cube transformations. Our findings suggest that each participant uses several strategies with a predominant one. Furthermore, we conducted a study to compare touchscreen and mouse interaction for 3D object manipulations. The results suggest that gestures are different according to the device, and touchscreens are preferred for the proposed tasks. Finally, we propose some guidelines to help designers in the creation of more user friendly tools.

Figure optionsDownload high-quality image (262 K)Download as PowerPoint slideHighlights
► We introduce a taxonomy for 3D object manipulation on touchscreens.
► We identify a set of strategies followed by novice users to manipulate a cube.
► We highlight how touchscreen interaction differ from mouse interaction.
► We show that novices preferred touchscreens than mice for 3D object manipulations.
► We propose some guidelines to help the design of new user friendly interfaces.