Mockup Builder: 3D modeling on and above the surface

We present Mockup Builder, a semi-immersive environment for conceptual design which allows virtual mockups to be created using gestures. Our goal is to provide familiar ways for people to conceive, create and manipulate three-dimensional shapes. To this end, we developed on-and-above-the-surface interaction techniques based on asymmetric bimanual interaction for creating and editing 3D models in a stereoscopic environment. Our approach combines both hand and finger tracking in the space on and above a multi-touch surface. This combination brings forth an alternative design environment where users can seamlessly switch between interacting on the surface or above it to leverage the benefit of both interaction spaces. A formal user evaluation conducted with experienced users shows very promising avenues for further work towards providing an alternative to current user interfaces for modeling.

Figure optionsDownload high-quality image (204 K)Download as PowerPoint slideHighlights
► We present an alternative semi-immersive design environment for conceptual design.
► We apply the asymmetric bimanual interaction model for 3D modeling.
► We combine hand and finger tracking in the space on and above a multi-touch surface.
► We conducted a formal user evaluation with experienced users using two CAD systems.