3DSSE – A 3D Scene Search Engine: Exploring 3D scenes using keywords

The evolution of real time 3D graphics technologies in combination with high bandwidth Internet connections and modern Web browsers enable users to explore complex 3D scenes. As a rule, a virtual visitor has to manually explore the geometrically complex 3D model in order to discover points of interest. This manual exploration is a time consuming process that, in some cases, can be assisted by sets of predefined points of interest. In this paper, we propose the annotation of 3D scenes in order to equip the user with a text based 3D scene search engine. The search engine provides a query mechanism that unburdens the user from the time consuming process of manually exploring vast 3D scenes. It responds to queries by exploiting the metadata of each 3D model and returns textual and visual information along with a group of links that correspond to relative points of interest within the 3D scene. The search engine allows the virtual visitor to automatically be transferred to a specific point of interest. We have built a Web accessible prototype system that is able to handle queries related to historical data, topological relationships and architectural properties of buildings. A number of 3D reconstructions covering urban areas of cultural importance located in Northern Greece have been annotated and used in the search engine as case studies. The prototype system is based on open source technologies and on a hybrid metadata schema that is derived from the MIDAS Heritage and MACE schemas.