Welcome to the experimental content based
retrieval engine which operates within a real time 3D virtual
reality environment. This system presents the idea of content
based retrieval of 3D models within a VR environment. A 3D
reconstruction of a part of the old city of Xanthi has been
used as a test-bed 3D scene. Within this environment the
user can perform a virtual walkthrough and by clicking on objects
the system performs a query-by-example to a database
and retrieves the coordinates of similar objects that might
exist within the 3D scene. Animated arrows are then presented over similar objects while the user can monitor on the top map the similarity ranking of the retrieved objects.
At the moment the system uses our
3D
descriptors which are designed for vessels and generally
surfaces of revolution and thus the available objects are limited
to bottles, flower-pots,etc. With the use of other 3D shape
descriptors the system can be expanded for other types of objects
such as architectural structures, facade features, etc.
It should be mentioned that the 3D scene is manually segmented
into separated 3D model entities which properties such as their
digital shape signatures (descriptors), their coordinates within
the 3D space and other information are encoded into metadata
within a native XML database and when the 3D scene is loaded
those are loaded progressively and located to their positions
according to their metadata.More specifically a left click on an object initiates a query-by-example call which
forwards the object's id to the database. The database compares
the digital signatures of the query-object against all other
scene objects using a similarity metric and returns a sorted
(based-on-shape similarity) list with the id's of the similar
objects.The system is based on PHP technology and on the native XML database
eXist. The 3D reconstruction of a part of the old city of Xanthi
has been modelled using Blender and the web based virtual walkthrough
is based on Quest 3D technology which works on IE web browser.
To enter the
3D scene using an IE browser click on the following link Take me to the old city of Xanthi(pop up window) or you can watch a small
video demo on youtube.
Additional
material related to this project can be found at the following
links
This
work is part of the 03ED679 research project, implemented within
the framework of the Reinforcement Programme of Human Research
Manpower (PENED) and co financed by National and Community
Funds (25% from the Greek Ministry of Development - General Secretariat
of Research and Technology and 75% from E.U.- European Social
Fund).
Contact
at us akoutsou at ipet.gr or cmakar at ipet.gr