Computer Science Colloquium
Immersive Integration of Physical and Virtual Environments
University of North Carolina
at Chapel Hill
Friday, November 12, 2004 11:30 A.M.
Room 1302 Warren Weaver Hall
251 Mercer Street
New York, NY 10012-1185
Colloquium Information: http://cs.nyu.edu/csweb/Calendar/colloquium/index.html
Zvi Kedem email@example.com, (212) 998-3101
We envision future work and play environments in which the user's
computing interface is more closely integrated with the physical
surroundings than today's conventional computer display screens and
keyboards. We are working toward realizable versions of such
environments, in which multiple video projectors and digital cameras
enable every visible surface to be both measured in 3D and used for
display. If the 3D surface positions were transmitted to a distant
location, they may also enable distant collaborations to become more
like working in adjacent offices connected by large windows.
With collaborators at the University of Pennsylvania, Brown
University, Advanced Network and Services, the Pittsburgh Supercomputing
Center, and ETH-Zurich, we at Chapel Hill have been working to bring
these ideas to reality. In one system, depth maps are calculated from
streams of video images and the resulting 3D surface points are
displayed to the user in head-tracked stereo.
Among the applications we are pursuing for this tele-presence
technology, is advanced training for trauma surgeons by immersive replay
of recorded procedures. Other applications display onto physical
objects, to allow more natural interaction with them--"painting" a
dollhouse, for example.
More generally, we hope to demonstrate that the principal interface of a
future computing environment need not be limited to a screen the size of
one or two sheets of paper. Just as a useful physical environment is all
around us, so too can the increasingly ubiquitous computing environment
be all around us--integrated seamlessly with our physical surroundings.
| contact firstname.lastname@example.org