ACTIVE VISUALIZATION FAQ's

TABLE OF CONTENTS

  1. What is visualization?
  2. How is visualization related to computer graphics?
  3. What are some parameters of foveated human vision?
  4. How do foveated images perform in visualization?
  5. What is active visualization?
  6. What are logmaps in vision?
  7. What is the connection to active vision?
  8. What is thinwire visualization?
  9. What is the role of eye-tracking in active visualization?
  10. REFERENCES

[ Back to Active Visualization Homepage ] [ Bottom of FAQ's]

  1. What is visualization?

    2. Visualization is the study of data presentation into visual form. The data can be numerical (e.g., points in multidimensional space), geometric (e.g., objects such as polygons) or even purely logical data (e.g., a graph). The goal of visualization is (to paraphrase Richard Hamming) is intuition, not pretty pictures. Of course, pretty pictures often help. As a major area of research, it has been considerably stimulated by an 1987 NSF report [1] on visualization applications in scientific computing.

  2. How is visualization related to computer graphics?

    3. Visualization systems are ultimately based on computer graphics technology. But since the goal of visualization is to provide intuition about the data, we have interest in the interfaces to help users visualize and manipulate the data, and in the nature of human perception. For example, one goal of traditional computer graphics is to produce photo-realistic pictures. But visualization may be very interested in unrealistic pictures which can help the visualization process.

  3. What are some parameters of foveated human vision?

    4. The resolution at the center of the retina is about 1 arcminute under ideal conditions, and this falls off rapidly outside the central 2 degree region. At 10 degrees eccentricity, the resolution is about 10 arcminute. A high resolution display with 1280 pixels across a 60 degree field of view achieves about 3 arcminutes per pixel. This means that outside the foveal region, much of the screen resolution is wasted.

  4. How do foveated images perform in visualization?

    5. There are really two related aspects.
    (a) First, how efficient are they? There are strong reasons to believe that they will drastically reduce the necessary bandwidth for visualization. Our current research is to obtain efficient methods to produce and display foveated images. We are experimenting with a new method based on wavelets. For a java demo, please go to our foveated image server.
    (b) The second aspect relates to user acceptability. A group at University of Texas Austin has produced a realtime system to track the eye and produce foveated images. They reported [3] that under certain conditions, the user detected only minimal perceptual artifacts while achieving a bandwidth reduction of 94.7% (factor of 18.8). See also.

  5. What is active visualization?

    6. Visualization is ultimately a psycho-physiological phenomenon and we can try to exploit this. Human vision is a very active process involving four principal eye movements: saccades, pursuit movements, vestibular systems and vergence [Robinson]. Active visualization seeks to present images that match some of these eye motions. This is over and on top of capabilities that are currently being exploited, such as head and body navigation. One advantage of active visualization is that we can now display foveated images, which have considerably lower data bandwidth than uniform resolution images (see logmaps below).

  6. What are logmaps in vision?

    7. Eric Schwartz [2] has established empirically that the map from the retina to the various layers of the visual cortex has the form
    z --> log (z+\alpha)
    where $z$ is a complex number and $\alpha>0$ is a real constant. Assuming that the range of this map is divided into uniform pixels corresponding to visual processing units, then the inverse of the log map takes these uniform pixels in the visual cortex into non-uniform pixels in the retina. These non-uniform pixels are called log pixels and their sizes increases exponentially with their distance from the fovea. Consequently, the number of log-pixels is logarithmic in the linear dimension of the visual field (and not quadratic as with uniform pixels). This remarkable fact has many applications. Our project attempts to exploit this for visualization purposes.

  7. What is the connection to active vision?

    8. Active visualization is similar to active vision in the attempt to close a feedback loop between the visualizer and the image generation process. But the two areas are interested in opposite poles of this loop. Active vision (as in computer vision generally) is trying duplicate the visualizer's process, i.e., reconstruct the unknown model from the generated images. Active visualization (as in visualization generally) is interested in the process of forming images from the known model. In active visualization, we expect the visualization tools to allow active control the image generation process.

  8. What is thinwire visualization?

    9. This is a server-client model of visualization where the server of images has power computational resources and the client has modest computational power, but they are connected by a very thin wire. Visualization over the internet provides such examples. We believe that active visualization is the best approach to such visualizations. Normally, the amount of throughput is overwhelmingly from the server to the client. With active visualization, and for a modest input from the client to the server, we want to greatly reduce the throughput from the server to the client.

  9. What is the role of eye-tracking in active visualization?

    10. If active visualization involves presenting images that follow the eye, it might appear that eye-tracking is an indispensable part of this research. This is actually false. In visualization, we may assume that the visualizer has a stake in the production of useful images. The user will therefore cooperate by informing the image generation process where the eye is currently focussed on. Any reasonable motor input device (such as the mouse) can be used. Of course, if we automatically track the user's eye, this can improve the usability of our system.

  10. REFERENCES

    1. B.H. McCormick, T.A. DeFanti, and M.D. Brown. Visualization in scientific computing. In ACM Computer Graphics (special issue), volume~21, 1987.
    2. E.L. Schwartz. Spatial mapping in primate sensory projection: analytic structure and relevance to perception. Biological Cybernetics, 25:181--194, 1977.
    3. Philip Kortum and Wilson S. Geisler. Implementation of a foveated image coding system for image bandwidth reduction. In Human Vision and Electronic Imaging, SPIE Proceedings Vol. 2657, (eds. B.E. Rogowitz and J.P. Allebach), 350--360, 1996. Spatial mapping in primate sensory projection: analytic structure

[ Table of Contents of FAQ] [ Back to Active Visualization Homepage]

LAST UPDATE: Nov 5, 1996
Chee Yap Courant Institute, NYU