Skip to main content Accesibility Help

Considering multiscale scenes to elucidate problems encumbering three-dimensional intellection and navigation

  • Michael Glueck (a1) and Azam Khan (a1)

Virtual three-dimensional (3-D) environments have become pervasive tools in a number of professional and recreational tasks. However, interacting with these environments can be challenging for users, especially as these environments increase in complexity and scale. In this paper, we argue that the design of 3-D interaction techniques is an ill-defined problem. This claim is elucidated through the context of data-rich and geometrically complex multiscale virtual 3-D environments, where unexpected factors can encumber intellection and navigation. We develop an abstract model to guide our discussion, which illustrates the cyclic relationship of understanding and navigating; a relationship that supports the iterative refinement of a consistent mental representation of the virtual environment. Finally, we highlight strategies to support the design of interactions in multiscale virtual environments, and propose general categories of research focus.

Corresponding author
Reprint requests to: Michael Glueck, Autodesk Research, 210 King Street East, Toronto, ON M5A1J7, Canada. E-mail:
Hide All
Bingham, G.P., & Lind, M. (2008). Large continuous perspective transformations are necessary and sufficient for accurate perception of metric shape. Perception & Psychophysics 70, 524540.
Brooks, F.P. (1988). Grasping reality through illusion—interactive graphics serving science. Proc. SIGCHI Conf. Human Factors in Computing Systems, CHI ‘88 (O'Hare, J.J., Ed.), pp. 111. New York: ACM.
Burelli, P., & Yannakakis, G.N. (2010). Combining local and global optimisation for virtual camera control. Proc. IEEE Conf. Computational Intelligence and Games.
Burtnyk, N., Khan, A., Fitzmaurice, G., & Kurtenbach, G. (2006). ShowMotion: camera motion based 3D design review. Proc. 2006 Symp. Interactive 3D Graphics and Games, I3D ‘06, pp. 167174. New York: ACM.
Carlbom, I., & Paciorek, J. (1978). Planar geometric projections and viewing transformations. ACM Computer Survey 10(4), 465502.
Christie, M., Olivier, P., & Normand, J.-M. (2008). Camera control in computer graphics. Computer Graphics Forum 27, 21972218.
Cutting, J.E., & Vishton, P.M. (1995). Perceiving layout and knowing distances: the integration, relative potency, and contextual use of different information about depth. In Handbook of Perception and Cognition. Volume 5: Perception of Space and Motion (Epstein, W., & Rogers, S., Eds.), pp. 69117. San Diego, CA: Academic Press.
Donath, D., Kruijff, E., & Regenbrecht, H. (1999). Spatial knowledge implications by using a virtual environment during design review. Proc. ACADIA 1999.
Durand, F. (2002). An invitation to discuss computer depiction. Proc. 2nd Int. Symp. Non-Photorealistic Animation and Rendering, NPAR ‘02, pp. 111124. New York: ACM.
Eastman, C., Teicholz, P., Sacks, R., & Liston, K. (2007). BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers and Contractors, pp. 108. Hoboken, NJ: Wiley.
Eby, D.W., & Braunstein, M.L. (1995). The perceptual flattening of three-dimensional scenes enclosed by a frame. Perception 24(9), 981993.
Elmqvist, N., & Tsigas, P. (2008). A taxonomy of 3D occlusion management for visualization. IEEE Transactions on Visualization and Computer Graphics 14(5), 10951109.
Fitzmaurice, G., Matejka, J., Mordatch, I., Khan, A., & Kurtenbach, G. (2008). Safe 3D navigation. Proc. 2008 Symp. Interactive 3D Graphics and Games, I3D ‘08, pp. 715. New York: ACM.
Glueck, M., Crane, K., Anderson, S., Rutnik, A., & Khan, A. (2009). Multiscale 3D reference visualization. Proc. 2009 Symp. Interactive 3D Graphics and Games, I3D ‘09, pp. 225232. New York: ACM.
Hachet, M., Decle, F., Knödel, S., & Guitton, P. (2009). Navidget for 3D interaction: camera positioning and further uses. International Journal of Human–Computer Studies 67(3), 225236.
Hailemariam, E., Glueck, M., Attar, R., Tessier, A., McCrae, J., & Khan, A. (2010). Toward a unified representation system of performance-related data. Proc. eSim 2010 Conf. IBPSA–Canada eSim Conf., pp. 117124.
Herndon, K.P., van Dam, A., & Gleicher, M. (1994). The challenges of 3D interaction: a CHI ‘94 workshop. SIGCHI Bulletin 26(4), 3643.
Infinity. (n.d.) Multiscale video game. Accessed at
Jul, S. (2003). “This is a lot easier!”: constrained movement speeds navigation. Proc. CHI ‘03 Extended Abstracts on Human Factors in Computing Systems, CHI ‘03, pp. 776777. New York: ACM.
Jul, S., & Furnas, G.W. (1998). Critical zones in desert fog: aids to multiscale navigation. Proc. 11th Annual ACM Symp. User interface Software and Technology, UIST ‘98, pp. 97106. New York: ACM.
Juricevic, I., & Kennedy, J.M. (2006). Looking at perspective pictures from too far, too close, and just right. Journal of Experimental Psychology 135(3), 448461.
Khan, A., Mordatch, I., Fitzmaurice, G., Matejka, J., & Kurtenbach, G. (2008). ViewCube: a 3D orientation indicator and controller. Proc. 2008 Symp. Interactive 3D Graphics and Games, I3D ‘08, pp. 1725. New York: ACM.
Kopper, R., Ni, T., Bowman, D.A., & Pinho, M. (2006). Design and evaluation of navigation techniques for multiscale virtual environments. Proc. IEEE Conf. Virtual Reality, VR, pp. 175182. Washington, DC: IEEE Computer Society.
Lee, S., Eisemann, E., & Seidel, H. (2010). Real-time lens blur effects and focus control. Proc. ACM SIGGRAPH 2010 Papers, SIGGRAPH ‘10 (Hoppe, H., Ed.), pp. 17. New York: ACM.
McCrae, J., Glueck, M., Grossman, T., Khan, A., & Singh, K. (2010). Exploring the design space of multiscale 3D orientation. Proc. Int. Conf. Advanced Visual interfaces, AVI ‘10 (Santucci, G., Ed.), pp. 8188. New York: ACM.
McCrae, J., Mordatch, I., Glueck, M., & Khan, A. (2009). Multiscale 3D navigation. Proc. 2009 Symp. Interactive 3D Graphics and Games, I3D ‘09, pp. 717. New York: ACM.
McInerney, T., & Broughton, S. (2006). HingeSlicer: interactive exploration of volume images using extended 3D slice plane widgets. Proc. Graphics Interface 2006, ACM Int. Conf. Proc. Series, Vol. 137, pp. 171178. Toronto: Canadian Information Processing Society.
Milgram, P., & Colquhoun, H. (1999). A taxonomy of real and virtual worlds display integration. In Mixed Reality—Merging Real and Virtual Worlds, pp. 116. Berlin: Springer-Verlag.
Mintz, F.E., Trafton, J.G., Marsh, E., & Perzanowski, D. (2004). Proc. Human Factors and Ergonomics Society Annual Meeting, Perception and Performance, Vol. 48, pp. 19331937.
Oskam, T., Sumner, R.W., Thuerey, N., & Gross, M. (2009). Visibility transition planning for dynamic camera control. Proc. 2009 ACM SIGGRAPH/Eurographics Symp. Computer Animation, SCA ‘09 (Fellner, D., & Spencer, S., Eds.), pp. 5565. New York: ACM.
Plumlee, M.D., & Ware, C. (2006). Zooming versus multiple window interfaces: cognitive costs of visual comparisons. ACM Transactions on Computer–Human Interaction 13(2), 179209.
Potmesil, M., & Chakravarty, I. (1981). A lens and aperture camera model for synthetic image generation. Proc. 8th Annual Conf. Computer Graphics and Interactive Techniques, SIGGRAPH ‘81, pp. 297305. New York: ACM.
Salomon, B., Garber, M., Lin, M.C., & Manocha, D. (2003). Interactive navigation in complex environments using path planning. Proc. 2003 Symp. Interactive 3D Graphics, I3D ‘03, pp. 4150. New York: ACM.
Stoakley, R., Conway, M.J., & Pausch, R. (1995). Virtual reality on a WIM: interactive worlds in miniature. Proc. SIGCHI Conf. Human Factors in Computing Systems (Katz, I.R., Mack, R., Marks, L., Rosson, M.B., & Nielsen, J., Eds.), pp. 265272. New York: ACM Press/Addison–Wesley.
Tan, D.S., Gergle, D., Scupelli, P., & Pausch, R. (2006). Physically large displays improve performance on spatial tasks. ACM Transactions on Computer–Human Interaction 13(1), 7199.
Tory, M., Kirkpatrick, A.E., Atkins, M.S., & Moller, T. (2006). Visualization task performance with 2D, 3D, and combination displays. IEEE Transactions on Visualization and Computer Graphics 12(1), 213.
Trapp, M., & Doellner, J. (2008). Relief clipping planes for real-time rendering. Proc. ACM SIGGRAPH Asia 2008—Sketch Program, Singapore.
Tversky, B. (1993). Cognitive maps, cognitive collages, and spatial mental models. Proc. COSIT ‘93, Spatial Information Theory: A Theoretical Basis for GIS (Frank, A.U., & Campari, I., Eds.), Lecture Notes in Computer Science, Vol. 716, pp. 1424.
Wanger, L. (1992). The effect of shadow quality on the perception of spatial relationships in computer generated imagery. Proc. 1992 Symp. Interactive 3D Graphics, I3D ‘92, pp. 3942. New York: ACM.
Weiskopf, D., Engel, K., & Ertl, T. (2003). Interactive clipping techniques for texture-based volume visualization and volume shading. IEEE Transactions on Visualization and Computer Graphics 9, 298312.
Yang, Z., & Purves, D. (2003). A statistical explanation of visual space. Nature Neuroscience 6, 632640.
Zhang, X. (2005). Space-scale animation: enhancing cross-scale understanding of multiscale structures in multiple views. Proc. Coordinated and Multiple Views in Exploratory Visualization, CMV, pp. 109120. Washington, DC: IEEE Computer Society.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

  • ISSN: 0890-0604
  • EISSN: 1469-1760
  • URL: /core/journals/ai-edam
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed