Skip to main content Accessibility help
×
Home
Hostname: page-component-ffbbcc459-kwkjh Total loading time: 0.277 Render date: 2022-03-13T21:24:48.222Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "useRatesEcommerce": false, "useNewApi": true }

Vision, eye movements, and natural behavior

Published online by Cambridge University Press:  01 January 2009

MICHAEL F. LAND*
Affiliation:
Department of Biology and Environmental Science, University of Sussex, Brighton, UK
*
*Address correspondence and reprint requests to: Michael F. Land, Department of Biology and Environmental Science, University of Sussex, Brighton BN1 9QG, UK. E-mail: m.f.land@sussex.ac.uk

Abstract

Historically, the principal function of vision has been to provide the information needed to support action. Visually mediated actions rely on three systems: the gaze system responsible for locating and fixating task-relevant objects, the motor system of the limbs to carry out the task, and the visual system to supply information to the other two. All three systems are under the control of a fourth system, the schema system, which specifies the current task and plans the overall sequence of actions. These four systems have separate but interconnected cortical representations. The way these systems interact in time and space is discussed here in relation to two studies of the gaze changes and manipulations made during two ordinary food preparation tasks. The main conclusions are that complex action sequences consist of a succession of individual object-related actions, each of which typically involve a turn toward the object (if needed), followed by fixation and finally manipulation monitored by vision. Gaze often moves on to the next object just before manipulation is complete. Task-irrelevant objects are hardly ever fixated, implying that the control of fixation comes principally from top-down instructions from the schema system, not bottom-up salience. Single fixations have identifiable functions (locating, directing, guiding, and checking) related to the action to be taken. Several variants of the basic object-related action scheme are discussed, including single-action events in ball sports involving only one anticipatory gaze shift, continuous production loops in text and music reading, and storage–action alternation in copying tasks such as portrait sketching.

Type
Natural Tasks
Copyright
Copyright © Cambridge University Press 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anstis, S.M. (1974). A chart demonstrating variations in acuity with retinal position. Vision Research 14, 589–592.CrossRefGoogle ScholarPubMed
Baddeley, A. (2007). Working Memory, Thought and Action. Oxford: Oxford University Press.CrossRefGoogle Scholar
Ballard, D.H., Hayhoe, M.M., Li, F. & Whitehead, S.D. (1992). Hand-eye coordination during sequential tasks. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 337, 331–339.CrossRefGoogle ScholarPubMed
Ballard, D.H., Hayhoe, M.M. & Pelz, J.B. (1995). Memory representations in natural tasks. Journal of Cognitive Neuroscience 7, 66–80.CrossRefGoogle ScholarPubMed
Bargh, J.A. & Ferguson, M.J. (2000). Beyond behaviorism: On the automaticity of higher mental processes. Psychological Bulletin 126, 925–945.CrossRefGoogle ScholarPubMed
Buswell, G.T. (1920). An experimental study of the eye-voice span in reading. Supplementary Educational Monographs 17. University of Chicago Press.Google Scholar
Butsch, R.L.C. (1932). Eye movements and the eye-hand span in typewriting. Journal of Educational Psychology 23, 104–121.CrossRefGoogle Scholar
Droll, J.A., Hayhoe, M.M., Triesch, J. & Sullivan, B.T. (2005). Task demands control acquisition and storage of visual information. Journal of Experimental Psychology. Human Perception and Performance 31, 1416–1438.CrossRefGoogle ScholarPubMed
Einhäuser, W., Rutishauser, U. & Koch, C. (2008). Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. Journal of Vision 8(2): article 2, 1–19.CrossRefGoogle ScholarPubMed
Fleischer, A.G. (1986). Control of eye movements by working memory load. Biological Cybernetics 55, 227–238.CrossRefGoogle ScholarPubMed
Furneaux, S. & Land, M.F. (1999). The effects of skill on the eye-hand span during musical sight-reading. Proceedings of the Royal Society of London. Series B, Biological Sciences 266, 2453–2440.CrossRefGoogle ScholarPubMed
Gilbert, S.J. & Burgess, P.W. (2008). Executive function. Current Biology 18, R110–R114.CrossRefGoogle ScholarPubMed
Hayhoe, M. (2000). Vision using routines: A functional account of vision. Visual Cognition 7, 43–64.CrossRefGoogle Scholar
Hayhoe, M., Mennie, N., Sullivan, B. & Gorgos, K. (2005). The role of internal models and prediction in catching balls. Proceedings of the American Association Artificial Intelligence (Fall).Google Scholar
Hayhoe, M.M., Shrivastava, A., Mruczek, R. & Pelz, J.B. (2003). Visual memory and motor planning in a natural task. Journal of Vision 3, 49–63.CrossRefGoogle Scholar
Itti, L. & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40, 1489–1506.CrossRefGoogle ScholarPubMed
Jeannerod, M. (1997). The Cognitive Neuroscience of Action. Oxford: Blackwell.Google Scholar
Johansson, R.S., Westling, G., Bäckström, A. & Flanagan, J.R. (2001). Eye-hand coordination in object manipulation. Journal of Neuroscience 21, 6917–6932.CrossRefGoogle ScholarPubMed
Land, M.F. (2003). Eye movements in daily life. In The Visual Neurosciences, ed. Chalupa, L.M. & Werner, J.S., pp. 1357–1368. Cambridge, MA: MIT Press.Google Scholar
Land, M.F. (2006). Eye movements and the control of actions in everyday life. Progress in Retinal and Eye Research 25, 296–324.CrossRefGoogle ScholarPubMed
Land, M.F. & Furneaux, S. (1997). The knowledge base of the oculomotor system. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 352, 1231–1239.CrossRefGoogle ScholarPubMed
Land, M.F. & Hayhoe, M. (2001). In what ways do eye movements contribute to everyday activities. Vision Research 41, 3559–3565.CrossRefGoogle ScholarPubMed
Land, M.F. & Lee, D.N. (1994). Where we look when we steer. Nature 369, 742–744.CrossRefGoogle ScholarPubMed
Land, M.F. & McLeod, P. (2000). From eye movements to actions: How batsmen hit the ball. Nature Neuroscience 3, 1340–1345.CrossRefGoogle Scholar
Land, M.F., Mennie, N. & Rusted, J. (1999). The roles of vision and eye movements in the control of activities of daily living. Perception 28, 1311–1328.CrossRefGoogle ScholarPubMed
McKinney, T., Chajka, K. & Hayhoe, M. (2008). Pro-active gaze control in squash. Journal of Vision 8(6): article 111, 111a.CrossRefGoogle Scholar
Mennie, N., Hayhoe, M. & Sullivan, B. (2007). Look-ahead fixations: Anticipatory eye movements in natural tasks. Experimental Brain Research 179, 427–442.CrossRefGoogle ScholarPubMed
Miller, E.K. & Cohen, J.D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience 24, 167–202.CrossRefGoogle ScholarPubMed
Norman, D.A. & Shallice, T. (1986). Attention to action: Willed and automatic control of behavior. In Consciousness and Self Regulation. Advances in Research and Theory, Vol. 4, ed. Davidson, R.J., Schwarts, G.E. & Shapiro, D., pp. 1–18. New York, NY: Plenum.Google Scholar
Patla, A.E. & Vickers, J.N. (2003). OHow far ahead do we look when required to step on specific locations in the travel path during locomotion. Exp. Brain Res. 148, 133–138.CrossRefGoogle Scholar
Pelz, J.B. & Canoza, R. (2001). Oculomotor behavior and perceptual categories in complex tasks. Vision Research 41, 3587–3596.CrossRefGoogle Scholar
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124, 372–422.CrossRefGoogle Scholar
Regan, D. (1992). Visual judgments and misjudgments in cricket, and the art of flight. Perception 21, 91–115.CrossRefGoogle Scholar
Ripoll, H., Fleurance, P. & Caseneuve, D. (1987). Analysis of visual patterns of table tennis players. In Eye Movements: From Physiology to Cognition, ed. O’Regan, J.K. & Levy-Schoen, A., pp. 616–617. Amsterdam, The Netherlands: North-Holland.CrossRefGoogle Scholar
Rizzolatti, G. & Luppino, G. (2001). The cortical motor system. Neuron 31, 889–901.CrossRefGoogle ScholarPubMed
Rothkopf, C., Ballard, D. & Hayhoe, M. (2007). Task and scene context determine where you look. Journal of Vision 7(14): article 16, 1–20.Google ScholarPubMed
Sailer, U., Flanagan, J.R. & Johansson, R.S. (2005). Eye-hand coordination during learning of a novel visuomotor task. Journal of Neuroscience 25, 8833–8842.CrossRefGoogle ScholarPubMed
Salvucci, D.D. & Gray, R. (2004). A two-point control model of steering. Perception 33, 1233–1248.CrossRefGoogle ScholarPubMed
Schwartz, M.F., Reed, E.S., Montgomery, M.W., Palmer, C. & Mayer, N.H. (1991). The quantitative description of action disorganisation after brain damage: A case study. Cognitive Neuropsychology 8, 381–414.CrossRefGoogle Scholar
Shallice, T. & Burgess, P.W. (1996). Domains of supervisory control and the temporal organisation of behaviour. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 351, 1405–1412.CrossRefGoogle Scholar
Tchalenko, J.S. (2007). Eye movements in drawing simple lines. Perception 36, 1152–1167.CrossRefGoogle ScholarPubMed
Triesch, J., Ballard, D.H., Hayhoe, M.M. & Sullivan, B.T. (2003). What you see is what you need. Journal of Vision 3, 86–94.CrossRefGoogle ScholarPubMed
Wann, J.P. & Wilkie, R.M. (2004). How do we control high speed steering. In Optic Flow and Beyond, ed. Vaina, L.M., Beardsley, S.A. & Rushton, S.K., pp. 371–389. Dordrecht, The Netherlands: Kluwer Academic Publishers.Google Scholar
Weaver, H.E. (1943). A study of visual processes in reading differently constructed musical selections. Psychological Monographs 55, 1–30.Google Scholar
Wright, R.D. & Ward, L.M. (2008). Orienting of Attention. Oxford: Oxford University Press.Google Scholar
Yarbus, A. (1967). Eye Movements and Vision. New York: Plenum Press.CrossRefGoogle Scholar
157
Cited by

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Vision, eye movements, and natural behavior
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

Vision, eye movements, and natural behavior
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

Vision, eye movements, and natural behavior
Available formats
×
×

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *