Skip to main content Accessibility help

Contour statistics in natural images: Grouping across occlusions



Correctly interpreting a natural image requires dealing properly with the effects of occlusion, and hence, contour grouping across occlusions is a major component of many natural visual tasks. To better understand the mechanisms of contour grouping across occlusions, we (a) measured the pair-wise statistics of edge elements from contours in natural images, as a function of edge element geometry and contrast polarity, (b) derived the ideal Bayesian observer for a contour occlusion task where the stimuli were extracted directly from natural images, and then (c) measured human performance in the same contour occlusion task. In addition to discovering new statistical properties of natural contours, we found that naïve human observers closely parallel ideal performance in our contour occlusion task. In fact, there was no region of the four-dimensional stimulus space (three geometry dimensions and one contrast dimension) where humans did not closely parallel the performance of the ideal observer (i.e., efficiency was approximately constant over the entire space). These results reject many other contour grouping hypotheses and strongly suggest that the neural mechanisms of contour grouping are tightly related to the statistical properties of contours in natural images.


Corresponding author

*Address correspondence and reprint requests to: Wilson S. Geisler, Center for Perceptual Systems, 1 University Station A8000, University of Texas at Austin, Austin, TX 78712. E-mail:


Hide All
Barrow, H.G. & Tenenbaum, J.M. (1986). Computational approaches to vision. In Handbook of Perception and Human Performance, Vol. II: Cognitive Processes and Performance, ed. Boff, K.R., Kaufman, L. & Thomas, J.P., pp. 38:3138:68. New York: John Wiley and Sons.
Beck, J., Rosenfeld, A. & Ivry, R. (1989). Line segregation. Spatial Vision 4, 75101.
Brunswik, E. & Kamiya, J. (1953). Ecological cue-validity of ‘proximity’ and other Gestalt factors. American Journal of Psychology 66, 2032.
Elder, J.H. & Goldberg, R.M. (2002). Ecological statistics of Gestalt laws for the perceptual organization of contours. Journal of Vision 2, 324353.
Feldman, J. (2001). Bayesian contour integration. Perception & Psychophysics 63, 11711182.
Field, D.J., Hayes, A. & Hess, R.F. (1993). Contour integration by the human visual system: Evidence for a local ‘association field’. Vision Research 33, 173193.
Field, D.J., Hayes, A. & Hess, R.F. (2000). The role of polarity and symmetry in perceptual grouping of contour fragments. Spatial Vision 13, 5166.
Geisler, W.S. (2008). Visual perception and the statistical properties of natural scenes. Annual Review of Psychology 59, 10.1110.26.
Geisler, W.S., Perry, J.S. & Ing, A.D. (2008). Natural systems analysis. In Human Vision and Electronic Imaging III, ed. Rogowitz, B.E. & Pappas, T.N., Proc. of SPIEIS & T Electronic Imaging, SPIE Vol. 68060M-111.
Geisler, W.S., Perry, J.S., Super, B.J. & Gallogly, D.P. (2001). Edge co-occurrence in natural images predicts contour grouping performance. Vision Research 41, 711724.
Grossberg, C.M. & Mingolla, E. (1985). Neural dynamics of form perception: Boundary completion, illusory figures, and neon color spreading. Psychological Review 92, 173211.
Kellman, P.J. (2003). Interpolation processes in the visual perception of objects. Neural Networks 16, 915923.
Kellman, P.J. & Shipley, T.F. (1991). A theory of visual interpolation in object perception. Cognitive Psychology 23, 141221.
Kovacs, I. & Julesz, B. (1993). A closed curve is much more than an incomplete one: Effect of closure in figure-ground segmentation. Proceedings of the National Academy of Sciences 90, 74957497.
Martin, D., Fowlkes, C. & Malik, J. (2004). Learning to detect natural image boundaries using local brightness, color and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 530549.
Neumann, H. & Mingolla, E. (2001). Computational models of spatial integration in perceptual grouping. In From Fragments to Objects: Grouping and Segmentation in Vision, ed. Shipley, T.F. & Kellman, P.J., pp. 353400. Amsterdam, the Netherlands: Elsevier.
Parent, P. & Zucker, S. (1989). Trace inference, curvature consistency and curve detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 11, 823839.
Rock, I. (1975). An Introduction to Perception. New York: Macmillan.
Sha'ashua, S. & Ullman, S. (1988). Structural saliency: The detection of globally salient structures using a locally connected network. Proceedings of the Second International Conference on Computer Vision, 321327.
Sigman, M., Cecchi, G.A., Gilbert, C.D. & Magnasco, M.O. (2001). On a common circle: Natural scenes and Gestalt rules. Proceedings of the National Academy of Sciences 98, 19351940.
Singh, M. & Fulvio, J.M. (2005). Visual extrapolation of contour geometry. PNAS 102, 939944.
Singh, M. & Fulvio, J.M. (2007). Bayesian contour extrapolation: Geometric determinants of good continuation. Vision Research 47, 783798.
Tversky, T., Geisler, W.S. & Perry, J.S. (2004). Contour grouping: Closure effects are explained by good continuation and proximity. Vision Research 44, 27692777.
Wertheimer, M. (1958). Principles of perceptual organization. In Readings in Perception, ed. Beardslee, D.C. & Wertheimer, M., pp. 103123. Princeton, NJ: Van Nostrand (Original work published 1923).
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Visual Neuroscience
  • ISSN: 0952-5238
  • EISSN: 1469-8714
  • URL: /core/journals/visual-neuroscience
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed