Skip to main content
×
Home
    • Aa
    • Aa

Information limits on neural identification of colored surfaces in natural scenes

  • DAVID H. FOSTER (a1), SÉRGIO M.C. NASCIMENTO (a2) and KINJIRO AMANO (a1)
Abstract

If surfaces in a scene are to be distinguished by their color, their neural representation at some level should ideally vary little with the color of the illumination. Four possible neural codes were considered: von-Kries-scaled cone responses from single points in a scene, spatial ratios of cone responses produced by light reflected from pairs of points, and these quantities obtained with sharpened (opponent-cone) responses. The effectiveness of these codes in identifying surfaces was quantified by information-theoretic measures. Data were drawn from a sample of 25 rural and urban scenes imaged with a hyperspectral camera, which provided estimates of surface reflectance at 10-nm intervals at each of 1344 × 1024 pixels for each scene. In computer simulations, scenes were illuminated separately by daylights of correlated color temperatures 4000 K, 6500 K, and 25,000 K. Points were sampled randomly in each scene and identified according to each of the codes. It was found that the maximum information preserved under illuminant changes varied with the code, but for a particular code it was remarkably stable across the different scenes. The standard deviation over the 25 scenes was, on average, approximately 1 bit, suggesting that the neural coding of surface color can be optimized independent of location for any particular range of illuminants.

Copyright
Corresponding author
Address correspondence and reprint requests to: David H. Foster, Visual and Computational Neuroscience Group, UMIST, Manchester M60 1QD, UK. Email: d.h.foster@umist.ac.uk
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

Buchsbaum, G. (1980). A spatial processor model for object colour perception. Journal of the Franklin Institute310, 126.

Buchsbaum, G. & Gottschalk, A. (1983). Trichromacy, opponent colours coding and optimum colour information transmission in the retina. Proceedings of the Royal Society B (London)220, 89113.

Craven, B.J. & Foster, D.H. (1992). An operational approach to colour constancy. Vision Research32, 13591366.

D'Zmura, M. & Lennie, P. (1986). Mechanisms of color constancy. Journal of the Optical Society of America A3, 16621672.

Finlayson, G.D., Drew, M.S., & Funt, B.V. (1994). Spectral sharpening: Sensor transformations for improved color constancy. Journal of the Optical Society of America A11, 15531563.

Foster, D.H. (1981). Changes in field spectral sensitivities of red-, green- and blue-sensitive colour mechanisms obtained on small background fields. Vision Research21, 14331455.

Foster, D.H. & Snelgar, R.S. (1983b). Test and field spectral sensitivities of colour mechanisms obtained on small white backgrounds: action of unitary opponent-colour processes?Vision Research23, 787797.

Foster, D.H. & Nascimento, S.M.C. (1994). Relational colour constancy from invariant cone-excitation ratios. Proceedings of the Royal Society B (London)257, 115121.

Foster, D.H., Nascimento, S.M.C., Amano, K., Arend, L., Linnell, K.J., Nieves, J.L., Plet, S., & Foster, J.S. (2001). Parallel detection of violations of color constancy. Proceedings of the National Academy of Sciences of the U.S.A.98, 81518156.

Lapidoth, A. (1996). Nearest neighbor decoding for additive non-Gaussian noise channels. IEEE Transactions on Information Theory42, 15201529.

Lee, B.B., Martin, P.R., Valberg, A., & Kremers, J. (1993). Physiological mechanisms underlying psychophysical sensitivity to combined luminance and chromatic modulation. Journal of the Optical Society of America A10, 14031412.

Naka, K.I. & Rushton, W.A.H. (1966). S-potentials from colour units in the retina of fish (Cyprinidae). Journal of Physiology185, 536555.

Nascimento, S.M.C. & Foster, D.H. (1997). Detecting natural changes of cone-excitation ratios in simple and complex coloured images. Proceedings of the Royal Society B (London)264, 13951402.

Nascimento, S.M.C., Ferreira, F.P., & Foster, D.H. (2002). Statistics of spatial cone-excitation ratios in natural scenes. Journal of the Optical Society of America A19, 14841490.

Nascimento, S.M.C., de Almeida, V.M.N., Fiadeiro, P.T., & Foster, D.H. (2004). Minimum-variance cone-excitation ratios and the limits of relational color constancy. Visual Neuroscience21, 337340.

Ripamonti, C. & Westland, S. (2003). Prediction of transparency perception based on cone-excitation ratios. Journal of the Optical Society of America A20, 16731680.

Ruderman, D.L., Cronin, T.W., & Chiao, C.-C. (1998). Statistics of cone responses to natural images: implications for visual coding. Journal of the Optical Society of America A15, 20362045.

Shapley, R., Kaplan, E., & Soodak, R. (1981). Spatial summation and contrast sensitivity of X and Y cells in the lateral geniculate nucleus of the macaque. Nature292, 543545.

Simoncelli, E.P. & Olshausen, B.A. (2001). Natural image statistics and neural representation. Annual Review of Neuroscience24, 11931216.

Smith, V.C. & Pokorny, J. (1972). Spectral sensitivity of color-blind observers and the cone photopigments. Vision Research12, 20592071.

Smith, V.C. & Pokorny, J. (1975). Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm. Vision Research15, 161171.

Sperling, G. (1960). The information available in brief visual presentations. Psychological Monographs: General and Applied74, 129.

Sperling, H.G. & Harwerth, R.S. (1971). Red-green cone interactions in the increment-threshold spectral sensitivity of primates. Science172, 180184.

Tiplitz Blackwell, K. & Buchsbaum, G. (1988). Quantitative studies of color constancy. Journal of the Optical Society of America A5, 17721780.

Verghese, P. & Pelli, D.G. (1992). The information capacity of visual attention. Vision Research32, 983995.

Vorobyev, M. & Osorio, D. (1998). Receptor noise as a determinant of colour thresholds. Proceedings of the Royal Society B (London)265, 351358.

Webster, M.A. & Mollon, J.D. (1995). Colour constancy influenced by contrast adaptation. Nature373, 694698.

West, G. & Brill, M.H. (1982). Necessary and sufficient conditions for Von Kries chromatic adaptation to give color constancy. Journal of Mathematical Biology15, 249258.

Westland, S. & Ripamonti, C. (2000). Invariant cone-excitation ratios may predict transparency. Journal of the Optical Society of America A17, 255264.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Visual Neuroscience
  • ISSN: 0952-5238
  • EISSN: 1469-8714
  • URL: /core/journals/visual-neuroscience
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords:

Metrics

Full text views

Total number of HTML views: 1
Total number of PDF views: 10 *
Loading metrics...

Abstract views

Total abstract views: 94 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 29th March 2017. This data will be updated every 24 hours.