Skip to main content
×
Home

Information limits on neural identification of colored surfaces in natural scenes

  • DAVID H. FOSTER (a1), SÉRGIO M.C. NASCIMENTO (a2) and KINJIRO AMANO (a1)
Abstract

If surfaces in a scene are to be distinguished by their color, their neural representation at some level should ideally vary little with the color of the illumination. Four possible neural codes were considered: von-Kries-scaled cone responses from single points in a scene, spatial ratios of cone responses produced by light reflected from pairs of points, and these quantities obtained with sharpened (opponent-cone) responses. The effectiveness of these codes in identifying surfaces was quantified by information-theoretic measures. Data were drawn from a sample of 25 rural and urban scenes imaged with a hyperspectral camera, which provided estimates of surface reflectance at 10-nm intervals at each of 1344 × 1024 pixels for each scene. In computer simulations, scenes were illuminated separately by daylights of correlated color temperatures 4000 K, 6500 K, and 25,000 K. Points were sampled randomly in each scene and identified according to each of the codes. It was found that the maximum information preserved under illuminant changes varied with the code, but for a particular code it was remarkably stable across the different scenes. The standard deviation over the 25 scenes was, on average, approximately 1 bit, suggesting that the neural coding of surface color can be optimized independent of location for any particular range of illuminants.

Copyright
Corresponding author
Address correspondence and reprint requests to: David H. Foster, Visual and Computational Neuroscience Group, UMIST, Manchester M60 1QD, UK. Email: d.h.foster@umist.ac.uk
References
Hide All

REFERENCES

Brillinger, D.R. (2002). Second-order moments and mutual information in the analysis of time series. In Recent Advances in Statistical Methods. Proceedings of Statistics 2001 Canada: The 4th Conference in Applied Statistics, Montreal, Canada, July 2001, ed. Chaubey, Y.P., pp. 6476. London: Imperial College Press.
Buchsbaum, G. (1980). A spatial processor model for object colour perception. Journal of the Franklin Institute 310, 126.
Buchsbaum, G. & Gottschalk, A. (1983). Trichromacy, opponent colours coding and optimum colour information transmission in the retina. Proceedings of the Royal Society B (London) 220, 89113.
Cover, T.M. & Thomas, J.A. (1991). Elements of Information Theory. New York: John Wiley & Sons, Inc.
Craven, B.J. & Foster, D.H. (1992). An operational approach to colour constancy. Vision Research 32, 13591366.
D'Zmura, M. & Lennie, P. (1986). Mechanisms of color constancy. Journal of the Optical Society of America A 3, 16621672.
Finlayson, G.D., Drew, M.S., & Funt, B.V. (1994). Spectral sharpening: Sensor transformations for improved color constancy. Journal of the Optical Society of America A 11, 15531563.
Foster, D.H. (1981). Changes in field spectral sensitivities of red-, green- and blue-sensitive colour mechanisms obtained on small background fields. Vision Research 21, 14331455.
Foster, D.H. & Snelgar, R.S. (1983a). Initial analysis of opponent-colour interactions revealed in sharpened field spectral sensitivities. In Colour Vision: Physiology and Psychophysics, ed. Mollon, J.D. & Sharpe, L.T., pp. 303311. London: Academic Press.
Foster, D.H. & Snelgar, R.S. (1983b). Test and field spectral sensitivities of colour mechanisms obtained on small white backgrounds: action of unitary opponent-colour processes? Vision Research 23, 787797.
Foster, D.H. & Nascimento, S.M.C. (1994). Relational colour constancy from invariant cone-excitation ratios. Proceedings of the Royal Society B (London) 257, 115121.
Foster, D.H., Nascimento, S.M.C., Amano, K., Arend, L., Linnell, K.J., Nieves, J.L., Plet, S., & Foster, J.S. (2001). Parallel detection of violations of color constancy. Proceedings of the National Academy of Sciences of the U.S.A. 98, 81518156.
Hurlbert, A. & Wolf, K. (2004). Color contrast: a contributory mechanism to color constancy. Progress in Brain Research 144, 147160.
Lapidoth, A. (1996). Nearest neighbor decoding for additive non-Gaussian noise channels. IEEE Transactions on Information Theory 42, 15201529.
Lee, B.B., Martin, P.R., Valberg, A., & Kremers, J. (1993). Physiological mechanisms underlying psychophysical sensitivity to combined luminance and chromatic modulation. Journal of the Optical Society of America A 10, 14031412.
MacKay, D.J.C. (2003). Information Theory, Inference, and Learning Algorithms. Cambridge: Cambridge University Press.
Maloney, L.T. (1999). Physics-based approaches to modeling surface color perception. In Color Vision: From Genes to Perception, ed. Gegenfurtner, K.R. & Sharpe, L.T., pp. 387416. Cambridge: Cambridge University Press.
Naka, K.I. & Rushton, W.A.H. (1966). S-potentials from colour units in the retina of fish (Cyprinidae). Journal of Physiology 185, 536555.
Nascimento, S.M.C. & Foster, D.H. (1997). Detecting natural changes of cone-excitation ratios in simple and complex coloured images. Proceedings of the Royal Society B (London) 264, 13951402.
Nascimento, S.M.C., Ferreira, F.P., & Foster, D.H. (2002). Statistics of spatial cone-excitation ratios in natural scenes. Journal of the Optical Society of America A 19, 14841490.
Nascimento, S.M.C., de Almeida, V.M.N., Fiadeiro, P.T., & Foster, D.H. (2004). Minimum-variance cone-excitation ratios and the limits of relational color constancy. Visual Neuroscience 21, 337340.
Ripamonti, C. & Westland, S. (2003). Prediction of transparency perception based on cone-excitation ratios. Journal of the Optical Society of America A 20, 16731680.
Ruderman, D.L., Cronin, T.W., & Chiao, C.-C. (1998). Statistics of cone responses to natural images: implications for visual coding. Journal of the Optical Society of America A 15, 20362045.
Shapley, R., Kaplan, E., & Soodak, R. (1981). Spatial summation and contrast sensitivity of X and Y cells in the lateral geniculate nucleus of the macaque. Nature 292, 543545.
Simoncelli, E.P. & Olshausen, B.A. (2001). Natural image statistics and neural representation. Annual Review of Neuroscience 24, 11931216.
Smith, V.C. & Pokorny, J. (1972). Spectral sensitivity of color-blind observers and the cone photopigments. Vision Research 12, 20592071.
Smith, V.C. & Pokorny, J. (1975). Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm. Vision Research 15, 161171.
Sperling, G. (1960). The information available in brief visual presentations. Psychological Monographs: General and Applied 74, 129.
Sperling, H.G. & Harwerth, R.S. (1971). Red-green cone interactions in the increment-threshold spectral sensitivity of primates. Science 172, 180184.
Tiplitz Blackwell, K. & Buchsbaum, G. (1988). Quantitative studies of color constancy. Journal of the Optical Society of America A 5, 17721780.
Verghese, P. & Pelli, D.G. (1992). The information capacity of visual attention. Vision Research 32, 983995.
Vorobyev, M. & Osorio, D. (1998). Receptor noise as a determinant of colour thresholds. Proceedings of the Royal Society B (London) 265, 351358.
Wandell, B.A. (1995). Foundations of Vision. Sunderland, Massachusetts: Sinauer Associates, Inc.
Webster, M.A. & Mollon, J.D. (1995). Colour constancy influenced by contrast adaptation. Nature 373, 694698.
West, G. & Brill, M.H. (1982). Necessary and sufficient conditions for Von Kries chromatic adaptation to give color constancy. Journal of Mathematical Biology 15, 249258.
Westland, S. & Ripamonti, C. (2000). Invariant cone-excitation ratios may predict transparency. Journal of the Optical Society of America A 17, 255264.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Visual Neuroscience
  • ISSN: 0952-5238
  • EISSN: 1469-8714
  • URL: /core/journals/visual-neuroscience
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords:

Metrics

Full text views

Total number of HTML views: 2
Total number of PDF views: 15 *
Loading metrics...

Abstract views

Total abstract views: 137 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 20th November 2017. This data will be updated every 24 hours.