Skip to main content
×
Home
    • Aa
    • Aa

Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders

  • MAUREEN DENNIS (a1) (a2), DAVID J. FRANCIS (a3) (a4), PAUL T. CIRINO (a3) (a4), RUSSELL SCHACHAR (a1) (a5), MARCIA A. BARNES (a6) and JACK M. FLETCHER (a3)...
Abstract
Abstract

IQ scores are volatile indices of global functional outcome, the final common path of an individual’s genes, biology, cognition, education, and experiences. In studying neurocognitive outcomes in children with neurodevelopmental disorders, it is commonly assumed that IQ can and should be partialed out of statistical relations or used as a covariate for specific measures of cognitive outcome. We propose that it is misguided and generally unjustified to attempt to control for IQ differences by matching procedures or, more commonly, by using IQ scores as covariates. We offer logical, statistical, and methodological arguments, with examples from three neurodevelopmental disorders (spina bifida meningomyelocele, learning disabilities, and attention deficit hyperactivity disorder) that: (1) a historical reification of general intelligence, g, as a causal construct that measures aptitude and potential rather than achievement and performance has fostered the idea that IQ has special status and that in studying neurocognitive function in neurodevelopmental disorders; (2) IQ does not meet the requirements for a covariate; and (3) using IQ as a matching variable or covariate has produced overcorrected, anomalous, and counterintuitive findings about neurocognitive function. (JINS, 2009, 15, 331–343.)

Copyright
Corresponding author
*Correspondence and reprint requests to: Maureen Dennis, Program in Neurosciences and Mental Health, Department of Psychology, The Hospital for Sick Children, 555 University Avenue, Toronto, Ontario, Canada M5G 1X8. E-mail: maureen.dennis@sickkids.ca
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

H. Aase , A. Meyer , & T. Sagvolden (2006). Moment-to-moment dynamics of ADHD behaviour in South African children. Behavioral and Brain Functions, 2, 11. doi: 10.1186/1744-9081-2-11.

K.M. Adams , G.G. Brown , & I. Grant (1985). Analysis of covariance as a remedy for demographic mismatch of research subject groups: Some sobering simulations. Journal of Clinical and Experimental Neuropsychology, 7, 445462.

R.A. Barkley , K.R. Murphy , & T. Bush (2001). Time perception and reproduction in young adults with attention-deficit/hyperactivity disorder. Neuropsychology, 15, 351360.

M.A. Barnes & M. Dennis (1992). Reading in children and adolescents after early onset hydrocephalus and in normally developing age peers: Phonological analysis, word recognition, word comprehension, and passage comprehension skill. Journal of Pediatric Psychology, 17, 445465.

A. Binet & T. Simon (1916). The development of intelligence in children (The Binet-Simon Scale); translated by E.S. Kite . Training School. Vineland, NJ: Suzanne Heisler.

A.M. Boonstra , J.J.S. Kooij , J.K. Buitelaar , J. Oosterlaan , J.A. Sergeant , J.G.A.M.A. Heister , & B. Franke (2008). An exploratory study of the relationship between four candidate genes and neurocognitive performance in adult ADHD. American Journal of Medical Genetics Part B (Neuropsychiatric Genetics), 147B, 397402.

T.S. Bowers & B.D. Beck (2006). What is the meaning of non-linear dose-response relationships between blood lead concentrations and IQ? Neurotoxicology, 27, 520524.

D.J. Bridgett & M.E. Walker (2006). Intellectual functioning in adults with ADHD: A meta-analytic examination of full scale IQ differences between adults with and without ADHD. Psychological Assessment, 18, 114.

R.B. Cattell (1943). The measurement of adult intelligence. Psychological Bulletin, 40, 153193.

S.J. Ceci (1991). How much does schooling influence general intelligence and its cognitive components? A reassessment of the evidence. Developmental Psychology, 27, 703722.

F.I.M. Craik & E. Bialystok (Eds.) (2006). Lifespan cognition: Mechanisms of change. New York: Oxford University Press.

I.J. Deary , M. Lawn , & D.J. Bartholomew (2008). A conversation between Charles Spearman, Godfrey Thomson, and Edward L. Thorndike: The International Examinations Enquiry Meetings 1931-1938. History of Psychology, 11, 122142.

J. Deese (1993). Human abilities versus intelligence. Intelligence, 17, 107116.

M. Dennis , K. Edelstein , K. Copeland , J. Frederick , D.J. Francis , R. Hetherington , S.E. Blaser L.A. Kramer , J.M. Drake , M. Brandt , & J.M. Fletcher (2005a). Covert orienting to exogenous and endogenous cues in children with spina bifida. Neuropsychologia, 43, 976987.

M. Dennis , K. Edelstein , K. Copeland , J.A. Frederick , D.J. Francis , R. Hetherington , S.E. Blaser , L.A. Kramer , J.M. Drake , M.E. Brandt , & J.M. Fletcher (2005b). Space-based inhibition of return in children with spina bifida. Neuropsychology, 19, 456465.

M. Dennis , K. Edelstein , R. Hetherington , K. Copeland , J. Frederick , S.E. Blaser , L.A. Kramer , J.M. Drake , M. Brandt , & J.M. Fletcher (2004). Neurobiology of perceptual and motor timing in children with spina bifida in relation to cerebellar volume. Brain, 127, 12931301.

A.E. Doyle , E.G. Willcutt , L.J. Seidman , J. Biederman , V.-A. Chouinard , J. Silva , & S.V. Faraone (2005). Attention-deficit/hyperactivity disorder endophenotypes. Biological Psychiatry, 57, 13241335.

B. Evans & B. Waites (1981). IQ and mental testing: An unnatural science and its social history. London: Macmillan Press.

S.H. Evans & E.J. Anastasio (1968). Misuse of analysis of covariance when treatment effect and covariate are confounded. Psychological Bulletin, 69, 225234.

M.J. Farah , D.M. Shera , J.H. Savage , L. Betancourt , J.M. Giannetta , N.L. Brodsky , E.K. Malmud , & H Hurt . (2006). Childhood poverty: Specific associations with neurocognitive development. Brain Research, 1110, 166174.

D.M. Fergusson , L.J. Horwood , & M.T. Lynskey (1993). The effects of conduct disorder and attention deficit in middle childhood on offending and scholastic ability at age 13. Journal of Child Psychology and Psychiatry, 34, 899916.

D.J. Francis , J.M. Fletcher , B.A. Shaywitz , S.E. Shaywitz , & B.P. Rourke (1996). Defining learning and language disabilities: Conceptual and psychometric issues with the use of IQ tests. Language, Speech, and Hearing Services in Schools, 27, 132143.

T.W. Frazier , H.A. Demaree , & E.A. Youngstrom (2004). Meta-analysis of intellectual and neuropsychological test performance in attention-deficit/hyperactivity disorder. Neuropsychology, 18, 543555.

R. Goodman , E. Simonoff , & J. Stevenson (1995). The impact of child IQ, parent IQ and sibling IQ on child behavioural deviance scores. Journal of Child Psychology and Psychiatry, 36, 409425.

L.S. Gottfredson (2004). Intelligence: Is it the epidemiologists’ elusive “fundamental cause” of social class inequalities in health? Journal of Personality and Social Psychology, 86, 174199.

S.J. Gould (1981). The mismeasure of man. New York: Norton.

R.J. Haier , R.E. Jung , R.A. Yeo , K. Head , & M.T. Alkire (2004). Structural brain variation and general intelligence. NeuroImage, 23, 425433.

R.J. Haier , R.E. Jung , R.A. Yeo , K. Head , & M.T. Alkire (2005). The neuroanatomy of general intelligence: Sex matters. NeuroImage, 25, 320327.

P. Hegarty (2007). From genius inverts to gendered intelligence: Lewis Terman and the power of the norm. History of Psychology, 10, 132155.

A.R Jensen . (1969). How much can we boost IQ and scholastic achievement? Harvard Educational Review, 39, 1123.

A.R. Jensen (1989). Raising IQ without raising g? A review of the Milwaukee project: Preventing mental retardation in children at risk. Developmental Review, 9, 234258.

A.R. Jensen & L.-J. Weng (1994). What is a good g? Intelligence, 18, 231258.

W. Johnson & T.J. Bouchard (2005). The structure of human intelligence: It is verbal, perceptual, and image rotation (VPR), not fluid and crystallized. Intelligence, 33, 393416.

W. Johnson , R.E. Jung , R. Colom , & R.J. Haier (2008). Cognitive abilities independent of IQ correlate with regional brain structure. Intelligence, 36, 1828.

H. Kane & T.D. Oakland (2000). Secular declines in Spearman’s g: Some evidence from the United States. Journal of Genetic Psychology, 161, 337345.

A.S. Kaufman (2001). Do low levels of lead produce IQ loss in children? A careful examination of the literature. Archives of Clinical Neuropsychology, 16, 303341.

S.A. Khan & S.V. Faraone (2006). The genetics of ADHD: A literature review of 2005. Current Psychiatry Reports, 8, 393397.

M. Kornhaber , M. Krechevsky , & H. Gardner (1990). Engaging intelligence. Educational Psychologist, 25, 177199.

J. Kuntsi , T.C. Eley , A. Taylor , C. Hughes , P. Asherson , A. Caspi , & T.E. Moffitt (2004). Co-occurrence of ADHD and low IQ has genetic origins. American Journal of Medical Genetics Part B (Neuropsychiatric Genetics), 124B, 4147.

F.M. Lord (1965). A strong true-score theory, with applications. Psychometrika, 30, 239270.

F.M. Lord (1967). A paradox in the interpretation of group comparisons. Psychological Bulletin, 68, 304305.

F.M. Lord (1969). Statistical adjustments when comparing preexisting groups. Psychological Bulletin, 72, 336337.

D. Lubinski (2004). Introduction to the special section on cognitive abilities: 100 years after Spearman’s (1904) “‘General intelligence,’ objectively determined and measured.” Journal of Personality and Social Psychology, 86, 96111.

P.G. Mathes , C.A. Denton , J.M. Fletcher , J.L. Anthony , D.J. Francis , & C. Schatschneider (2005). The effects of theoretically different instruction and student characteristics on the skills of struggling readers. Reading Research Quarterly, 40, 148182.

J. Mill , A. Caspi , B.S. Williams , I. Craig , A. Taylor , M. Polo-Tomas , C.W. Berridge , R. Poulton , & T.E. Moffitt (2006). Prediction of heterogeneity in intelligence and adult prognosis by genetic polymorphisms in the dopamine system among children with attention-deficit/hyperactivity disorder: Evidence from 2 birth cohorts. Archives of General Psychiatry, 63, 462469.

G.A. Miller & J.P. Chapman (2001). Misunderstanding analysis of covariance. Journal of Abnormal Psychology, 110, 4048.

K.R. Murphy , R.A. Barkley , & T. Bush (2001). Executive functioning and olfactory identification in young adults with attention deficit-hyperactivity disorder. Neuropsychology, 15, 211220.

U. Neisser , G. Boodoo , T.J Bouchard , A.W. Boykin , N. Brody , S.J. Ceci , D.F. Halpern , J.C. Loehlin , R. Perloff , R.J. Sternberg , & S. Urbina (1996). Intelligence: Knowns and unknowns. American Psychologist, 51, 77101.

K.G. Noble , M.F. Norman , & M.J. Farah (2005). Neurocognitive correlates of socioeconomic status in kindergarten children. Developmental Science, 8, 7487.

S.D. Porteus (1917). Mental tests with delinquents and aboriginal children. Psychological Review, 24, 3241.

M.D. Rapport , S.W. Scanlan , & C.B. Denney (1999). Attention-deficit/hyperactivity disorder and scholastic achievement: A model of dual developmental pathways. Journal of Child Psychology and Psychiatry, 40, 11691183.

N. Roll-Hansen (1988). The progress of eugenics: Growth of knowledge and change in ideology. History of Science, 26, 295331.

M.S. Salman , J.A. Sharpe , L. Lillakas , M.J. Steinbach , & M. Dennis (2007). Smooth ocular pursuit in Chiari type II malformation. Developmental Medicine and Child Neurology, 49, 289293.

R.J. Schachar , S. Chen , G.D. Logan , T.J. Ornstein , J. Crosbie , A. Ickowicz , & A. Pakulak (2004). Evidence for an error monitoring deficit in attention deficit hyperactivity disorder. Journal of Abnormal Child Psychology, 32, 285293.

R. Schachar , G.D. Logan , P. Robaey , S. Chen , A. Ickowicz , & C. Barr (2007). Restraint and cancellation: Multiple inhibition deficits in attention deficit hyperactivity disorder. Journal of Abnormal Child Psychology, 35, 229238.

W.H. Schneider (1992). After Binet: French intelligence testing, 1900-1950. Journal of the History of the Behavioural Sciences, 28, 111132.

D.L. Share , P.A. McGee , & P.A. Silva (1989). IQ and reading progress: A test of the capacity notion of IQ. Journal of the American Academy of Child and Adolescent Psychiatry, 28, 97100.

L.S. Siegel (1992). An evaluation of the discrepancy definition of dyslexia. Journal of Learning Disabilities, 25, 618629.

L.S. Siegel , D. Share , & E. Geva (1995). Evidence for superior orthographic skills in dyslexics. Psychological Science, 6, 250254.

R.S. Siegler (1992). The other Alfred Binet. Developmental Psychology, 28, 179190.

C. Spearman (1904). “General intelligence,” objectively determined and measured. American Journal of Psychology, 15, 201293.

C. Spearman (1914). Theory of two factors. Psychological Review, 21, 105115.

K.E. Stanovich (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 21, 360407.

K.K. Stuebing , J.M. Fletcher , J.M. LeDoux , G.R. Lyon , S.E. Shaywitz , & B.A. Shaywitz (2002). Validity of IQ-discrepancy classifications of reading disabilities: A meta-analysis. American Educational Research Journal, 39, 469518.

T.W. Teasdale & D.R. Owen (2008). Secular declines in cognitive test scores: A reversal of the Flynn effect. Intelligence, 36, 121126.

D.E. Tupper & L.K. Rosenblood (1984). Methodological considerations in the use of attribute variables in neuropsychological research. Journal of Clinical and Experimental Neuropsychology, 6, 441453.

F.R. Vellutino , D.M. Scanlon , & G.R. Lyon (2000). Differentiating between difficult-to-remediate and readily remediated poor readers. Journal of Learning Disabilities, 33, 223238.

M. Wilke , J.-H. Sohn , A.W. Byars , & S.K. Holland (2003). Bright spots: Correlations of gray matter volume with IQ in a normal pediatric population. NeuroImage, 20, 202215.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of the International Neuropsychological Society
  • ISSN: 1355-6177
  • EISSN: 1469-7661
  • URL: /core/journals/journal-of-the-international-neuropsychological-society
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords:

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 18
Total number of PDF views: 224 *
Loading metrics...

Abstract views

Total abstract views: 768 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 25th May 2017. This data will be updated every 24 hours.