John C. Raven
Introduction
John Carlyle Raven (28 June 1902 – 10 August 1970) was an English psychologist who created the Progressive Matrices — the most widely used nonverbal reasoning test in the world, and one of the few psychological instruments whose name has outlived any theory it was built to serve.
What he meant it to measure is frequently misunderstood. The Matrices were not designed as an IQ test. Raven built them to measure one specific component of Charles Spearman's g: eductive ability, the capacity to make meaning out of confusion — to draw out structure and implication from a field of unrelated elements. The companion measure was reproductive ability, the storing and retrieving of what is already known, which he assessed with a vocabulary scale.
He was also, fifty years ahead of the field, insistent about a technical point that few contemporaries shared: a test should approximate an interval scale, which requires that the order of item difficulty be the same for people at every ability level. To check this he plotted what are now called item characteristic curves. When Georg Rasch developed his model in the late 1950s, he tested it on the Matrices.
Early Life and Education
Raven was born in London on 28 June 1902. His interest in psychology began early and against resistance. His father died when he was young, leaving him with a mother and two sisters to support, and his school teachers discouraged him on account of his dyslexia.
To fund his studies he worked as a teacher, and then as head teacher, at a boarding school for children with physical disabilities. His undergraduate notes on laboratory work survive and are unusually careful — as are his notes on topics that most of his profession would have regarded as marginal, particularly the psychology of religion and its parapsychological fringes.
Both his undergraduate and postgraduate studies were formally supervised by Francis Aveling at King's College London, though contact appears to have been slight, and his MSc dissertation was based on work carried out at the Royal Eastern Counties Institution rather than under Aveling's direction. The formative relationship was with Charles Spearman, whom he befriended as an undergraduate and whose two-factor theory became the scaffolding for everything he later built.
Around the time he graduated, Spearman's connection led to an introduction to Lionel Penrose, a geneticist investigating the genetic and environmental origins of mental deficiency. Penrose needed an assistant. The work required administering Stanford–Binet scales — the American revision of Alfred Binet's test — to the parents and siblings of children the East Anglia school system had identified as mentally deficient — in their homes, their schools, and sometimes their workplaces.
Raven found the instrument unusable in those settings. It was cumbersome where there was no separate room, where friends and parents were anxious to help, and where there was usually a great deal of noise. More damaging, the results were uninterpretable: a single score composited together too many different things to say anything about causes. He also met Mary Elizabeth Wild around this time; she married him and remained a working collaborator for the rest of his life.
Academic and Professional Career
The Matrices were specified in his master's dissertation, and the dissertation is unusual in what it contains. It is not a literature review. It is a set of operational criteria that a test — which did not yet exist — would have to satisfy. He and his wife then set about building one that met them, funded by a grant from the Darwin Trust.
The first versions of the Coloured Progressive Matrices and the Standard Progressive Matrices appeared in 1938, with the Advanced Progressive Matrices following later. The CPM was designed to spread the scores of the less able, for whom the standard version was too hard to differentiate.
The Second World War made the test's reputation. High rates of illiteracy among recruits and the sheer numbers to be screened made most existing tests impractical, and a special twenty-minute version was produced for military use, with items arranged in a single order of difficulty in place of the usual cyclical presentation. Because the test required no language, it spread into military systems worldwide — and into settings such as the South African mines, where examinees and administrators spoke different languages.
In 1944 he was offered the post of Director of Psychological Research at the Crichton Royal Hospital in Dumfries. He negotiated two unusual terms: that the post be part-time, so he could pursue topics of his own choosing without institutional approval, and that the department's remit be to study the normal in order to illuminate the abnormal, rather than the other way round.
He retired in May 1964. His sons continued the work through J.C. Raven Ltd, and the tests are now licensed by Pearson.
Major Contributions to Psychology
Eductive and reproductive ability
The theoretical frame is Spearman's. g had two components: the eductive, which makes meaning, and the reproductive, which recalls what is known. Raven built one instrument for each, on the argument that a single composite score — of the kind the Stanford–Binet produced — could not distinguish them and therefore could not support any causal inference. The Matrices measure the first; the Mill Hill Vocabulary Scale, which he developed with John Court, measures the second.
Pairing the two was the point. A person who scores low on the Matrices but adequately on vocabulary is not showing the same pattern as one who scores low on both, and Raven's instruments were designed so that the difference would be visible rather than averaged away.
Insistence on interval-scale measurement
Raven was one of a very small number of psychometricians — Louis Guttman was another — who recognised that most psychological tests produce ordinal scores that are then treated as interval scores, and that this invalidates most of the arithmetic done with them.
For a test to approximate an interval scale, the sequence of item difficulties must be the same for examinees at every level of ability. Demonstrating this required plotting, for each item, the relationship between ability and the probability of passing it. Raven did exactly this in order to decide which items to modify or reject. These plots are now standard apparatus in item response theory under the name item characteristic curves. Rasch, developing his model two decades later, used the Matrices as a test case.
Principles of Individuation and Coordinates of Conduct
Raven regarded his theoretical framework of the Principles of Individuation and Coordinates of Conduct as his most important contribution to psychology. It is now almost entirely unread. He also published Controlled Projection (first edition 1944, expanded 1951), an early attempt to bring standardised scoring to free-drawing and projective techniques, and he continued to argue that eductive ability depends substantially on affective and conative components and on unconscious activity of a kind later called metacognitive — which is why, he maintained, it could not be understood through the reductionist item-level studies that later filled Carroll's syntheses.
Major Publications
- Mental Tests Used in Genetic Studies (1936, with Lionel Penrose) — the East Anglia work that prompted the Matrices
- Progressive Matrices: A Perceptual Test of Intelligence (1938) — the Standard and Coloured versions
- The Mill Hill Vocabulary Scale (1943, with John Court)
- Advanced Progressive Matrices (1947,Sets I and II; 1962)
- Controlled Projection (1944; 2nd ed. 1951)
- Guide to the Standard Progressive Matrices (1960, with John H. Court and John Raven)
Impact and Legacy
The Matrices are among the most administered psychological tests ever made, used in clinical neuropsychology, educational placement, personnel selection, and cross-cultural research. Their practical advantages are real: they are cheap to administer, need no language, can be given to groups, and — the property Raven designed for — are comparatively robust to the examiner's language and the examinee's schooling.
Criticism — and the central claim has not survived intact. The Matrices are routinely described as culture-fair or culture-free. They are neither, and the evidence against the stronger claim is substantial.
The most direct refutation comes from the Matrices themselves. James Flynn's discovery of large intergenerational rises in test scores was built substantially on Standard Progressive Matrices data collected from mass testing of military conscripts across many countries and many years. Gains on the Matrices are among the largest recorded for any cognitive test. A measure of innate reasoning capacity that shifts by that magnitude within a few decades is not measuring something independent of environment, however nonverbal its format.
Schooling, test familiarity, and practice all move scores. The nonverbal format removes one source of bias — vocabulary and verbally transmitted knowledge — and substitutes others: familiarity with abstract visual puzzles, with multiple-choice formats, and with the specific convention of completing a matrix. Removing the language does not remove the culture; it makes the remaining cultural load harder to see.
There is also a persistent category error in how the test is used. Raven built it to measure one component of g, and he insisted for decades that eductive ability could not be reduced to item-level analysis. It is nevertheless routinely administered and reported as a general intelligence test, and described in some literature as the best single measure of g. Whatever merits that claim has, it is not the instrument's designed purpose, and Raven's own account of what the test measures was considerably more cautious and more complex than the uses to which it is put.
Finally, the work he considered his most important is forgotten. The Principles of Individuation and Coordinates of Conduct has had essentially no influence, and the theoretical framework that was meant to connect test performance to the organisation of conduct never connected to anything. What survives is the instrument — which is a great deal more than most psychometricians leave, and considerably less than he intended.
Learn More
- Human Intelligence — the construct the Matrices were built to measure one part of
- Intelligence Testing — the wider field, and the measurement problems Raven tried to solve
- Thinking and Reasoning — what eductive ability actually consists in
- Francis Galton — whose measurement assumptions established the tradition Raven worked within
References
- Raven, J. C. (1938). Progressive Matrices: A Perceptual Test of Intelligence. Lewis.