
Crusile
Kraken
- Joined
- Dec 5, 2021
- Posts
- 3,977
- Reputation
- 4,086
Reaction time correlation was p-hacked by test selectionPhysiological correlations https://www.sciencedirect.com/science/article/abs/pii/016028969290010O
As mentioned earlier, Galton viewed human mental ability differences in terms of mental speed. He included reaction time (RT) items in his tests, as did some of his followers. Although they yielded nothing of interest (people from different social classes performed much the same on average), the idea has been recently revived. This time the aim has been to see whether RT correlates with IQ, thus supporting the conclusion that IQ is really a measure of some physiological or neural efficiency. For example, in the 1990s, Arthur Jensen (a well-known supporter of Galton) spoke of “individual differences in speed or efficiency of the various elementary processes,” and how “those differences account for the differences in performance on psychometric tests.”20 The hope engendered was that of discovering the mother lode in a psychological gold mine.
Initially, some excitement was created in two ways. First a small correlation (0.2–0.3) was found between IQ and a modified RT test: the appropriate reaction had to be quickly chosen from up to four alternatives (e.g., different buttons for different light signals). Variability of individual performance in this so-called choice-reaction time was also weakly correlated with IQ.
The problem is what to make of it. As always, we must not accept such correlations as causally meaningful without controlled experiments. Such small correlations indicate, anyway, that there are a lot of other things causing differences in performance. And they may not even be cognitive in origin. Douglas Detterman showed how RT involves a lot other than simple response efficiency.21 Individual differences can stem from misunderstanding instructions, familiarity with the equipment, motivation to do the task, sensory acuity, learned response strategies, time spent on sensory processing and motor action rather than decision time, attention, arousal, task orientation, confidence, and anxiety. Such research appears to be up another cul de sac. But, like frustrated yet hopeful prospectors, IQ devotees keep returning to RT.
The selected "reaction time test" is a measure of attentiveness- obtained through educational attainment, not magic "cognitive processing power"
On the other hand, many studies have now demonstrated the role of ‘topdown’, cognitive processes—influencing what Bub (2000) calls ‘state ofpreparedness’—in all ECT responses. An optimum state of readiness forperforming ECTs involves many factors like selective attention, the monitoring of expectancies, response preparation, filtering of extraneous thoughtsand sensory distractions, modulation of internal states, and so forth (Bub,2000). In concurrence with this view, Nettlebeck and Vita (1992) foundlarge practice effects on an IT task, with corresponding diminution of IQ–ITcorrelation to ‘negligible proportions’. Bors, Stokes, Forrin and Hodder(1999) report similar findings, and say that ‘attentiveness is at least in partresponsible for the IQ–IT correlation’ (p. 111). Using a slightly differenttask, Burns, Nettlebeck and Cooper (2000) report little association betweenIT and ‘fluid ability’. In addition, even individual ITs are not stable from onesituation to another (Deary & Stough, 1996).
it is consistently found that the largest correlations with IQ are for intraindividual variation in RT (usually measured by individuals’ standard deviations, or SDs, over numerous trials). As Jensen (1998) explains, ‘It is a rare study indeed in which RTSD does not have a larger (negative)correlation with IQ than does RT itself. In other words, higher-IQ persons have more consistent RT’s from trial to trial when performing an ECT’(p. 225). In other words, low-IQ subjects regularly produce RTs equal to those ofhigh-IQ subjects, but with less consistency over trials. This lack of consistency may well reflect poor self-confidence and high test anxiety and their effects on information processing, incursions of extraneous cognitions,sensory distractions and so on. This interpretation is reinforced by Jensen’s1998 (p. 224) report that RT significantly correlates (–.45) with Extraversionscores on the Eysenck Personality Inventory. Ratings on the EPI are relatedto high self-efficacy beliefs, self-confidence, freedom-from-anxiety andother aspects of ‘emotional well-being’ (Peterson, Maier, & Seligman,1993). Again it seems reasonable to suggest that any common source of variance in IQ and ECTs originates in the sociocognitive-affective nexusdescribed above.
0.132 kekIn males, three such correlations reach nominal significance but not Bonferroni significance. In females, no correlations reach nominal significance. These results contrast with those of R & J, who found a correlation of +.256 ( p=.0017) between the NCV for the 16-square test condition and IQ derived from the Raven Progressive Matrices (therefore, performing only one significance test) intheir 147 male participants. The correlation for our 16-square NCV and Raven in males is +.121; in the32- and 64-square conditions, it is +.154 and +.132, respectively. All correlations are nonsignificant nominally
Tiny/funny correlations with physical traits can be explained by indirect causes. like height correlates at .20 but obviously doesnt directly influence cognitive ability