I have always remembered the last line of Huckleberry Finn: “Aunt Sally she's going to adopt me and sivilize me, and I can't stand it. I been there before.”
Perhaps I share Huckleberry’s dislike of schools: “WELL, three or four months run along, and it was well into the winter now. I had been to school most all the time and could spell and read and write just a little, and could say the multiplication table up to six times seven is thirty-five, and I don't reckon I could ever get any further than that if I was to live forever. I don't take no stock in mathematics, anyway.”
However, I aim to be open to new ideas, and persons of great talent and learning assure me that going to school boosts IQ and that I should stop being churlish about such establishments.
Their arguments have to surmount a couple of hurdles. Firstly, “any fule kno” that the not so bright leave school early and the brighter ones stay on longer, so “years of schooling” is a dodgy measure which could show an apparent effect of schooling for artefactual reasons only.
Secondly, people understand that school might speed up some pedestrian mental processes, but leave you at the same intrinsic level of brightness at the end of schooling that you would have achieved anyway. 17/18 years of age is the proof of the pudding, when the final educated product rolls off the production line, possibly ready to make a useful contribution to society, so we should restrict ourselves to intelligence assessments conducted at around that age.
Thirdly, a body of work asserts that it does not matter whether children start school at 5 because they do just as well when they start at 7, but if schooling boosts IQ those who start at 7 should be duller, and that should show up for ever. The counter argument might be that school starting ages do not count, but school leaving ages do, but that would go against Abecedarian type results, which indicate that massive pre-school interventions with highly vulnerable children can boost IQ by 4 points which are sustained into middle age.
Fourthly, twin studies ought to show an effect of schooling on intelligence, but tend not to, which either suggests there isn’t any, or that current schooling is so similar that there is no school-based variance within standard educational systems.
What have the learned scholars arguing for the intelligence boosting effects of schooling got to offer?
The first helping is Ceci (1991) How Much Does Schooling Influence General Intelligence and Its Cognitive Components? A Reassessment of the Evidence. Developmental Psychology 1991, Vol. 27, No. 5, 703-722.
Ceci is also known for his work on racetrack experts (Ceci & Liker, 1986a, 1986b), research which has been often quoted as meaning that IQ does not count for much in real life. Doug Detterman demolished those papers so comprehensively that I am slightly on guard when reading this particular paper, but still reading it nonetheless. (It is silly and over-dramatic to avoid a person’s publications entirely because of some errors and contested results in other papers). Among the stronger studies he quotes Harnqvist's (1968) study of Swedish men. In 1961 Harnqvist selected a 10% random sample (approximately 12,000 men and women) of the Swedish school population who had been born in 1948 and who, at the age of 13, were given IQ tests. On reaching the age of 18 (in 1966), 4,616 of the Swedish men were tested as part of their country's national military registration. Thus, the study is not vulnerable to the usual sampling biases. Harnquist was able to compare children who were comparable on IQ, SES, and school grades at age 13 and determine the impact of dropping out of school on IQ at age 18. He found that for each year of secondary school (gymnasium) not completed, there was a loss of 1.8 IQ points—up to a maximum of nearly 8 IQ points difference between 2 boys who were similar in IQ, SES, and grades at age 13 but who subsequently differed in the amount of schooling completed by up to 4 years of high school. Naturally, one would need to look at the assumptions behind the SES and school grade “corrections” before being convinced by this, but this is strong stuff.
Ceci says: One of the best ways to document the impact of schooling on IQ is with a cohort-sequential analysis in which children of the same chronological age enter school at different times and remain there for similar lengths of time. By performing the appropriate statistical operations, it is possible to separate the effects of schooling from those of chronological age and, possibly; historical period, though the latter claim is a source of some contention.
Ceci summarises his paper’s findings thus: Taken together, the evidence for the influence of schooling on IQ appears to be fairly pervasive. Eight types of evidence for this relationship were reviewed: (a) the link between grade attained and IQ, (b) the impact of summer vacations, (c) the relationship between intermittent attendance and IQ, (d) the effect of late school onset, (e) the effect of early school termination, (f) the equivalence of aptitude and achievement test scores, (g) the
result of cohort-related changes, and (h) historical changes in the IQ-schooling link, all involving multiple replications. Although it is not possible to estimate with any confidence the precise decrement in IQ scores that befalls each month or year of missed or delayed school (Jencks et al., 1972, hazard the estimate of 1 IQ point decrement for each year of missed school), the trend is clearly one of declining IQ scores as a function of missed school. All of the studies that were reviewed accord with this statement, and only one empirical study argues otherwise.
Next up are Brincha and Gallowaya (2012) Schooling in adolescence raises IQ scores. PNAS www.pnas.org/cgi/doi/10.1073/pnas.1106077109
They say: Although some scholars maintain that education has little effect on intelligence quotient (IQ) scores, others claim that IQ scores are indeed malleable, primarily through intervention in early childhood. The causal effect of education on IQ at later ages is often difficult to uncover because analyses based on observational data are plagued by problems of reverse causation and self-selection into further education. We exploit a reform that increased compulsory schooling from 7 to 9 y in Norway in the 1960s to estimate the effect of education on IQ. We find that this schooling reform, which primarily affected education in the middle teenage years,
had a substantial effect on IQ scores measured at the age of 19 y.
This is a substantial paper, exploiting a natural experiment, in which various educational changes were made at different rates in different municipalities, all leading to an extra 2 years of school for adolescents, and a new unified middle school for those extra years. In Norway children begin school at 7, and this late start was maintained in the reformed system. There were no IQ measures beforehand. IQ was tested at age 19 when the men entered military service. So the paper is about men not women, and might be influenced by men’s slower maturation rates, and relates to the generation born between 1950 and 1958, and contains two important simultaneous changes: length and type of education. Given that there were no pre-school or early school IQ measures, the argument is based on various assumptions about what average IQs would have looked like if there had been no changes to the educational system.
As a consequence, the analysis of the results is quite complex. I am doing my best to simplify here. The first method, a difference-in-difference (DID) analysis, is to estimate the effect of the reform on the average IQ score for Norwegian men by comparing the change in IQ scores from the pre-reform period to post-reform period for municipalities that introduced the reform in a given year with the change in IQ scores in that same period in municipalities that did not introduce the reform in that particular year.
The second approach employs instrumental variables (IV) methods in which experiencing the new schooling system is used as an instrument for educational attainment (with appropriate controls for time trends and municipality of residence). The resulting system of two simultaneous equations is then estimated by two stage
least squares (2SLS). If we assume that the exclusive mechanism by which the reform affected IQ scores is by increasing the amount of schooling, the IV/2SLS approach allows us to break down the effect of the reform into (i) the effect of the reform on educational attainment and (ii) the effect of 1 y of additional schooling on IQ scores.
The results show that the educational reform (both length and type of education) increased men’s IQ by 0.6 points, which is statistically significant in this large population sample, though small of itself. I am favour plain statistics over the other more complicated analyses, because I am a primitive sort of person. For that reason, I went straight to the supplemental data.
Looking at Table S1 in the supplement it is clear that Norwegian men’s intelligence for all reasons including the educational reform rose for those of the 1950-1958 birth period from IQ 106 to 107.5. Given that this is a population sample we need to begin with an explanation as to why the initial score as not 100. Flynn effects probably account for this, in particular post-war recovery from Nazi occupation, but in fact the secular rise is said to have been faster in other periods. The IQ test produces stanine scores, so important detail is lost, though this should not be too important in this large sample. However, if during this birth period IQ rose by 1.6 IQ points, then the higher claimed rate which the authors show is the upward deviation from the trend line which the reform created for part of the test period.
The authors say: Because we estimate the total reform effect to be 0.6 IQ points and the total Flynn effect to be roughly 1.6 IQ points, we can attribute over one-third of the Flynn effect to the direct effect of the educational reform for the population of cohorts we study.
Having a sight of the IQs over a longer period would be a reality check as to whether there was an obvious and sustained upward movement in intelligence which could be attributed to the extra two years of schooling. Long data sets are the best, because all variations can be seen in historical context. If those historical data are available, they would be extremely informative. In the mean time, please give me a hand and have a look at the results section on pages 427 onwards to see what you make of them.
This is a good paper, highly detailed and open about the assumptions made. I need to look at the further analyses in more detail to see if I understand and agree with the higher gain estimates produced by them (of an enormous 3.7 IQ points per year), but if I have to summarise, I would put the gain at 0.6 IQ points.
https://drive.google.com/file/d/0B3c4TxciNeJZcTViR0dfbmdsWnc/view?usp=sharing
It is hard to discuss any intelligence matter without making a bow towards the granite fortress of Edinburgh, and sure enough Stuart Ritchie, Timothy Bates, Geoff Der, John M. Starr, and Ian J. Deary have launched “Education is associated with higher later-life IQ scores, but not with faster cognitive processing speed”
Recent reports suggest a causal relationship between education and IQ, which has implications for cognitive development and ageing - education may improve cognitive reserve. In two longitudinal cohorts, we tested the association between education and lifetime cognitive change. We then tested whether education is linked to improved scores on processing speed variables such as Reaction Time, which are associated with both IQ and longevity. Controlling for childhood IQ score, we found that education was positively associated with IQ at ages 79 (Sample 1) and 70 (Sample 2), and more strongly for participants with lower initial IQ scores. Education, however, showed no significant association with processing speed, measured at ages 83 and 70. Increased education may enhance important later-life cognitive capacities, but does not appear to improve more fundamental aspects of cognitive processing.
In the LBC1921, each year of education was associated with a .66 IQ point advantage in IQ (95% confidence interval: .14 to 1.17 points) at age ~79, controlling for age 11 IQ, SES, age at both times of testing, and sex (Table 2, Step 3).
for individuals with lower scores on the initial IQ test, education was more strongly associated with higher later-life IQ.
This paper is particularly interesting because it has actual IQ results at age 11 and then uses exactly the same test decades later. By holding prior IQ constant it is in a position to show whether more education has an influence on later intelligence.
Correlation matrices for the two samples are shown above and below the diagonal, but are roughly the same. If we look at column 1 which relates to sample 1 then we can see that IQ at 11 is strongly related to later life IQ .66, to education .44, to age 11 social class .24 and more weakly to the reaction time and inspection time measures. Later life IQ shows the same sort of correlation with education .42 and stronger correlations with reaction time and inspection time.
The present results suggest that education has enduring effects on IQ test performance, even controlling for childhood IQ score, and that these effects are stronger for those with lower cognitive ability in childhood. However, they also suggest that these effects work via mechanisms – perhaps those involving improvements in specific skills - that are distinct from those generating differences in more fundamental measures of processing speed.
There is a slight problem with survivor bias in both samples: the participants are somewhat brighter than average, and in my view thus more likely to have stayed in education, which might somewhat inflate the apparent contribution of education. The first sample shows more variance in years of education than the second (2.47 vs 1.13) so in theory the effect of education should be greater in the first sample, but the second sample gains 15.24 points, the first 12.79 which is somewhat against prediction.
The paper is also interesting because it appears to reveal the nature and limitation of educational effects. It also shows greater gains for lower ability students, which would make sense if education had a mildly compensatory effect.
https://drive.google.com/file/d/0B3c4TxciNeJZNHNBVzBDbnFEaGs/view?usp=sharing
There is more in this next paper (working title: education and g) which is still under review and which is brought to you exclusively so that you can review it yourselves (thus spurring on the official reviewers):
Previous research indicates that education influences cognitive development, but it is unclear what, precisely, is being improved. Here, we tested whether education is associated with cognitive test score improvements via domain-general effects on general cognitive ability (g), or via domain-specific effects on particular cognitive skills. We conducted structural equation modeling on data from a large (n = 1,091), longitudinal sample, with a measure of intelligence at age 11 years and ten tests covering a diverse range of cognitive abilities taken at age 70. Results indicated that the association of education with improved cognitive test scores is not mediated by g, but consists of direct effects on specific cognitive skills. These results suggest a decoupling of educational gains from increases in general intellectual capacity.
The findings indicate that education’s ability to raise intelligence test scores (as shown by, e.g. Brinch & Galloway, 2012) is driven by domain-specific effects that do not show ‘far transfer’ to general cognitive ability. Such a result coheres with findings from Ritchie et al. (2013), who, in the same participants who were assessed here, showed no association of education with elementary cognitive measures such as reaction and inspection time, despite an association with improved scores on more verbal IQ subtests. Our results are also broadly consistent with recent reviews concluding that training programs targeting the specific skill of working memory can improve performance on working memory (and closely related) tasks, but this advantage does not seem to generalize to more distantly related skills such as reasoning and arithmetic (e.g. Melby-LervĂ„g & Hulme, 2012; though see Karbach & Verhaeghen, 2014). Finally, our results are in line with a study by Finn et al. (2014), who showed in a longitudinal sample of schoolchildren that while the quality of the school they attended had effects on tests of directly-taught subjects such as mathematics and English language, there was no relation of school quality to performance on tests of ‘fluid’ ability such as processing speed, working memory, and reasoning. These findings, along with the results of present study, point to a conceptualization of education as a training program that develops particular intellectual abilities but not more fundamental capacities such as the efficiency of cognitive operations.
https://drive.google.com/file/d/0B3c4TxciNeJZa3BnSm5xVEVWazg/view?usp=sharing
In summary, it very much looks like more years of education are associated with an increase in intelligence test scores, but not anything like as strongly to underlying general intelligence or to underlying basic processing speeds. There is some hesitancy on my part, because I need to look at the arguments and the statistical techniques in more detail, but the Lothian cohorts get round most of those problems, simply because they have IQ measures at age 11.
So, where does all this leave our hero? Huckleberry did admit: “At first I hated the school, but by and by I got so I could stand it.” Perhaps it boosted his IQ, though not his processing speed. I hope it did not stop him from drifting down the Mississippi on those sunny afternoons I still remember.
Big problem with all this: measurement error.
ReplyDelete"Harnquist was able to compare children who were comparable on IQ, SES, and school grades at age 13 and determine the impact of dropping out of school on IQ at age 18. He found that for each year of secondary school (gymnasium) not completed, there was a loss of 1.8 IQ points—up to a maximum of nearly 8 IQ points difference between 2 boys who were similar in IQ, SES, and grades at age 13 but who subsequently differed in the amount of schooling completed by up to 4 years of high school."
Every test has error. The whole point of repeat testing is to minimize that error (of course, we don't know if changes in test scores over long periods of time represent genetically mediated changes – see here – need longitudinal twin studies for that. This is in addition to other problems such as practice gains). Allow me to illustrate this with a simple example.
Say two guys test at IQ 100. In reality, thanks to the testing error, the first guy's true IQ is 95 and the second's 105. We then follow these two guys through their lives. We test them again at some much later time, and we find scores closer to their true scores (say 97 and 104). We then note that the second guy – who now tests higher – has completed more schooling. We then conclude that the extra schooling now makes the difference – indeed a big difference of that, at 7 points – when in reality, this is exactly what would happen if both guys lived up to their actual potential. This is why I don't like studies like this.
Let me add an extra complication: say we use twins. We find the same result, and assume we've controlled for everything. In fact, you have not, again, "identical" twins are not identical (neither phenotypically nor genetically), so again we'd expect much the same result of their "true" IQ scores differed.
Rithcie's et al. study on the LBC suffers from the same problem, in addition to the problems you describe.
Of course, there's proof in the pudding on that one, which was pointed out to them before (not by me):
"We then tested whether education is linked to improved scores on processing speed variables such as Reaction Time, which are associated with both IQ and longevity. Controlling for childhood IQ score, we found that education was positively associated with IQ at ages 79 (Sample 1) and 70 (Sample 2), and more strongly for participants with lower initial IQ scores. Education, however, showed no significant association with processing speed, measured at ages 83 and 70."
Which goes back to:
"Here, we tested whether education is associated with cognitive test score improvements via domain-general effects on general cognitive ability (g), or via domain-specific effects on particular cognitive skills. We conducted structural equation modeling on data from a large (n = 1,091), longitudinal sample, with a measure of intelligence at age 11 years and ten tests covering a diverse range of cognitive abilities taken at age 70. Results indicated that the association of education with improved cognitive test scores is not mediated by g, but consists of direct effects on specific cognitive skills."
I'm just sayin'
A couple of the guys in that team are mad at me nowadays. They have leveled against me the charge me that I am a "fundamentalist" and a "genetic determinist" (their words). Of course, in my experience – and this is without fail, so far:
ReplyDeletehttp://twitter.com/JayMan471/statuses/444550572922785792
These people want to believe that traits, like IQ of all things, lend themselves to some sort of controlled manipulation. Education would seem to be the "best" way of doing that. However, the evidence for this is highly questionable, at best. To those guys, I say this: don't be mad at me. It's not my fault that the evidence for "environmental" effects generally sucks. Don't shoot the messenger.
So it appears from the above that educational effects are "hollow" with respect to g. Which is all fine and good, most people (in this space, anyway) will agree with that. But the question then becomes do these "hollow" IQ gains (assuming they're even real in the first place) have any practical significance? Well, that's starting to look questionable too, as per this link, courtesy Emil Kirkegaard:
IQ Subtest Analysis
IQ subtest scores don't seem to have much predictive value over the g factor. So there goes that....
Great post. Happy you finally took a time to break this shit down, something it sorely needed.
No one has done a meta-analysis of IQ gains from education yet with method of correlated vectors. Maybe Nijenhuis has already had his grad students collect the data, but didn't publish it yet. Did anyone have a quick look at some of these studies and see if they report subtest scores? I did look at one. The Norwegian one does not report subtests. It only the total score converted into a stanine score. Useless for method of correlated vectors.
ReplyDeleteI will bet that the g-loading of educational gains is not strongly positive (say, not r>.5). I'd say it will be close to 0 in a battery with a diverse set of tests.
The g-loading of the gains on compensatory education are pretty negatively g-loaded, in line with "teaching to the test" hypothesis. Note above that if the gains were stronger for the lower scoring, this seems like it functions like compensatory education then. Gains from adoption are negatively g-loaded too.
Is any environmental gain positively g-loaded? I know there are some studies on gains from vitamins, even RCTs. Did anyone look them up to see if they report subtest scores?
"the granite fortress of Edinburgh": oh come now; it is Aberdeen that is the Granite City.
ReplyDeleteGranite in both, from personal observation. No disrespect intended to Aberdeen.
DeleteNo, no, no. Edinburgh is built with Craigleith stone, an unusually hard sandstone.
ReplyDeleteCarboniferous sandstone. I stand corrected. Hard to tell in the driving rain.
DeleteFinland carried out a school reform similar to the Norwegian one in the 1970s. The effect on army IQ scores was very small, perhaps null.
ReplyDeleteWe then note that the second guy – who now tests higher – has completed more schooling. We then conclude that the extra schooling now makes the difference – indeed a big difference of that, at 7 points – when in reality, this is exactly what would happen if both guys lived up to their actual potential. This is why I don't like studies like this.
But errors like that will be cancelled out if the sample size is large enough. Measurement error is normally distributed around zero, which means that if we have two groups of individuals with true mean IQs of 95 and 105, their mean IQs will be 95 and 105, respectively, no matter how many times you test them (assuming no practice effects), even if the IQs of specific individuals within the two groups may go up or down because of measurement error.
IQ subtest scores don't seem to have much predictive value over the g factor. So there goes that....
A big problem with subtest scores is that they have very low reliability. Usually it's not mathematically possible for the subtest scores to predict anything because they have so little reliable variance.
However, it's clear that within high-IQ samples, such as college students, one's IQ profile has plenty of predictive power.
@J:
Delete"But errors like that will be cancelled out if the sample size is large enough. Measurement error is normally distributed around zero, which means that if we have two groups of individuals with true mean IQs of 95 and 105, their mean IQs will be 95 and 105, respectively, no matter how many times you test them (assuming no practice effects), even if the IQs of specific individuals within the two groups may go up or down because of measurement error."
Or at least it would – if they were interpreting them the right way. That is, with the subsequent tests (educational accomplishments, later IQ test) being checks of the first.
But that's not what they did. The methods they used took that natural error variance (which as you correctly noted is normally distributed the true score) and ran with it. The education and later IQ tests are tests of each other. Those whose true IQ was lower than the score they tested as children are of course going to perform worse on later tests and in educational accomplishment, and vice versa. But if you're naive to this fact, you can fall for the idea that the education made the difference – when in reality, it revealed the difference.
"However, it's clear that within high-IQ samples, such as college students, one's IQ profile has plenty of predictive power."
Indeed. Range restriction becomes important, apparently.
Thinking more about JayMan's measurement error example, there was a German study (which I can't locate at the moment) where the IQs of children tracked into "practical" and "academic" schools were compared before and after the tracking started. They found that the IQs of those attending the academic track grew faster than the IQs of those attending the practical track even when comparing children who were initially very similar in IQ and background variables (such as SES; IIRC, they used propensity score matching to equate individuals).
ReplyDeleteHowever, you could still argue that the "true" IQs of those selected for the academic track were higher than the true IQs of their ostensibly similar peers, and that their true differences revealed themselves upon retesting. The best approach here would be to use latent variable methods to model IQ change (the German study used observed scores).
If I understand you correctly Ceci seems to believe that IQ is not very important but is increased by education. If it's not important the alleged fact that education increases IQ does not justify investment in IQ.
ReplyDeleteI've often noticed this pattern on the left before. For example after saying that IQ isn't important or is some kind of artifact they say that great efforts are required to reduce environmental lead because it is supposed to cause lower IQ.
Your references to Huckleberry Finn brought back my memories of reading Twain's wonderful novels when I was a child.
I think that Ceci's approach was to say that IQ is an imperfect measure of ability and that the fact that schooling influences it shows that schooling is the most important thing to provide, and IQ will follow. I am making assumptions here, but I think that was the implication.
DeleteAs you say, Ceci suggests "that schooling is the most important thing to provide, and IQ will follow."
Deletereminds me of a sadly discredited theory here in the states in the mid to late 1800s: "rain follows the plow."
here on the great plains we're still waiting for the rain... seems pretty analogous to Ceci's overoptimistic interpretation of the data:)
The rain follows the plow, and good results follow good intentions! Voltaire would be amused.
DeleteI meant to say "investment in education"
ReplyDeleteTechnically though weren't Huck and Jim going up the Mississippi? Jim wanted to escape slavery.
ReplyDeleteI think your observation makes sense, because Jim was always afraid of being sold downriver. I must have drifted away from these important geographic particulars.
ReplyDeleteIq no have a ''ceiling''. I thought in digit span. Is much more easy to memorize a sequence of numbers where there more than one repeated number than a sequence of number without repeating numbers.
ReplyDeleteOther thing, people with low latent inhibition, can do worse in digit span, obviously because they are ''less focused'' OR globally concentrated, i.e, everything capture its attention. But, if people were equally take a digit span test where all memorize in loud voice**
(( east asians are better to learning in silence while ''western'' students are better to learning in loud voice, The East, The West video))
Two ideas, extroverted people tend to focus externally, then introverted people tend to focus internally. Then, introverted people will be better in digit span because they can concentrate more internally, famous ''oriental tranquility=concentration''.
Second idea, digit span tests with repeated numbers are more easy than digit span tests without repeated numbers. Is not only the quantity of numbers that should be memorized but the number of different numbers.
About iq technical errors, there is a real necessity to, in fact, ''to standardize'' globally the iq tests.
Santoculto
Jayman, IV regression is supposed to alleviate somewhat the problem of measurement errors. Thus, your argument does not apply to Brinch/Galloway.
ReplyDeleteJ Thompson, it's a good article in general, but it's unfortunate that you have missed that large sample study here. But don't trust too much the conclusion of these authors however. They conclude that schooling reform increases some abilities but not others, only because they rely on p-values. I have calculated the d gaps a while ago, when reading the paper, and I can tell you the d values were all close to zero. Some d "gains" were even negative.
Furthermore, you mention the Abecedarian, but I believe it has many problems.
In general, people who study IQ gains by educational means do not answer the question : is it intelligence gain or is it knowledge gain ? I suspect the latter to be a large component of the IQ gains, and yet it is not intelligence gain. I talked about that here. See chapter 10.
@Meng Hu:
Delete"Jayman, IV regression is supposed to alleviate somewhat the problem of measurement errors. Thus, your argument does not apply to Brinch/Galloway."
I can't see how it could possibly do that, with regards to the problems I describe. Could you explain a little about this?
Dear Meng Hu, Many thanks for these helpful links. I did not know about the Finnish work, and will look at it. Yes, the Abecedarian study has problems, but I tend to believe there is an effect, and there have been replications.
ReplyDeleteAnyway, thanks again for these links
Education is basically as you say, replicate smart habits to people. "knowledge" can be everything and correlate with "to say smart things but don't understand what it really mean" like today with "race is social construct". People learn a set of smart things to say as possible socio-economic advantage.
ReplyDeleteReal knowledge is not only memmorization.
But some methods can improve knowledge capture efficience. Teacher need adapt to student. If the universe of personal motivations of a hypothetical student is video games, teacher need correlate scholastic knowledge with this specific personal motivation.
Santoculto