tag:blogger.com,1999:blog-4624586630299165335.post9074344037152757183..comments2024-03-14T09:50:44.315+00:00Comments on Psychological comments: Measurement errorsAnonymoushttp://www.blogger.com/profile/09320614837348759094noreply@blogger.comBlogger14125tag:blogger.com,1999:blog-4624586630299165335.post-66953266687785886212014-06-30T22:57:40.912+01:002014-06-30T22:57:40.912+01:00Very possibly so. Hard to get objective measures o...Very possibly so. Hard to get objective measures of motivation, but it looks as if brighter students are motivated by the sheer interest of tackling difficult questions.Anonymoushttps://www.blogger.com/profile/09320614837348759094noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-37077204356775556562014-06-30T22:56:30.462+01:002014-06-30T22:56:30.462+01:00I think that some countries might "game"...I think that some countries might "game" the tests, just by giving them a lot of emphasis, though as you and others have pointed out other countries have probably ensured that weaker students did not show up on the exam day. We need more data on the "anti cheating" checks on procedures and data.Anonymoushttps://www.blogger.com/profile/09320614837348759094noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-18814347765825287462014-06-30T15:39:34.286+01:002014-06-30T15:39:34.286+01:00Why not say that IQ scores predict real-life outco...Why not say that IQ scores predict real-life outcomes both because they measure "g" and because they measure motivation, both of which are important?Beliavskynoreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-80393719186276510512014-06-30T02:09:29.346+01:002014-06-30T02:09:29.346+01:00One question is whether motivation matters in PISA...One question is whether motivation matters in PISA-type tests. For example, Finland routinely outperforms on PISA tests how it does on IQ standardizations. This could be that Finland's schools really are better than the rest of the Caucasian world's schools. Or maybe the Finnish school system is effective at giving pep talks to Finnish students to try really hard, get a good night's sleep before hand, and other wise treat this low stakes test like a high stakes test.Steve Sailerhttps://www.blogger.com/profile/11920109042402850214noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-75958460923216362092014-06-29T09:59:40.027+01:002014-06-29T09:59:40.027+01:00Dear Panjoomby: Always a pleasure to have a true e...Dear Panjoomby: Always a pleasure to have a true expert on board.Anonymoushttps://www.blogger.com/profile/09320614837348759094noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-83741377652853047332014-06-29T02:43:52.222+01:002014-06-29T02:43:52.222+01:00standardization test-ees & testers are fairly ...standardization test-ees & testers are fairly well-paid. (i.e., motivated:) standardization testers are on the look out for situations & behavior which could invalidate precious data. <br /><br />every once in a while something goes horribly awry: true story - standardization validity study - kid got high score on test A. week or 2 later kid gets low score on test B. discovered a month later during a routine eyeball scatterplot analysis - kid's datapoint stuck out like a sore thumb. much investigation over outlier ensued. <br /><br />turns out kid was pulled from a birthday party to take test B - kid could even see ongoing party from her window as she took test B:( needless to say, her data were not included. <br /><br />party motivation inversely correlates with test scores. <br /><br />test companies rigorously pursue anal-retentive methods for considering & ruling out the effects of everything upon everything else (&/or trust in randomness to even them out). standardization tests are long - testers are often told spread it out over 3 days, do an hour a day, etc. it's all been thought of & looked at to death, examined, evaluated, looked at sideways, rethought, reanalyzed, etc.<br /><br />but when is an outlier an outlier? how far out of line do the scores have to be before not including them? depends on the party, i guess.<br /><br />there is a positive correlation between IQ & motivation. researchers have looked into more different kinds of motivation with multi trait multi method studies than any reasonable person would ever want to know :)<br /><br />test standardization is a serious business - test companies dislike paying test cooperators for invalid data.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-48989818029562132732014-06-29T00:25:36.763+01:002014-06-29T00:25:36.763+01:00In group test data we usually don't have any d...In group test data we usually don't have any data other than item responses, and sometimes latencies of response. Olev Must has good historical data which suggests that there may have been differences in guessing over the years, a hypothesis first proposed by Chris Brand. The picture on guessing rates is not consistent though. However, I doubt that effort is a major factor, though persistence on untimed tasks might be. Anonymoushttps://www.blogger.com/profile/09320614837348759094noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-69358001688879975242014-06-28T19:53:46.045+01:002014-06-28T19:53:46.045+01:00Could differences in motivation play a significant...Could differences in motivation play a significant role in the Flynn Effect? I understand that psychologists giving (individually administered) IQ tests, pay close attention to motivation and consider the scores of unmotivated people to be suspect, but does this apply to the norming samples too? Are the scores of unmotivated people counted when they are standardizing tests like the Wechsler? And if most people in the 1930s were unmotivated to try their best on these tests, would their lack of motivation have even been recognized if it was the norm for the time?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-85446930872744794752014-06-28T08:39:19.601+01:002014-06-28T08:39:19.601+01:00Yes, intelligent people are motivated to solve pro...Yes, intelligent people are motivated to solve problems, because they find problems interesting, and are often rewarded by the pleasure of solving them.Anonymoushttps://www.blogger.com/profile/09320614837348759094noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-60902856422194730972014-06-28T00:27:57.260+01:002014-06-28T00:27:57.260+01:00I think intelligence and motivation are correlated...I think intelligence and motivation are correlated because if you're intelligent enough to see when the benefits of hard work outweigh the costs, you'll be more likely to work harder, and the more intelligent you are, the more your hard work will pay off which will motivate you to work harder in the future.<br /><br />But I would never say that motivation is an aspect of intelligence. Instead I would say that intelligence is the ability to problem solve, but motivation defines what is a problem in the first place. So if there's no food and I'm motivated to eat, then the lack of food by definition is a problem, and my intelligence figures out a solution: order pizza.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-42060809904882722682014-06-27T16:14:29.336+01:002014-06-27T16:14:29.336+01:00And a bit more on the confidence literature:http:/...And a bit more on the confidence literature:http://drjamesthompson.blogspot.co.uk/2013/12/isir-confidence-and-achievement.html Anonymoushttps://www.blogger.com/profile/09320614837348759094noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-81241143354224205382014-06-27T15:17:20.673+01:002014-06-27T15:17:20.673+01:00However, if IQ and personality are correlated then...However, if IQ and personality are correlated then motivation may be an aspect of intelligence http://drjamesthompson.blogspot.co.uk/2013/07/intelligence-personality-and-self.htmlAnonymoushttps://www.blogger.com/profile/09320614837348759094noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-16134053509602429952014-06-27T15:12:34.858+01:002014-06-27T15:12:34.858+01:00The hypothesis can be tested by comparing the pred...The hypothesis can be tested by comparing the predictions made by tests of intelligence and by tests of motivation. So far, tests of intelligence are the better predictors, (also also better than self-rated intelligence).Anonymoushttps://www.blogger.com/profile/09320614837348759094noreply@blogger.comtag:blogger.com,1999:blog-4624586630299165335.post-87115419677125637842014-06-27T14:30:25.126+01:002014-06-27T14:30:25.126+01:00If real IQ was completely uncorrelated with life o...If real IQ was completely uncorrelated with life outcomes but motivation was highly correlated with life outcomes, the IQ test would be more correlated with life outcomes than real IQ. That exact scenario is unlikely but who knows whether real IQ or test IQ is more correlated with life outcomes.Anonymousnoreply@blogger.com