Wednesday, April 14, 2021

[Article Review] Revolutionizing Psychometric Test Norms: How Continuous Norming Outperforms Conventional Methods

Reference

Lenhard, W., & Lenhard, A. (2021). Improvement of Norm Score Quality via Regression-Based Continuous Norming. Educational and Psychological Measurement, 81(2), 229-261. https://doi.org/10.1177/0013164420928457

Review

In their article, Lenhard and Lenhard (2021) compared semiparametric continuous norming (SPCN) with conventional norming methods to improve the quality of norm scores in psychometric tests. The authors simulated test scales with varying item numbers and difficulties and used random samples to model norm scores through either conventional ranking procedures or SPCN. Cross-validation and error measures were computed using a representative sample of 840,000 individuals.

The results indicated that both approaches benefitted from an increase in sample size, but SPCN achieved optimal results with smaller samples compared to conventional norming. Furthermore, conventional norming performed worse in terms of data fit, age-related errors, and missing values in norm tables. The authors questioned the general recommendations for sample sizes in test norming due to the varying data fit in conventional norming with fixed subsample sizes.

Lenhard and Lenhard (2021) concluded that test norms should be based on statistical models of raw score distributions rather than simply compiling norm tables via conventional ranking procedures. This study highlights the potential for SPCN to improve norm score quality in psychometric testing, which may lead to better interpretation and utility of test results in educational and psychological settings.

Saturday, April 10, 2021

[Article Review] Building Resistance Against Online Misinformation: Unraveling the Bad News Game

Reference

Roozenbeek, J., Maertens, R., McClanahan, W., & van der Linden, S. (2021). Disentangling Item and Testing Effects in Inoculation Research on Online Misinformation: Solomon Revisited. Educational and Psychological Measurement, 81(2), 340-362. https://doi.org/10.1177/0013164420940378

Review

In the article, "Disentangling Item and Testing Effects in Inoculation Research on Online Misinformation: Solomon Revisited" (2021), Roozenbeek, Maertens, McClanahan, and van der Linden address methodological questions about the effectiveness of the "Bad News" game, an online fake news inoculation tool. The authors investigate the potential item and testing effects, which may influence the observed intervention effects. Their study, based on two online experiments with a total of 2,159 participants, showed that while item effects somewhat influenced inoculation interventions, testing effects did not.

The researchers found that inoculation interventions were effective at improving people's ability to identify misinformation techniques, without making them more skeptical of real news. These findings suggest that the "Bad News" game is a promising tool for building cognitive resistance against misinformation online. By examining the item and testing effects, this study provides valuable insights into the methodological issues in evaluating real-world psychological interventions.