QSG this week features external speaker Katerina Mercoulides from University of Minnesota with talk titled “A Comparison of Metaheuristic Optimization Algorithms for Scale Short Form Development”. The abstract for the talk is given below.
Title: A Comparison of Metaheuristic Optimization Algorithms for Scale Short Form Development
Abstract: Short forms of psychometric scales have been commonly used in educational and psychological research to reduce the burden of test administration. However, it is challenging to select items for a short form that preserves the validity and reliability of the scores of the original scale. This study compares automated methods to develop short forms of psychometric scales. Metaheuristic algorithms can select items for short forms while optimizing on several validity criteria, such as adequate model fit, composite reliability and relationship to external variables. Using a Monte Carlo simulation study, this study compared ant-colony optimization, Tabu search, simulated annealing, and genetic algorithm to select short forms of scales. Selection of short forms of scales with unidimensional, multidimensional and bifactor structure were evaluated, with and without model misspecification and/or an external variable. The results showed that when the confirmatory factor analysis model of the full form of the scale was correctly specified or had only minor misspecification, the four algorithms produced short forms with good psychometric qualities that maintained the desired factor structure of the full scale. Major model misspecification resulted in worse performance for all algorithms, but including an external variable only had minor effects on results. The simulated annealing algorithm showed the best overall performance as well as robustness to model misspecification, while the genetic algorithm produced short forms with worse fit than the other algorithms under conditions with model misspecification.
QSG meets on Thursdays from 3:30-4:45pm in Corbett 378. All are welcome, and we hope to see you there. Snacks provided!
For a complete list of speakers for Fall 2019, please visit nd.psychstat.org/classes/qsg2019f/index.