We investigated the extent to which the observed gender differences in mental rotation ability among the 2,468 freshmen studying engineering at a Midwest public university attributed to the gender bias of a test. The Revised Purdue Spatial Visualization Tests: Visualization of Rotations (Revised PSVT:R) is a spatial test frequently used to measure students’ spatial visualization ability in three-dimensional mental rotation in science, technology, engineering, and mathematics fields. With two major approaches for evaluating measurement invariance, we found that five items in the Revised PSVT:R showed a difference in the response pattern by gender, but the impact of these biased items was marginal on the total scores on the scale. Our findings support the equitable use of the Revised PSVT:R by gender for educational research and practices.
American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2.
BrownT. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
3.
ByrneB. M.ShavelsonR. J.MuthénB. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466. doi:10.1037/0033-2909.105.3.456
4.
HillC.CorbettC.St. RoseA. (2010). Why so few? Women in science, technology, engineering, and mathematics. Washington, DC: American Association of University Women. Retrieved from http://files.eric.ed.gov/fulltext/ED509653.pdf
5.
LinnM. C.PetersenA. C. (1985). Emergence and characterization of sex differences in spatial ability: A meta-analysis. Child Development, 56, 1479-1498. doi:10.2307/1130467
6.
LohmanD. F. (1996). Spatial ability and g. In DennisI.TapsfieldP. (Eds.), Human abilities: Their nature and measurement (pp. 97-116). Mahwah, NJ: Lawrence Erlbaum.
7.
MaedaY.YoonS. Y. (2013). A meta-analysis on gender differences in mental rotation ability measured by the Purdue spatial visualization tests: Visualization of rotations (PSVT: R). Educational Psychology Review, 25(1), 69-94. doi:10.1007/s10648-012-9215-x
8.
MaedaY.YoonS. Y.Kim-KangK.ImbrieP. K. (2013). Psychometric properties of the Revised PSVT:R for measuring the first year engineering students’ spatial ability. International Journal of Engineering Education, 29, 763-776.
9.
MuthénL. K.MuthénB. O. (1998-2012). Mplus user’s guide (7th ed.), Los Angeles, CA: Author.
SassD. A. (2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29, 347-363. doi:10.1177/0734282911406661
13.
SchmittN.KuljaninG. (2008). Measurement invariance: Review of practice and implications. Human Resource Management Review, 18, 210-222. doi:10.1016/j.hrmr.2008.03.003
14.
SorbyS.CaseyB.VeurinkN.DulaneyA. (2013). The role of spatial training in improving spatial and calculus performance in engineering students. Learning and Individual Differences, 26, 20-29. doi:10.1016/j.lindif.2013.03.010
UttalD. H.MeadowN. G.TiptonE.HandL. L.AldenA. R.WarrenC.NewcombeN. S. (2013). The malleability of spatial skills: A meta-analysis of training studies. Psychological Bulletin, 139, 352-402. doi:10.1037/a0028446
17.
WaiJ.LubinskiD.BenbowC. P. (2009). Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. Journal of Educational Psychology, 101, 817-835. doi:10.1037/a0016127
18.
YangF. M.HeslinK. C.MehtaK. M.YangC. W.Ocepek-WeliksonK.KleinmanM.. . . TeresiJ. A. (2011). A comparison of item response theory-based methods for examining differential item functioning in object naming test by language of assessment among older Latinos. Psychological Test and Assessment Modeling, 53, 440-460.
19.
YoonS. Y. (2011). Psychometric properties of the revised purdue spatial visualization tests: Visualization of rotations (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses. (Order No. 3480934).
20.
ZwickR. (2012). A review of ETS differential item functioning assessment procedures: Flagging rules, minimum sample size requirements, and criterion refinement. Princeton, NJ: Educational Testing Service.
