|
Sign In to gain access to subscriptions and/or personal tools.
|
Applied Psychological Measurement, Vol. 32, No. 1,
45-61 (2008)
DOI: 10.1177/0146621607311577
Invariance of Score Linkings Across Gender Groups for Forms of a Testlet-Based College-Level Examination Program Examination
Wen-Ling Yang
Educational Testing Service, wyang{at}ets.org
Rui Gao
Educational Testing Service
This study investigates whether the functions linking number-correct scores to the College-Level Examination Program (CLEP) scaled scores remain invariant over gender groups, using test data on the 16 testlet-based forms of the CLEP College Algebra exam. To be consistent with the operational practice, linking of various test forms to a common reference form is based on the Rasch model. Equatability indices proposed by Dorans and Holland (2000) were used to evaluate linking invariance over gender subpopulations. Overall, linkings based on the gender groups are very similar to linkings for the total group. At all score levels, differences between subgroup and total group linkings are smaller than the difference that will affect the pass/fail decision for CLEP candidates. On only one form, linking based on the male group would pass slightly more candidates than linking for the total group at the recommended CLEP cut score of 50 due to rounding.
Key Words: Index terms: test equating linking invariance of linking equatability
References
- Camilli, G., Wang, M.M., & Fesq, J. (1995). The effects of dimensionality on equating the Law School Admission Test. Journal of Educational Measurement, 32, 79-96.[CrossRef][ISI]
- Dorans, N.J., & Feigenbaum, M.D. (1994). Equating issues engendered by changes to the SAT and PSAT/NMSQT. In I. M. Lawrence, N. J. Dorans, M. D. Feigenbaum, N. J. Feryok, A. P. Schmitt, & N. K. Wright (Eds.), Technical issues related to the introduction of the new SAT and PSAT/NMSQT (ETS Research Memorandum No. RM-94-10). Princeton, NJ: Educational Testing Service.
- Dorans, N.J., & Holland, P.W. (2000). Population invariance and equatability of tests: Basic theory and the linear case. Journal of Educational Measurement, 37, 281-306.[CrossRef]
- Dorans, N.J., & Kingston, N.M. (1985). The effects of violations of unidimensionality on the estimation of item and ability parameters and on item response theory equating of the GRE verbal scale. Journal of Educational Measurement, 22, 249-262.[CrossRef][ISI]
- Hambleton, R.K., & Swaminathan, H. (1990). Item response theory: Principles and applications. Boston: Kluwer Nijhoff.
- Reckase, M.D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4, 207-230.[CrossRef]
- Reckase, M.D., Ackerman, T.A., & Carlson, J.E. (1988). Building a unidimensional test using multidimensional items. Journal of Educational Measurement, 25, 193-203.[CrossRef][ISI]
- Stocking, M.L., & Lord, F.M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.[Abstract]
- von Davier, A.A., Holland, P.W., & Thayer, D.T. (2004). The chain and post-stratification methods for observed-score equating and their relationship to population invariance. Journal of Educational Measurement, 41, 15-32.[CrossRef][ISI]
- Yang, W.-L. (2004). Sensitivity of linkings between AP multiple-choice scores and composite scores to geographical region: An illustration of checking for population invariance. Journal of Educational Measurement, 41, 33-41.[CrossRef][ISI]

CiteULike Connotea Del.icio.us Digg Reddit Technorati What's this?
This article has been cited by other articles:

|
 |

|
 |
 
Qing Yi, H. Assessment, D. J. Harris, and Xiaohong Gao
Invariance of Equating Functions Across Different Subgroups of Examinees Taking a Science Achievement Test
Applied Psychological Measurement,
January 1, 2008;
32(1):
62 - 80.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
N. J. Dorans, Jinghua Liu, and S. Hammond
Anchor Test Type and Population Invariance: An Exploration Across Subpopulations and Test Administrations
Applied Psychological Measurement,
January 1, 2008;
32(1):
81 - 97.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
N. S. Petersen
A Discussion of Population Invariance of Equating
Applied Psychological Measurement,
January 1, 2008;
32(1):
98 - 101.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. L. Brennan
A Discussion of Population Invariance
Applied Psychological Measurement,
January 1, 2008;
32(1):
102 - 114.
[PDF]
|
 |
|
|