EDP X80D EDP 380D Topics in Psychometrics 3 Hours
3 Lecture Hours 0 Lab Hours
Theory, models, methods, and applications in psychometrics and program evaluation. Educational Psychology 380D and 180P, 280P, 380P, 480P may not both be counted unless the topics vary. Three lecture hours a week for one semester.
Pre/Corequisites: Graduate standing and consent of the adviser in the student's area of specialization.
Grading: Student Option
Repeatable for credit: May be repeated for credit when the topics vary.
Academic Level: Doctoral
Topic 2: Measurement and Evaluation. A basic background in measurement and evaluation is necessary to be appropriately critical of tests and instruments that are used in educational and psychological measurement situations. Subjects include general principles and basic concepts; types of reliability and validity; and the use of psychometric principles in various testing areas, such as intelligence testing; special aptitudes and abilities; educational achievement; and non-cognitive characteristics. Educational Psychology 380D (Topic 2) and 180P (Topic 1), 280P (Topic 1), 380P (Topic 1), 480P (Topic 1) may not both be counted. Additional prerequisite: Twelve semester hours of upper-division coursework in education, psychology, or other behavioral sciences.
Topic 4: Psychometric Theory and Methods. Addresess major approaches to analyzing responses to test items for making inferences about characteristics of examinees and items. Subjects include mental test theory and methods (e.g., the classical true-score model, item response theory models, and test construction methods); an introduction to factor analysis; and psychological scaling theory and procedures. Educational Psychology 380D (Topic 4) and 180P, 280P, 380P, 480P (Topic 2) may not both be counted. Additional prerequisite: Educational Psychology 380C (Topic 2) (or 180E, 280E, 380E (Topic 1)) or consent of instructor.
Topic 6: Program Evaluation Models and Techniques. Examine the theoretical origins of Program Evaluation, as well as major sub-fields such as Responsive and Decision-Oriented evaluation. Conduct program decompositions in order to deeply understand the constraints, transactions and outcomes of a program, and create proposed evaluation of a program. Explore qualitative research methods that are useful for program evaluation and common quantitative methods and instrumentation, including survey design. Relate programmatic examples from other fields such as Nursing, Journalism, Pharmacy, and Educational Leadership. Educational Psychology 380D (Topic 6) and 180P (Topic 4: Evaluation Models and Techniques), 280P (Topic 4: Evaluation Models and Techniques), 380P (Topic 4: Evaluation Models and Techniques), 480P (Topic 4: Evaluation Models and Techniques) may not both be counted. Additional prerequisite: Educational Psychology 380C (Topic 2) (or 380E (Topic 1)), or consent of instructor. Educational Psychology 380C (Topic 6) or 480C (Topic 6) is preferred.
Topic 8: Item Response Theory. Subjects include background and theory (including classical test theory, objectivity in mental measurement, dichotomous and polytomous models, conventional item analysis versus the item response theory approach, item parameter and ability estimation, and information functions), and applications (including relative efficiency of tests, flexilevel and two-stage tests, computerized adaptive tests and mastery tests, test equating, differential item functioning, and attitude and personality measurement). Educational Psychology 380D (Topic 8) and 180P (Topic 6), 280P (Topic 6), 380P (Topic 6), 480P (Topic 6) may not both be counted. Additional prerequisite: Educational Psychology 380D (Topic 4) (or 180P (Topic 2), 280P (Topic 2), 380P (Topic 2), 480P (Topic 2)), or consent of instructor.
Topic 10: Test and Scale Construction. Design of effective instruments and cognitive tests; facet theory for scale construction; measurement of opinions and beliefs; tryout of experimental forms and item analysis; use of factor analysis and multidimensional scaling; norms and scaled scores; reliability and validity assessment; and test equating methods. Educational Psychology 380D (Topic 10) and Educational Psychology 180P (Topic 8), 280P (Topic 8), 380P (Topic 8), 480P (Topic 8) may not both be counted. Additional prerequisite: Educational Psychology 380D (Topic 4), (or Educational Psychology 180P (Topic 2), 280P (Topic 2), 380P (Topic 2), 480P (Topic 2)), or consent of instructor.
Topic 11: Computer Adaptive Testing. In-depth examination of computer adaptive testing (CAT) methodologies based on Item Response Theory (IRT) models. Subjects include optimal test design principles; estimation of person parameters; item banking techniques; components of fully-adaptive and multi-stage testing algorithms; and issues concerning reliability, validity, item exposure, and score reporting. Only one of the following may be counted: Educational Psychology 380D (Topic 11), 380D (Topic 12), 380P (Topic 13). Additional prerequisite: Educational Psychology 380D (Topic 8) or consent of instructor.
Topic 12: Computer-Based Testing. In-depth examination of computer-based testing (CBT) systems based on item response theory (IRT) models, including cases where the items are scored either right or wrong and cases where items are scored using more than two categories. Subjects include data simulation procedures; estimation of item and person parameters; item banking techniques; components of CBT algorithms; and issues concerning reliability, validity, and score reporting. Educational Psychology 380D (Topic 12) and Educational Psychology 180P (Topic 13), 280P (Topic 13), 380P (Topic 13), 480P (Topic 13) may not both be counted. Additional prerequisite: Educational Psychology 380D (Topic 8) (or 180P (Topic 6), 280P (Topic 6), 380P (Topic 6), 480P (Topic 6)), or consent of instructor.
Topic 14: Applied Psychometrics. In-depth examination of applied psychometric techniques. Subjects include equating scores; setting standards; detecting differential item functioning and selection, placement, and classification. Educational Psychology 380D (Topic 14) and Educational Psychology 180P (Topic 14), 280P (Topic 14), 380P (Topic 14), 480P (Topic 14) may not both be counted. Additional prerequisite: Educational Psychology 380D (Topic 4) (or 180P (Topic 2), 280P (Topic 2), 380P (Topic 2), 480P (Topic 2)), or consent of instructor.
Topic 16: Advanced Psychometrics Seminar. Discussion of emerging technical subjects in the areas of psychometrics, measurement, and educational statistics. Addresses advanced techniques for analyzing item response data, and studying characteristics of tests/assessment instruments, using available computer software. Educational Psychology 380D (Topic 16) and 180P, 280P, 380P, 480P (Topic 9) may not both be counted. Additional prerequisite: Educational Psychology 380D (Topic 4) (or 180P, 280P, 380P, 480P (Topic 2)), or consent of instructor.
Topic 18: Advanced Psychometrics Research. Educational Psychology 380D (Topic 18) and 180P (Topic 15), 280P (Topic 15), 380P (Topic 15), 480P (Topic 15) may not both be counted. Additional prerequisite: Educational Psychology 380D (Topic 4) (or 180P (Topic 2), 280P (Topic 2), 380P (Topic 2), 480P (Topic 2)), or consent of instructor.