1. What levels of measurements are the variables included in the instrument or test?
2. How are the scores interpreted?
3. Are the scores standardized or normed based on age or education levels?
4. For the instrument, describe the reliability testing that has been performed on the instrument.
o For example, Test-Retest method, Internal Consistency method
5. What factors might affect the tests reliability? (Refer to the six factors we discussed in lecture.)
6. Did the instrument/test developers use a classical theory or generalizability approach in developing the instrument and testing its psychometric properties?
Part Two:
1. Explain the concepts of inter-scorer agreement and intra-scorer agreement. In what types of tests are these concepts most important?
2. What are the implications of a professor using the same test as a pre- and posttest? What, if anything, might the professor do to increase reliability of the test scores?
