| Constructing Measures introduces a way to understand the advantages and disadvantages of measurement instruments, how to use such instruments, and how to apply these methods to develop new instruments or adapt old ones. The book is organized around the steps taken while constructing an instrument. It opens with a summary of the constructive steps involved. Each step is then expanded on in the next four chapters. These chapters develop the "building blocks" that make up an instrument--the construct map, the design plan for the items, the outcome space, and the statistical measurement model. The next three chapters focus on quality control. They rely heavily on the calibrated construct map and review how to check if scores are operating consistently and how to evaluate the reliability and validity evidence. The book introduces a variety of item formats, including multiple-choice, open-ended, and performance items; projects; portfolios; Likert and Guttman items; behavioral observations; and interview protocols.
Each chapter includes an overview of the key concepts, related resources for further investigation and exercises and activities. Some chapters feature appendices that describe parts of the instrument development process in more detail, numerical manipulations used in the text, and/or data results. A variety of examples from the behavioral and social sciences and education including achievement and performance testing; attitude measures; health measures, and general sociological scales, demonstrate the application of the material. An accompanying CD features control files, output, and a data set to allow readers to compute the text's exercises and create new analyses and case archives based on the book's examples so the reader can work through the entire development of an instrument.
Constructing Measures is an ideal text or supplement in courses on item, test, or instrument development, measurement, item response theory, or rasch analysis taught in a variety of departments including education and psychology. The book also appeals to those who develop instruments, including industrial/organizational, educational, and school psychologists, health outcomes researchers, program evaluators, and sociological measurers. Knowledge of basic descriptive statistics and elementary regression is recommended.
This book is designed to be used as either (a) the core reference for a first course in measurement, or (b) the reference for the practical and conceptual aspect of a course that uses another reference for the other, more technical, aspects of the course. In approach (a), the course would normally be followed by a second course that would concentrate on the mathematical and technical expression of the ideas introduced here.1 Thus, this book attempts to convey to readers the measurement ideas that are behind the technical realizations of measurement models, but does not attempt to explore those technical matters in any depth—a second course is needed for that. For example, although the final chapters do introduce the reader to the use of output from an item-response model, the Rasch model, and does give a motivation for using that particular formulation, the book does not attempt to place it within the larger panoply of measurement models that are available. Similar remarks could also be made about topics such as DIF and item and person fit. This seems a natural pedagogic order—find out what the scientific ideas are, then learn about the technical way to express them. It may be that some will prefer to teach both the concepts and technical expression at the same time—for such, the best option is to read a more traditional technical introduction in parallel with this book. |
