Items related to Handbook of Inter-Rater Reliability (Second Edition)
Synopsis
Note to readers: This book has a more complete third edition already available on Amazon.com.
This book presents various methods for calculating the extent of agreement among raters for different types of ratings. Some of the methods initially developed for nominal-scale ratings only, are extended in this book to ordinal and interval scales as well. To ensure an adequate level of sophistication in the treatment of this topic, the precision aspects associated with the agreement coefficients are treated. New methods begin with the simple scenario of 2 raters and 2 response categories before being extended to the more complex situation of multiple raters, and multiple-level nominal, ordinal and interval scales. Cohen's Kappa coefficient is one of the most widely-used agreement coefficients among researchers, despite its tendency to yield controversial results. Kappa and its various versions have raised concerns among practitioners and showed limitations, which are well-documented in the literature. This book discusses numerous alternatives, and proposes a new framework of analysis that allows researchers to gain further insight into the core issues related to the interpretation of the coefficients' magnitude, in addition to providing a common framework for evaluating the merit of different approaches. The author explains in a clear and intuitive fashion the motivations and assumptions underlying each technique discussed in the book. He demonstrates the benefits of using basic level statistical thinking in the design and analysis of inter-rater reliability experiments. The interpretation and limitations of various techniques are extensively discussed. From optimizing the design of the inter-rater reliability study to validating the computed agreement coefficients, the author's step-by-step approach is practical, easy to understand and will put all practitioners on the path to achieving their data quality objectives.
"synopsis" may belong to another edition of this title.
About the Author
KILEM L GWET has a doctorate degree in Statistics from Carleton University. He is a statistical Consultant, a researcher and an instructor. He has over 15 years of experience in various industries, with clients including Booz Allen & Hamilton, American Health Information Management Association (AHIMA), Centers for Medicare & Medicaid Services (CMS), IMPAQ International and many others. He has several publications on Inter-rater and Intra-rater reliability assessment in peer-reviewed journals. He currently lives in Maryland.
From the Back Cover
A successful data collection should always aim to uphold the integrity of a research project. In many scientific fields of study, data collection activities require adherence to guidelines and compliance with regulations. The consistency with which various observers or raters follow guidelines, and implement methods is essential for ensuring the interpretability and usefulness of data. Independent observers must be able to replicate processes and obtain comparable results. This book discusses many proven techniques and their use in evaluating the extent of agreement among observers.
From the Inside Flap
This text is intended to general practitioners, researchers, students with general analytical background. Being able to read basic mathematical expressions will ease the reading without it being a prerequisite for accessing the material. The key concepts and main approaches are explained in plain language independently of the mathematical formulas. The book is full of numerical examples to show how the different techniques are implemented in practice. To facilitate the use of the techniques presented in this book, I developed a user-friendly point-and-click Excel VBA program called AgreeStat, which can be downloaded from the website agreestat.com. This program can handle a large number of response categories. It can calculate various agreement coefficients available in the literature for 2 raters or more, along with their standard errors. Conditional analysis on specific categories has been implemented as well.
"About this title" may belong to another edition of this title.
(No Available Copies)
Search Books: Create a WantCan't find the book you're looking for? We'll keep searching for you. If one of our booksellers adds it to AbeBooks, we'll let you know!
Create a Want
