Date:         Thu, 4 Aug 2011 22:01:12 -0400
Reply-To:     R B <ryan.andrew.black@gmail.com>
Sender:       "SPSSX(r) Discussion" <SPSSX-L@LISTSERV.UGA.EDU>
From:         R B <ryan.andrew.black@gmail.com>
Subject:      Re: Interrater reliability
In-Reply-To:  <68ADE97D694FCB4E95A6E68A2A0133C9E2BFF3E55C@UCMAILBE2.ad.uc.edu>
Content-Type: multipart/alternative;

What types of ratings were made?

Ryan

On Wed, Aug 3, 2011 at 2:41 PM, Lovins, Brian (lovinsbk) <
LOVINSBK@ucmail.uc.edu> wrote:

> Good afternoon,****
>
> I am looking to calculate Kappa to determine a measure of interrater
> reliability. I currently have 125 subjects being rated by different pairs of
> staff. Each pair assesses the same person, but there are 125 different pairs
> of staff. I want to calculate the overall Kappa for the entire group. I can
> do it for the individual pairs and average the scores, but was hoping there
> was a syntax/macro that I could use that would calculate the overall Kappa.
> The data are formatted as follows, but I can restructure the data if needed:
> ****
>
> ** **
>
> Rater1a****
>
> Rater1b****
>
> Rater2a****
>
> Rater2b****
>
> Item 1-Subject 1****
>
> Item 1-Subject 1****
>
> Item 1-Subject 2****
>
> Item 1 – Subject 2****
>
> Item 2 – Subject 1****
>
> Item 2 – subject 1****
>
> Item 2-Subject 2****
>
> Item 2 – Subject 2****
>
> ** **
>
> ** **
>
> Thanks****
>
> Brian****
>

[text/html]