Search the Community
Showing results for tags 'reliability'.
-
Hi, I have a dataset with one column and many rows. Each field (or cell) in the dataset contains text that is being coded by two people. I have read the manual and see how to run the comparison query. This apparently compares the nodes based on the number of characters that are selected and added into each node. Instead, I just want to know whether a cell contains any text that has been coded to a node by coder 1 and then compare that to coder 2. In other words, I don't care about the exact text highlighted and added to a node, I just want to know if the field contains any text coded to the node or not, and then compare those. This is hard to explain in writing, but hopefully it makes some sense. Thanks for the help! ___________ Example: Each row of the single column of the dataset represents a survey response. Two coders code are coding for whether the survey response is generally positive or generally negative. I want to see the agreement between coding for positive and negative at the level of the review, not by the exact text selected and coded into the node.
- 1 reply
-
- inter-rater
- reliability
-
(and 3 more)
Tagged with:
-
Hi everybody, I have a question regarding coding comparison queries. I find it hard to make sense of percentage agreement. Basically, I've run a coding comparison query to see whether individual codes are reliable. Since NVivo includes negative agreement in the calculation, it is hard for me to judge whether we have achieved an acceptable percentage for the particular code. I know that there is the column "A+ B (%)" , but because this percentage is in relation to the overall source size it is not helpful either. Do you have any suggestions for how I I can calculate positive agreement for individual codes? I hope my question is understandable Thanks in advance, Marie
- 4 replies
-
- coding comparison
- percentage agreement
-
(and 1 more)
Tagged with: