Home 2023 › Forums › Official & Introductions › Inter-Rater Reliability of the Vultology Code

Link to Paper: https://nemvus.com/article/138/
Abstract: The reliability of the Cognitive Type Vultology Code 3 (CTVC3), as a visual analysis instrument, is evaluated through a study involving the classification of random samples by ten raters to test the level of independent convergence among them. During the course of six weeks, ten students were trained in the methodology of the instrument. Towards the end of the six weeks, a final exam containing ten randomly selected people was administered to the raters privately, to assess their degree of independent agreement with the instructor and with each other. Four of the ten students obtained a passing score of 90% or higher, while the group average score was 84.25%. The Kappa values among the ten raters were calculated, showing results significantly greater than chance. The results reveal that classification using the CTVC3 meets acceptable criterion for reliability and reproducibility.
Hello guys,
I'm happy to share with you all the first formal test of the Vultology Code's inter-rater reliability. This study relays the results of the first practitioner program, which doubled as a controlled experiment for the evaluation of the Code's reliability. I'm so happy to report that the results emerged very positive, with scores that match and/or exceed reliability standards used in academic settings.
What this means is that, under careful training, it is possible to teach the methodology to others in a consistent way. This helps put to rest questions regarding the ambiguity of the vultology instrument, its signals and scoring. The methodology is clear enough in its definitions of signals to function predictably.
This also means that large disagreements in typings among aspiring readers are more likely due to a lack of training, than to a lack of methodological rigor in the instrument. It just takes time to learn it and it isn't the easiest thing in the world to learn, but it is possible.
Now that we have a proven tool, I am hoping to teach this methodology in full to many more people, and help bring more clarity into the world about human differences and types. I extend my sincerest thanks to everyone who's pitched in, in the development and refinement of this tool over the years. You are all so wonderful, and your feedback has made this possible.
Cheers,
- Auburn
.
.
.
