TPC-Journal-V6-Issue2

The Professional Counselor /Volume 6, Issue 2 128 The ROC analysis of the FVOD scale produced an AUROC value of .965, p = .000, standard error = .013, with a 95% confidence interval range of .940 to .990. This indicates that there is an excellent agreement between the FVOD scale and the counselors’ SUD other than alcohol dependence diagnoses (Youngstrom, 2014). A review of the coordinates of the curve (Figure 2) argued against making any adjustments to the current FVOD score cut-offs for Rule 2. Figure 2. ROC Curve for FVOD t Score Plotted Against Counselor SUD Diagnosis The ROC analysis of the SYM scale produced an AUROC value of .803, p = .000, standard error = .035, with a 95% confidence interval range of .735 to .871. This indicates that there is a good agreement between the SYM scale and the counselors’ SUD diagnoses (Youngstrom, 2014). A review of the coordinates of the curve (Figure 3) demonstrates that an adjusted SYM t score cut-off of 56.5 would provide the optimal balance between sensitivity (.761) and specificity (.774). A t score of 56.5 translates into an SYM raw score of approximately 5 for males and 4 for females. Rule 3 was recalculated using these new raw scores and a kappa statistic was calculated to determine the agreement rate between this new SYM cut score and the counselors’ overall SUD diagnoses. The kappa statistic was .437, p = .000. The new Rule 3 sensitivity and specificity rates were, respectively, .76 and .77. Rule 3’s false positive rate was .23 and the false negative rate was .24. Lowering the Rule 3 cut score to 6 improved the kappa statistic by .208. Note. Diagonal segments are produced by ties.