Radiological Reliability Study on OCD X-Ray Classification

Slide Note
Embed
Share

This study evaluates the reliability of classifying OCD X-rays in various aspects such as location, size, skeletal maturity, and radiodensity of parent bone rim. It includes interrater and intrarater agreements, ICC values, and Kappa agreements across different measurements. The study indicates substantial to excellent reliability within the interpretations.

finnl
finnl Follow

Uploaded on Dec 16, 2024 | 0 Views

Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript

  1. OCD X-Ray Classification Reliability ROCK Study Group

  2. X-Ray Classification Form

  3. OCD X-ray View Most Visible OCD X-Ray View (AP/Lateral/Notch) % Agreement 42% (19/45) 83% (262/315) appa 0.65 0.69 INTERRATER INTRARATER Kappa Agreement 0.81-1 = excellent 0.61-0.8 = substantial 0.41-0.6 = moderate 0.21-0.4 = fair 0-0.2 = slight

  4. Skeletal Maturity Growth Plates (Open/Closing/Closed) ICC 0.86 Kappa 0.84 % Agreement 49% (22/45) % Agreement 86% (270/315) INTERRATER INTRARATER Kappa Agreement ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

  5. OCD Location OCD Location (Medial/Lateral) % Agreement 93% (42/45) 98% (310/315) appa 0.96 0.97 INTERRATER INTRARATER OCD Location (Anterior/Posterior/Not Visible) % Agreement 13% (6/45) 77% (244/315) appa 0.37 0.63 INTERRATER INTRARATER OCD Location (Anterior/Posterior) all cases rated not visible excluded % Agreement 33% (6/18) 88% (215/245) appa 0.49 0.72 INTERRATER INTRARATER Kappa Agreement 0.81-1 = excellent 0.61-0.8 = substantial 0.41-0.6 = moderate 0.21-0.4 = fair 0-0.2 = slight

  6. OCD Size INTERRATER AP Knee Width AP Lesion Width AP Lesion Depth Lateral Knee Width Lateral Lesion Width Lateral Lesion Depth Notch Knee Width Notch Lesion Width Notch Lesion Depth ICC 0.96 0.92 0.95 0.98 0.95 0.93 0.96 0.97 0.97 ICC 0.95 0.88 0.92 0.95 0.84 0.87 0.90 0.95 0.89 INTRARATER AP Knee Width AP Lesion Width AP Lesion Depth Lateral Knee Width Lateral Lesion Width Lateral Lesion Depth Notch Knee Width Notch Lesion Width Notch Lesion Depth ICC Agreement 0.75-1 = excellent 0.60-0.75 = good 0.40-0.59 = fair 0-0.39 = poor

  7. Radiodensity of Parent Bone Rim Parent Bone Rim Radiodensity (More/Same/Less) ICC 0.39 Kappa 0.47 % Agreement 22% (10/45) % Agreement 73% (231/315) INTERRATER INTRARATER Kappa Agreement ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

  8. Radiodensity of Parent Bone Rim Parent Bone Rim Radiodensity (More/Same/Less) ICC 0.39 Kappa 0.47 % Agreement 22% (10/45) % Agreement 73% (231/315) INTERRATER INTRARATER Parent Bone Rim Radiodensity (More/LessORSame) % Agreement 22% (10/45) 75% (235/315) appa 0.35 0.49 INTERRATER INTRARATER Parent Bone Rim Radiodensity (Less/MoreORSame) % Agreement 96% (43/45) 98% (309/315) appa 0.97 0 INTERRATER INTRARATER Kappa Agreement ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

  9. % agreement = 85% (85/100) kappa = 0.70 % agreement = 85% (85/100) kappa = 0.32

  10. Progeny Bone Visibility Progeny Bone Visibility (Yes/No) % Agreement 36% (16/45) 85% (267/315) appa 0.45 0.67 INTERRATER INTRARATER Kappa Agreement 0.81-1 = excellent 0.61-0.8 = substantial 0.41-0.6 = moderate 0.21-0.4 = fair 0-0.2 = slight

  11. Progeny Bone Fragmentation Progeny Bone Fragmentation (Yes/No) % Agreement 50% (8/16) 86% (153/177) appa 0.54 0.64 INTERRATER INTRARATER Kappa Agreement 0.81-1 = excellent 0.61-0.8 = substantial 0.41-0.6 = moderate 0.21-0.4 = fair 0-0.2 = slight

  12. Progeny Bone Displacement Progeny Bone Displacement (None/Partial/Total) ICC 0.52 Kappa 0.80 % Agreement 13% (2/16) % Agreement 91% (161/177) INTERRATER INTRARATER Kappa Agreement 0.81-1 = excellent 0.61-0.8 = substantial 0.41-0.6 = moderate 0.21-0.4 = fair 0-0.2 = slight

  13. Progeny Bone Center Radiodensity Progeny Bone Center Radiodensity (More/Same/Less) ICC 0.52 Kappa 0.57 % Agreement 25% (4/16) INTERRATER INTRARATER 75% (133/177) Kappa Agreement ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

  14. Progeny Bone Center Radiodensity Progeny Bone Center Radiodensity (More/Same/Less) ICC 0.52 Kappa 0.57 % Agreement 25% (4/16) INTERRATER INTRARATER 75% (133/177) Progeny Bone Center Radiodensity (More/LessORSame) % Agreement 63% (10/16) 90% (160/177) appa 0.68 0.27 INTERRATER INTRARATER Progeny Bone Center Radiodensity (Less/MoreORSame) % Agreement 56% (9/16) 83% (147/177) appa 0.64 0.65 INTERRATER INTRARATER Kappa Agreement ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

  15. Progeny Bone Rim Radiodensity Progeny Bone Rim Radiodensity (More/Same/Less) ICC 0.11 Kappa 0.32 % Agreement 0% (0/16) % Agreement 66% (116/177) INTERRATER INTRARATER Kappa Agreement ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

  16. Progeny Bone Rim Radiodensity Progeny Bone Rim Radiodensity (More/Same/Less) ICC 0.11 Kappa 0.32 % Agreement 0% (0/16) % Agreement 66% (116/177) INTERRATER INTRARATER Progeny Bone Rim Radiodensity (More/LessORSame) % Agreement 50% (8/16) 90% (159/177) appa 0.61 0.14 INTERRATER INTRARATER Progeny Bone Rim Radiodensity (Less/MoreORSame) Kappa 0.01 0.36 % Agreement 0% (0/16) 70% (124/177) Kappa Agreement INTERRATER INTRARATER ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

  17. Progeny Bone Boundary Progeny Bone Boundary (Distinct/Indistinct) % Agreement 63% (10/16) 79% (140/177) appa 0.62 0.55 INTERRATER INTRARATER Kappa Agreement 0.81-1 = excellent 0.61-0.8 = substantial 0.41-0.6 = moderate 0.21-0.4 = fair 0-0.2 = slight

  18. Progeny Bone Shape Progeny Bone Shape (Convex/Linear/Concave) ICC 0.33 Kappa 0.53 % Agreement 38% (6/16) % Agreement 77% (137/177) INTERRATER INTRARATER Kappa Agreement ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

  19. Progeny Bone Shape Progeny Bone Shape (Convex/Linear/Concave) ICC 0.33 Kappa 0.53 % Agreement 38% (6/16) % Agreement 77% (137/177) INTERRATER INTRARATER Progeny Bone Shape (Convex/LinearORConcave) % Agreement 44% (7/16) 81% (144/177) appa 0.55 0.58 INTERRATER INTRARATER Progeny Bone Shape (Concave/LinearORConvex) % Agreement 56% (9/16) 83% (147/177) appa 0.65 0.47 INTERRATER INTRARATER Kappa Agreement ICC Agreement 0.81-1 = excellent 0.75-1 = excellent 0.61-0.8 = substantial 0.60-0.75 = good 0.41-0.6 = moderate 0.40-0.59 = fair 0.21-0.4 = fair 0-0.39 = poor 0-0.2 = slight

Related


No related presentations.

More Related Content