Inter-observer agreement between 2-dimensional CT versus 3-dimensional I-Space model in the Diagnosis of Occult Scaphoid Fractures

Document Type : RESEARCH PAPER


1 Orthopaedic Hand and Upper Extremity Service, Massachusetts General Hospital, Boston, USA

2 Emergency Department, Reinier de Graaf Gasthuis, Delft, The Netherlands

3 Surgery Department, Medisch Centrum Haaglanden, Den Haag, The Netherlands

4 Radiology Department, Medisch Centrum Haaglanden, Den Haag, The Netherlands

5 Department of Bioinformatics, Erasmus MC University Medical Center, Rotterdam, Netherlands


The I-Space is a radiological imaging system in which Computed Tomography (CT)-scans can be evaluated as a three dimensional hologram. The aim of this study is to analyze the value of virtual reality (I-Space) in diagnosing acute occult scaphoid fractures.
A convenient cohort of 24 patients with a CT-scan from prior studies, without a scaphoid fracture on radiograph, yet high clinical suspicion of a fracture, were included in this study. CT-scans were evaluated in the I-Space by 7 observers of which 3 observers assessed the scans in the I-Space twice. The observers in this study assessed in the I-Space whether the patient had a scaphoid fracture. The kappa value was calculated for inter- and intra-observer agreement.
The Kappa value varied from 0.11 to 0.33 for the first assessment. For the three observers who assessed the CT-scans twice; observer 1 improved from a kappa of 0.33 to 0.50 (95% CI 0.26-0.74, P=0.01), observer 2 from 0.17 to 0.78 (95% CI 0.36-1.0, P<0.001), and observer 3 from 0.11 to 0.24 (95% CI 0.0-0.77, P=0.24).
Following our findings the I-Space has a fast learning curve and has a potential place in the diagnostic modalities for suspected scaphoid fractures.


Main Subjects

1. Rhemrev SJ, de Zwart AD, Kingma LM, Meylaerts
SA, Arndt JW, Schipper IB, et al. Early computed
tomography compared with bone scintigraphy in
suspected scaphoid fractures. Clin Nucl Med. 2010;
2. Mallee WH, Wang J, Poolman RW, Kloen P, Maas M, de
Vet HC, et al. Computed tomography versus magnetic
resonance imaging versus bone scintigraphy for
clinically suspected scaphoid fractures in patients
with negative plain radiographs. Cochrane Database
Syst Rev. 2015; 5(6):CD010023.
3. Hannemann PF, Brouwers L, Dullaert K, van der
Linden ES, Poeze M, Brink PR. Determining scaphoid
waist fracture union by radiographic examination:
an analysis of reliability and validity. Arch Orthop
Trauma Surg. 2015; 135(2):291-6.
4. Timmermans L, Deerenberg EB, van Dijk SM, Lamme
B, Koning AH, Kleinrensink GJ, et al. Abdominal
rectus muscle atrophy and midline shift after
colostomy creation. Surgery. 2014; 155(4):696-701.
5. Meuffels DE, Potters JW, Koning AH, Brown CH Jr,
Verhaar JA, Reijman M. Visualization of postoperative
anterior cruciate ligament reconstruction bone
tunnels: reliability of standard radiographs, CT
scans, and 3D virtual reality images. Acta Orthop.
2011; 82(6):699-703.
6. van Adrichem LN, van Vlimmeren LA, Cadanová
D, Helders PJ, Engelbert RH, van Neck HJ, et al.
Validation of a simple method for measuring cranial
deformities (plagiocephalometry). J Craniofac Surg.
2008; 19(1):15-21.
7. Baken L, van Gruting IM, Steegers EA, van der Spek
PJ, Exalto N, Koning AH. Design and validation of a
3D virtual reality desktop system for sonographic
length and volume measurements in early pregnancy
evaluation. J Clin Ultrasound. 2015; 43(3):164-70.
8. Baken L, Rousian M, Koning AH, Bonsel GJ, Eggink
AJ, Cornette JM, et al. First-trimester detection
of surface abnormalities: a comparison of 2- and
3-dimensional ultrasound and 3-dimensional virtual
reality ultrasound. Reprod Sci. 2014; 21(8):993-9.
9. Rifouna MS, Reus AD, Koning AH, van der Spek
PJ, Exalto N, Steegers EA, et al. First trimester
trophoblast and placental bed vascular volume
measurements in IVF or IVF/ICSI pregnancies. Hum
Reprod. 2014; 29(12):2644-9.
10. Baken L, van Heesch PN, Wildschut HI, Koning AH,
van der Spek PJ, Steegers EA, et al. First-trimester
crown-rump length and embryonic volume of
aneuploid fetuses measured in virtual reality.
Ultrasound Obstet Gynecol. 2013; 41(5):521-5.
11. Viera AJ, Garrett JM. Understanding interobserver
agreement: the kappa statistic. Fam Med. 2005;
12. Landis JR, Koch GG. The measurement of observer
agreement for categorical data. Biometrics. 1977;
13. Adey L, Souer JS, Lozano-Calderon S, Palmer W, Lee S,
Ring D. Computed tomography of suspected scaphoid
fractures. J Hand Surg Am. 2007; 32(1):61-6.