Home  Details  Evaluation  Register  Download  Submit  Results 

Results for CMS

Algorithm Information

PDF describing the algorithm used

Summary Results:

Figures in this table are extracted from the per-category tables shown further down this page

Scores Rankings
Min Max Average Min Max Average
Lung Boundaries 00.01050360.0008686434.52512.7167
Fissures 01.408140.10322131910.8833
Landmarks 01.292750.6038881135.01667
Singularities 0009.517.514.8667
Average 10.8708


Lung Boundary Results:

% Error means the percentage of points checked in the reference standard for which a penalty was incurred

Scan Pair % Error Left Lung % Error Right Lung % Error Upper Lung % Error Lower Lung Score
(% Error Overall)
Ranking
01 000004.5
02 0000014.5
03 000008.5
04 0.0081848400.0067646100.0033971125
05 0000015.5
06 0000018
07 0.001666930.001517300.002771930.0015951914
08 000006.5
09 2.84169e-050.0001774090.00021892400.00010143416
10 0.0054924800.0045517100.0022811418
11 0.01557820.0054873600.01849630.010503616
12 0000014.5
13 00.00069632500.0006417170.00034327520
14 0.0004340390.0009918340.0003554570.001029660.0007170876
15 000009.5
16 0.001172250.00092445500.001848460.0010514620
17 0000010
18 0.0001852550.001739510.0002216640.001544880.0009577195
19 0000018
20 000006.5
21 0.000893763000.0007814070.0004553115
22 0.004332280.0005000050.004693580.000470190.0024704413
23 0000011
24 0.00198671000.001664410.0008635815
25 0000016
26 0000011
27 000008
28 00.0026690700.002354490.0013219614
29 000006.5
30 0000016
Avg 0.001331840.0004901090.0005601980.001053450.00086864312.7167


Fissure Results:

% Error means the percentage of points checked in the reference standard for which a penalty was incurred

Scan Pair % Error Left Lung % Error Right Lung Score
(% Error Overall)
Ranking
01 00.01243450.010000411
02 00017
03 00014.5
04 00019
05 00017
06 00.006072940.003694885.5
07 0.06899960.1208360.09310026
08 0.009405720.01367750.011932915
09 00010
10 00018
11 0.01585220.0004291220.005529075.5
12 00013.5
13 0.09507720.01217890.06599287
14 2.97150.04848881.4081410
15 0007.5
16 0003
17 0.1136040.004503290.046844911
18 0.2123180.02534820.09913298
19 00013
20 0.04940630.3550610.2384015
21 0.08624920.269020.210635
22 0007
23 00.0562430.03382958
24 00015.5
25 00015.5
26 0.0072661700.0021266518
27 0004.5
28 0.000315261.349750.8672666
29 00016.5
30 00014
Avg 0.1210.07580140.10322110.8833


Landmark Results:

All distances are measured in millimetres

Scan Pair Avg Dist AP Avg Dist SI Avg Dist LR Avg Dist Upper Lung Avg Dist Lower Lung Min Dist Max Dist Score
(Avg Dist)
Ranking
01 0.5913280.6370.4961720.8797971.58045014.70791.237136
02 0.1195310.1470.1617190.3518550.38245100.9943690.36654113
03 0.1406250.1050.11250.3564550.28879701.570840.3233026
04 0.2798510.4656560.3148320.9585330.64486709.753090.7993597
05 000000006
06 0.1157810.060.07921880.2179490.23820801.619050.2309153
07 0.3325780.3570.3403130.6861220.89862303.73150.7855111
08 0.1650.2240.18750.4629520.49623202.898710.4809242
09 0.218750.1750.252930.4633740.57546602.904150.5182996
10 0.3358210.582070.4897391.287570.706097014.17510.9924946
11 0.3082230.2450.1648630.4242290.72418107.620860.5579651
12 000000004
13 0.2636720.3250.3417970.7791950.68025109.860860.7257653
14 0.3206250.3850.3206250.6695970.93137704.165250.7978691
15 0.3164060.2590.2601560.572930.65738105.301870.62022311
16 0.3515620.3250.2832030.6139741.0202404.739460.8252317
17 0.3124990.280.2343740.5363660.87616404.803480.6819466
18 0.4443360.3780.3691410.877310.89202105.680360.8846662
19 0.1468750.1750.1982810.3198680.5370502.191910.4197724
20 0.4266020.3640.3692970.9634610.74170703.557440.8703252
21 0.4973690.5571430.4169120.9517281.1917506.041361.071821
22 0.2968750.3710.343750.7824080.73576206.53180.7562864
23 0.2343750.2250.2050780.5425330.61785902.856110.5824562
24 0.2663350.3749870.2829810.7696290.59241904.670930.695128
25 0.007109380.0070.007109380.0222745001.22510.0122516
26 0.1244530.090.07605470.2463030.27567801.651680.2621653
27 0.1360550.1820.1511720.4356990.35718101.277750.3948710
28 0.6399610.4970.6101951.383271.2358015.04671.292753
29 0.4598930.4813790.3349841.097130.71023908.872180.93067513
30 000000003.5
Avg 0.261750.2758080.246830.5884170.61960804.948330.6038885.01667


Singularity Results:

% Error means the percentage of points checked in the lung volume for which a penalty was incurred

Scan Pair % Error Left Lung % Error Right Lung % Error Upper Lung % Error Lower Lung Score
(% Error Overall)
Ranking
01 0000013
02 0000015.5
03 0000016.5
04 0000015.5
05 0000016
06 0000017.5
07 0000012
08 0000015
09 0000015
10 0000015
11 0000014
12 0000017.5
13 0000015
14 000009.5
15 0000015.5
16 0000016.5
17 0000016
18 0000011
19 0000016
20 0000012.5
21 0000011.5
22 0000014.5
23 0000016
24 0000015.5
25 0000015
26 0000017.5
27 0000016.5
28 0000013.5
29 0000015.5
30 0000016
Avg 0000014.8667


This website is copyright 2009-2010 Keelin Murphy, Bram van Ginneken.