Solver Square Comparison: Considers all models.

Date / Time: 01/28/08 11:14:02


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC2004 is represented on the left (rows) and solver GLPK2008 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :1-CBC2004.trc
Tracefile 2 :4-GLPK2008.trc
Solvers used : CBC2004
GLPK2008
Modeltype(s)   LP



GLPK2008:
optimal
GLPK2008:
locally optimal
GLPK2008:
feasible
GLPK2008:
infeasible
GLPK2008:
unbounded
GLPK2008:
fail
GLPK2008:
no data
total CBC2004
CBC2004:
optimal
78 - - - - 20 - 98
CBC2004:
locally optimal
- - - - - - - -
CBC2004:
feasible
- - - - - - - -
CBC2004:
infeasible
5 - - 3 - 6 - 14
CBC2004:
unbounded
- - - - - - - -
CBC2004:
fail
1 - - - - 7 - 8
CBC2004:
no data
- - - - - - - -
total GLPK2008 84 - - 3 - 33 - 120




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CBC2004: optimal -- GLPK2008: optimal    Back to top

Modelname Time (CBC2004) Time (GLPK2008) Ratio (CBC2004/GLPK2008) Obj (CBC2004) Obj (GLPK2008)
aa01 4.8400 21.1600 0.229 55535.43638822 55535.43638822
aa03 2.2900 28.0400 0.082 49616.36363636 49616.36363636
aa3 0.0000 0.0000 --- 0.00000000 0.00000000
aa4 0.0000 0.0000 --- 0.00000000 0.00000000
aa5 0.0000 0.0000 --- 0.00000000 0.00000000
aa6 0.0000 0.0000 --- 0.00000000 0.00000000
air02 0.0700 0.2300 0.304 7640.00000000 7640.00000000
air06 2.2900 28.0400 0.082 49616.36363636 49616.36363636
baxter 12.4400 53.6100 0.232 56007255.67225311 56007255.67225311
car4 2.1900 1.3100 1.672 35.46037017 35.46037017
cari 0.2100 0.3800 0.553 581.89305779 581.89305779
co5 8.3300 17.8600 0.466 714469.55375105 714469.55375105
co9 47.0400 103.0000 0.457 946920.43028456 946920.43028456
cq5 4.9400 12.4900 0.396 400133.80747262 400133.80747262
cq9 32.7200 59.8500 0.547 505541.70980727 505541.70980727
crew1 0.4100 0.4900 0.837 20.55555556 20.55555556
ex3sta1 28.3100 12.0500 2.349 -63.07540325 -63.07540325
fit2d 1.5000 24.6100 0.061 -68464.29329383 -68464.29329383
fit2p 9.5000 12.0400 0.789 68464.29329383 68464.29329383
fome11 0.0800 0.2200 0.364 0.00000000 0.00000000
fome12 0.1500 0.6700 0.224 0.00000000 0.00000000
gen2 70.6300 79.8000 0.885 3.29279078 3.29279078
jendrec1 3.6400 16.4200 0.222 7028.46050003 7028.46051135
ken-11 2.8400 28.0900 0.101 -6972382262.51999000 -6972382262.51996900
lpl3 11.3100 25.6000 0.442 27318.00000000 27318.00000000
maros-r7 44.7100 14.0500 3.182 1497185.16647964 1497185.16647964
model10 344.9900 40.8800 8.439 -154599.56968942 -154599.62130064
model5 16.3100 5.3100 3.072 -858440.72907343 -858440.72907341
model7 15.8800 7.9200 2.005 49380.08549287 49380.08549293
model9 5.4000 6.2100 0.870 -141123.09066298 -141123.09361336
nemspmm1 14.7000 10.7200 1.371 -327415.83567076 -327415.83567076
nemspmm2 16.5100 12.8200 1.288 -291794.83609893 -291794.83608908
osa-07 1.1500 1.3300 0.865 535722.51729935 535722.51729935
p010 5.6300 35.8100 0.157 1115047.91511082 1115047.91511082
p05 1.7000 8.1900 0.208 556000.27662588 556000.27662588
pcb3000 1.3200 7.6400 0.173 137416.41961282 137416.41961282
pds-06 3.8800 9.8500 0.394 27761037600.00000000 27761037600.00000000
pds-10 16.3000 42.2700 0.386 26727094976.00000000 26727094976.00000000
pilot87 62.8800 37.2000 1.690 301.71034733 301.71034744
r05 3.1700 9.5900 0.331 557831.85904066 557831.85904066
rat1 127.6000 7.3700 17.313 1999531.66287928 1999531.66287928
rat5 77.0100 11.3300 6.797 3083707.01043842 3083707.01043819
rosen10 0.9600 3.0700 0.313 -174215.45613870 -174215.45613870
scfxm1-2b-64 14.6300 76.3400 0.192 2877.56386371 2877.56386371
scfxm1-2r-64 3.5200 14.8500 0.237 2877.56386371 2877.56386371
scfxm1-2r-96 8.8700 43.5200 0.204 2891.70611371 2891.70611371
scrs8-2r-512 1.5500 34.3400 0.045 1074.09934157 1074.09934157
scsd8-2b-64 0.5000 51.4100 0.010 15.99866803 15.99866803
scsd8-2c-64 0.5000 56.4000 0.009 14.99923200 14.99923200
scsd8-2r-108 0.1000 7.2800 0.014 23.69999434 23.69999434
scsd8-2r-216 0.3800 32.4500 0.012 23.39998402 23.39998416
sctap1-2b-64 1.4700 12.9400 0.114 484.56000000 484.56000000
slptsk 4.5200 6.8800 0.657 29.89536602 29.89536602
stocfor3 11.8300 16.5200 0.716 -39976.78394365 -39976.78394365
testbig 5.7400 21.6000 0.266 -60.42296073 -60.42296073
wood1p 0.1400 0.4400 0.318 1.44290241 1.44290241
bas1lp 0.9100 5.3100 0.171 363.00000000 363.00000000
cre-b 101.5700 41.9100 2.424 23129639.88683240 23129639.88683240
cre-d 46.1800 26.4500 1.746 24454969.76454920 24454969.76454920
fome13 0.3100 2.3100 0.134 0.00000000 0.00000000
kl02 0.6600 1.8000 0.367 215.25000000 215.25000000
nemsemm2 2.3800 17.5900 0.135 581079.57090469 581079.57090469
nsct2 11.4200 3.7100 3.078 -37175082.00003560 -37175082.00000000
osa-14 5.4700 6.8200 0.802 1106462.84473625 1106462.84473626
osa-30 34.6500 25.3500 1.367 2142139.87320977 2142139.87320976
rail507 21.8500 58.4700 0.374 172.14556668 172.14556668
rail516 8.1900 21.4400 0.382 182.00000000 182.00000000
rail582 16.2700 65.5400 0.248 209.71223296 209.71223296
rat7a 413.1700 83.3100 4.959 2074371.41572829 2074371.41572798
rlfddd 0.6100 113.3400 0.005 -13.00000000 -13.00000000
rlfprim 6.5900 76.4400 0.086 1.00000000 1.00000000
route 1.2400 45.1500 0.027 5941.65027667 5941.65027667
scsd8-2r-432 1.1700 154.5200 0.008 25.79996970 25.79997076
t0331-4l 71.7600 105.8400 0.678 29730.03335194 29730.03335194
us04 0.5500 2.4800 0.222 17731.66666667 17731.66666667
nemsemm1 5.6400 22.7400 0.248 512959.60078797 512959.60078798
nw14 1.6500 6.1500 0.268 61844.00000000 61844.00000000
self 17.8300 19.5200 0.913 0.00000000 0.00000000

Back to top





CBC2004: optimal -- GLPK2008: fail    Back to top

Modelname Time (CBC2004) Time (GLPK2008) Ratio (CBC2004/GLPK2008) Obj (CBC2004) Status (GLPK2008)
gen1 19.2800 NA --- 0.00000052 mstat(13) sstat(13)
gen4 73.6200 NA --- 0.00000133 mstat(13) sstat(13)
ken-13 11.1500 NA --- -1.0257394789482E+10 mstat(13) sstat(13)
l30 37.4900 NA --- 0.95266120 mstat(13) sstat(13)
lp22 70.0600 NA --- 458.94459411 mstat(13) sstat(13)
mod2 82.7900 NA --- 27737371.42265070 mstat(13) sstat(13)
model11 3.9700 NA --- 0.00000000 mstat(13) sstat(13)
nemswrld 166.8100 NA --- 260.30896600 mstat(13) sstat(13)
south31 70.3600 NA --- 1818940197.10106000 mstat(13) sstat(13)
world 70.5200 NA --- 40364873.17569180 mstat(13) sstat(13)
fome20 201.5600 NA --- 23821658640.00000000 mstat(13) sstat(13)
fome21 458.8000 NA --- 47346318912.00000000 mstat(13) sstat(13)
ken-18 149.3000 NA --- -5.2217025287397E+10 mstat(13) sstat(13)
pds-20 187.4400 NA --- 23821658640.00000000 mstat(13) sstat(13)
pds-30 683.4400 NA --- 21385445736.00000000 mstat(13) sstat(13)
pds-40 1267.7100 NA --- 18855198824.00000000 mstat(13) sstat(13)
pds-50 1777.9000 NA --- 16603525724.00000000 mstat(13) sstat(13)
pds-60 2534.8000 NA --- 14265904407.00000000 mstat(13) sstat(13)
rlfdual 24.3200 NA --- -1.00000000 mstat(13) sstat(13)
watson_1 1739.3500 NA --- -1609.28077714 mstat(13) sstat(13)

Back to top





CBC2004: infeasible -- GLPK2008: optimal    Back to top

Modelname Time (CBC2004) Time (GLPK2008) Ratio (CBC2004/GLPK2008) Status (CBC2004) Obj (GLPK2008)
nsir1 0.2900 1.7300 --- mstat(19) sstat( 1) -28909033.00000000
nsir2 0.8600 0.9800 --- mstat(19) sstat( 1) -27175593.50000000
nsct1 8.2500 17.3100 --- mstat(19) sstat( 1) -38922436.00000000
dbir1 11.3100 32.3700 --- mstat(19) sstat( 1) -8106707.00000000
dbir2 11.0100 9.3500 --- mstat(19) sstat( 1) -6116916.50000000

Back to top





CBC2004: infeasible -- GLPK2008: infeasible    Back to top

Modelname Time (CBC2004) Time (GLPK2008) Ratio (CBC2004/GLPK2008) Status (CBC2004) Status (GLPK2008)
bgindy 0.0400 0.5500 --- mstat(19) sstat( 1) mstat(19) sstat( 1)
gosh 12.7900 2.8800 --- mstat(19) sstat( 1) mstat(19) sstat( 1)
sgpf5y6 82.9000 0.5700 --- mstat(19) sstat( 1) mstat(19) sstat( 1)

Back to top





CBC2004: infeasible -- GLPK2008: fail    Back to top

Modelname Time (CBC2004) Time (GLPK2008) Ratio (CBC2004/GLPK2008) Status (CBC2004) Status (GLPK2008)
nug15 1993.6300 NA --- mstat(19) sstat( 1) mstat(13) sstat(13)
qap15 1451.8300 NA --- mstat(19) sstat( 1) mstat(13) sstat(13)
ulevimin 100.0100 NA --- mstat(19) sstat( 1) mstat(13) sstat(13)
lpl1 0.5300 NA --- mstat(19) sstat( 1) mstat(13) sstat(13)
nug20 1804.6000 NA --- mstat(19) sstat( 1) mstat(13) sstat(13)
dbic1 136.3600 NA --- mstat(19) sstat( 1) mstat(13) sstat(13)

Back to top





CBC2004: fail -- GLPK2008: optimal    Back to top

Modelname Time (CBC2004) Time (GLPK2008) Ratio (CBC2004/GLPK2008) Status (CBC2004) Obj (GLPK2008)
osa-60 NA 112.4900 --- mstat(13) sstat(13) 4044072.50315744

Back to top





CBC2004: fail -- GLPK2008: fail    Back to top

Modelname Time (CBC2004) Time (GLPK2008) Ratio (CBC2004/GLPK2008) Status (CBC2004) Status (GLPK2008)
nug30 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
pds-100 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
pds-70 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
pds-80 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
pds-90 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
rail2586 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
rail4284 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)

Back to top





CBC2004: optimal:     Back to top

Modelname Time (CBC2004) Obj (CBC2004)
aa01 4.8400 55535.43638822
aa03 2.2900 49616.36363636
aa3 0.0000 0.00000000
aa4 0.0000 0.00000000
aa5 0.0000 0.00000000
aa6 0.0000 0.00000000
air02 0.0700 7640.00000000
air06 2.2900 49616.36363636
baxter 12.4400 56007255.67225311
car4 2.1900 35.46037017
cari 0.2100 581.89305779
co5 8.3300 714469.55375105
co9 47.0400 946920.43028456
cq5 4.9400 400133.80747262
cq9 32.7200 505541.70980727
crew1 0.4100 20.55555556
ex3sta1 28.3100 -63.07540325
fit2d 1.5000 -68464.29329383
fit2p 9.5000 68464.29329383
fome11 0.0800 0.00000000
fome12 0.1500 0.00000000
gen1 19.2800 0.00000052
gen2 70.6300 3.29279078
gen4 73.6200 0.00000133
jendrec1 3.6400 7028.46050003
ken-11 2.8400 -6972382262.51999000
ken-13 11.1500 -1.0257394789482E+10
l30 37.4900 0.95266120
lp22 70.0600 458.94459411
lpl3 11.3100 27318.00000000
maros-r7 44.7100 1497185.16647964
mod2 82.7900 27737371.42265070
model10 344.9900 -154599.56968942
model11 3.9700 0.00000000
model5 16.3100 -858440.72907343
model7 15.8800 49380.08549287
model9 5.4000 -141123.09066298
nemspmm1 14.7000 -327415.83567076
nemspmm2 16.5100 -291794.83609893
nemswrld 166.8100 260.30896600
osa-07 1.1500 535722.51729935
p010 5.6300 1115047.91511082
p05 1.7000 556000.27662588
pcb3000 1.3200 137416.41961282
pds-06 3.8800 27761037600.00000000
pds-10 16.3000 26727094976.00000000
pilot87 62.8800 301.71034733
r05 3.1700 557831.85904066
rat1 127.6000 1999531.66287928
rat5 77.0100 3083707.01043842
rosen10 0.9600 -174215.45613870
scfxm1-2b-64 14.6300 2877.56386371
scfxm1-2r-64 3.5200 2877.56386371
scfxm1-2r-96 8.8700 2891.70611371
scrs8-2r-512 1.5500 1074.09934157
scsd8-2b-64 0.5000 15.99866803
scsd8-2c-64 0.5000 14.99923200
scsd8-2r-108 0.1000 23.69999434
scsd8-2r-216 0.3800 23.39998402
sctap1-2b-64 1.4700 484.56000000
slptsk 4.5200 29.89536602
south31 70.3600 1818940197.10106000
stocfor3 11.8300 -39976.78394365
testbig 5.7400 -60.42296073
wood1p 0.1400 1.44290241
world 70.5200 40364873.17569180
bas1lp 0.9100 363.00000000
cre-b 101.5700 23129639.88683240
cre-d 46.1800 24454969.76454920
fome13 0.3100 0.00000000
fome20 201.5600 23821658640.00000000
fome21 458.8000 47346318912.00000000
ken-18 149.3000 -5.2217025287397E+10
kl02 0.6600 215.25000000
nemsemm2 2.3800 581079.57090469
nsct2 11.4200 -37175082.00003560
osa-14 5.4700 1106462.84473625
osa-30 34.6500 2142139.87320977
pds-20 187.4400 23821658640.00000000
pds-30 683.4400 21385445736.00000000
pds-40 1267.7100 18855198824.00000000
pds-50 1777.9000 16603525724.00000000
pds-60 2534.8000 14265904407.00000000
rail507 21.8500 172.14556668
rail516 8.1900 182.00000000
rail582 16.2700 209.71223296
rat7a 413.1700 2074371.41572829
rlfddd 0.6100 -13.00000000
rlfdual 24.3200 -1.00000000
rlfprim 6.5900 1.00000000
route 1.2400 5941.65027667
scsd8-2r-432 1.1700 25.79996970
t0331-4l 71.7600 29730.03335194
us04 0.5500 17731.66666667
watson_1 1739.3500 -1609.28077714
nemsemm1 5.6400 512959.60078797
nw14 1.6500 61844.00000000
self 17.8300 0.00000000

Back to top





CBC2004: infeasible:     Back to top

Modelname Time (CBC2004) Status (CBC2004)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
nsir1 -- mstat(19) sstat( 1)
nsir2 -- mstat(19) sstat( 1)
nug15 -- mstat(19) sstat( 1)
qap15 -- mstat(19) sstat( 1)
ulevimin -- mstat(19) sstat( 1)
lpl1 -- mstat(19) sstat( 1)
nsct1 -- mstat(19) sstat( 1)
nug20 -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)
dbic1 -- mstat(19) sstat( 1)
dbir1 -- mstat(19) sstat( 1)
dbir2 -- mstat(19) sstat( 1)

Back to top





CBC2004: fail:     Back to top

Modelname Time (CBC2004) Status (CBC2004)
nug30 -- mstat(13) sstat(13)
osa-60 -- mstat(13) sstat(13)
pds-100 -- mstat(13) sstat(13)
pds-70 -- mstat(13) sstat(13)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail2586 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(13)

Back to top





GLPK2008: optimal:     Back to top

Modelname Time (GLPK2008) Obj (GLPK2008)
aa01 21.1600 55535.43638822
aa03 28.0400 49616.36363636
aa3 0.0000 0.00000000
aa4 0.0000 0.00000000
aa5 0.0000 0.00000000
aa6 0.0000 0.00000000
air02 0.2300 7640.00000000
air06 28.0400 49616.36363636
baxter 53.6100 56007255.67225311
car4 1.3100 35.46037017
cari 0.3800 581.89305779
co5 17.8600 714469.55375105
co9 103.0000 946920.43028456
cq5 12.4900 400133.80747262
cq9 59.8500 505541.70980727
crew1 0.4900 20.55555556
ex3sta1 12.0500 -63.07540325
fit2d 24.6100 -68464.29329383
fit2p 12.0400 68464.29329383
fome11 0.2200 0.00000000
fome12 0.6700 0.00000000
gen2 79.8000 3.29279078
jendrec1 16.4200 7028.46051135
ken-11 28.0900 -6972382262.51996900
lpl3 25.6000 27318.00000000
maros-r7 14.0500 1497185.16647964
model10 40.8800 -154599.62130064
model5 5.3100 -858440.72907341
model7 7.9200 49380.08549293
model9 6.2100 -141123.09361336
nemspmm1 10.7200 -327415.83567076
nemspmm2 12.8200 -291794.83608908
nsir1 1.7300 -28909033.00000000
nsir2 0.9800 -27175593.50000000
osa-07 1.3300 535722.51729935
p010 35.8100 1115047.91511082
p05 8.1900 556000.27662588
pcb3000 7.6400 137416.41961282
pds-06 9.8500 27761037600.00000000
pds-10 42.2700 26727094976.00000000
pilot87 37.2000 301.71034744
r05 9.5900 557831.85904066
rat1 7.3700 1999531.66287928
rat5 11.3300 3083707.01043819
rosen10 3.0700 -174215.45613870
scfxm1-2b-64 76.3400 2877.56386371
scfxm1-2r-64 14.8500 2877.56386371
scfxm1-2r-96 43.5200 2891.70611371
scrs8-2r-512 34.3400 1074.09934157
scsd8-2b-64 51.4100 15.99866803
scsd8-2c-64 56.4000 14.99923200
scsd8-2r-108 7.2800 23.69999434
scsd8-2r-216 32.4500 23.39998416
sctap1-2b-64 12.9400 484.56000000
slptsk 6.8800 29.89536602
stocfor3 16.5200 -39976.78394365
testbig 21.6000 -60.42296073
wood1p 0.4400 1.44290241
bas1lp 5.3100 363.00000000
cre-b 41.9100 23129639.88683240
cre-d 26.4500 24454969.76454920
fome13 2.3100 0.00000000
kl02 1.8000 215.25000000
nemsemm2 17.5900 581079.57090469
nsct1 17.3100 -38922436.00000000
nsct2 3.7100 -37175082.00000000
osa-14 6.8200 1106462.84473626
osa-30 25.3500 2142139.87320976
rail507 58.4700 172.14556668
rail516 21.4400 182.00000000
rail582 65.5400 209.71223296
rat7a 83.3100 2074371.41572798
rlfddd 113.3400 -13.00000000
rlfprim 76.4400 1.00000000
route 45.1500 5941.65027667
scsd8-2r-432 154.5200 25.79997076
t0331-4l 105.8400 29730.03335194
us04 2.4800 17731.66666667
dbir1 32.3700 -8106707.00000000
dbir2 9.3500 -6116916.50000000
nemsemm1 22.7400 512959.60078798
nw14 6.1500 61844.00000000
osa-60 112.4900 4044072.50315744
self 19.5200 0.00000000

Back to top





GLPK2008: infeasible:     Back to top

Modelname Time (GLPK2008) Status (GLPK2008)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





GLPK2008: fail:     Back to top

Modelname Time (GLPK2008) Status (GLPK2008)
gen1 -- mstat(13) sstat(13)
gen4 -- mstat(13) sstat(13)
ken-13 -- mstat(13) sstat(13)
l30 -- mstat(13) sstat(13)
lp22 -- mstat(13) sstat(13)
mod2 -- mstat(13) sstat(13)
model11 -- mstat(13) sstat(13)
nemswrld -- mstat(13) sstat(13)
nug15 -- mstat(13) sstat(13)
qap15 -- mstat(13) sstat(13)
south31 -- mstat(13) sstat(13)
ulevimin -- mstat(13) sstat(13)
world -- mstat(13) sstat(13)
fome20 -- mstat(13) sstat(13)
fome21 -- mstat(13) sstat(13)
ken-18 -- mstat(13) sstat(13)
lpl1 -- mstat(13) sstat(13)
nug20 -- mstat(13) sstat(13)
pds-20 -- mstat(13) sstat(13)
pds-30 -- mstat(13) sstat(13)
pds-40 -- mstat(13) sstat(13)
pds-50 -- mstat(13) sstat(13)
pds-60 -- mstat(13) sstat(13)
rlfdual -- mstat(13) sstat(13)
watson_1 -- mstat(13) sstat(13)
dbic1 -- mstat(13) sstat(13)
nug30 -- mstat(13) sstat(13)
pds-100 -- mstat(13) sstat(13)
pds-70 -- mstat(13) sstat(13)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail2586 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(13)

Back to top