Solver Square Comparison: Considers all models.

Date / Time: 01/28/08 11:14:02


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC2008 is represented on the left (rows) and solver GLPK2008 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :2-CBC2008.trc
Tracefile 2 :4-GLPK2008.trc
Solvers used : CBC2008
GLPK2008
Modeltype(s)   LP



GLPK2008:
optimal
GLPK2008:
locally optimal
GLPK2008:
feasible
GLPK2008:
infeasible
GLPK2008:
unbounded
GLPK2008:
fail
GLPK2008:
no data
total CBC2008
CBC2008:
optimal
84 - - - - 27 - 111
CBC2008:
locally optimal
- - - - - - - -
CBC2008:
feasible
- - - - - - - -
CBC2008:
infeasible
- - - 3 - 1 - 4
CBC2008:
unbounded
- - - - - - - -
CBC2008:
fail
- - - - - 5 - 5
CBC2008:
no data
- - - - - - - -
total GLPK2008 84 - - 3 - 33 - 120




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CBC2008: optimal -- GLPK2008: optimal    Back to top

Modelname Time (CBC2008) Time (GLPK2008) Ratio (CBC2008/GLPK2008) Obj (CBC2008) Obj (GLPK2008)
aa01 3.9100 21.1600 0.185 55535.43638822 55535.43638822
aa03 2.1200 28.0400 0.076 49616.36363636 49616.36363636
aa3 0.0000 0.0000 --- 0.00000000 0.00000000
aa4 0.0000 0.0000 --- 0.00000000 0.00000000
aa5 0.0000 0.0000 --- 0.00000000 0.00000000
aa6 0.0100 0.0000 --- 0.00000000 0.00000000
air02 0.1200 0.2300 0.522 7640.00000000 7640.00000000
air06 2.1400 28.0400 0.076 49616.36363636 49616.36363636
baxter 1.9200 53.6100 0.036 56007255.67225311 56007255.67225311
car4 2.7700 1.3100 2.115 35.46037017 35.46037017
cari 0.6400 0.3800 1.684 581.89305779 581.89305779
co5 4.8400 17.8600 0.271 714469.55375105 714469.55375105
co9 28.2300 103.0000 0.274 946920.43028456 946920.43028456
cq5 2.1300 12.4900 0.171 400133.80747262 400133.80747262
cq9 12.4500 59.8500 0.208 505541.70980727 505541.70980727
crew1 0.3100 0.4900 0.633 20.55555556 20.55555556
ex3sta1 133.1100 12.0500 11.046 -63.07540325 -63.07540325
fit2d 8.1000 24.6100 0.329 -68464.29329383 -68464.29329383
fit2p 8.1700 12.0400 0.679 68464.29329383 68464.29329383
fome11 0.3700 0.2200 1.682 0.00000000 0.00000000
fome12 0.8200 0.6700 1.224 0.00000000 0.00000000
gen2 75.5100 79.8000 0.946 3.29279078 3.29279078
jendrec1 4.9700 16.4200 0.303 7028.46051135 7028.46051135
ken-11 0.8100 28.0900 0.029 -6972382262.51996900 -6972382262.51996900
lpl3 1.3700 25.6000 0.054 27318.00000000 27318.00000000
maros-r7 7.3400 14.0500 0.522 1497185.16647964 1497185.16647964
model10 64.4700 40.8800 1.577 -154599.62130064 -154599.62130064
model5 6.0100 5.3100 1.132 -858440.72907343 -858440.72907341
model7 5.3500 7.9200 0.676 49380.08549287 49380.08549293
model9 2.0700 6.2100 0.333 -141123.09361336 -141123.09361336
nemspmm1 5.8100 10.7200 0.542 -327415.83567076 -327415.83567076
nemspmm2 6.9700 12.8200 0.544 -291794.83608908 -291794.83608908
nsir1 0.5200 1.7300 0.301 -28909033.00000000 -28909033.00000000
nsir2 0.8700 0.9800 0.888 -27175593.50000000 -27175593.50000000
osa-07 0.5200 1.3300 0.391 535722.51729935 535722.51729935
p010 1.6200 35.8100 0.045 1115047.91511082 1115047.91511082
p05 0.6000 8.1900 0.073 556000.27662588 556000.27662588
pcb3000 1.3200 7.6400 0.173 137416.41961282 137416.41961282
pds-06 0.7600 9.8500 0.077 27761037600.00000000 27761037600.00000000
pds-10 1.6100 42.2700 0.038 26727094976.00000000 26727094976.00000000
pilot87 25.7700 37.2000 0.693 301.71034746 301.71034744
r05 0.7000 9.5900 0.073 557831.85904066 557831.85904066
rat1 0.6800 7.3700 0.092 1999531.66287928 1999531.66287928
rat5 2.7700 11.3300 0.244 3083707.01043841 3083707.01043819
rosen10 0.2300 3.0700 0.075 -174215.45613870 -174215.45613870
scfxm1-2b-64 7.1700 76.3400 0.094 2877.56386371 2877.56386371
scfxm1-2r-64 2.2300 14.8500 0.150 2877.56386371 2877.56386371
scfxm1-2r-96 4.3200 43.5200 0.099 2891.70611371 2891.70611371
scrs8-2r-512 0.3400 34.3400 0.010 1074.09934157 1074.09934157
scsd8-2b-64 0.6700 51.4100 0.013 15.99866803 15.99866803
scsd8-2c-64 0.6800 56.4000 0.012 14.99923200 14.99923200
scsd8-2r-108 0.1800 7.2800 0.025 23.69999434 23.69999434
scsd8-2r-216 0.5100 32.4500 0.016 23.39998388 23.39998416
sctap1-2b-64 1.6000 12.9400 0.124 484.56000000 484.56000000
slptsk 3.5600 6.8800 0.517 29.89536602 29.89536602
stocfor3 1.9300 16.5200 0.117 -39976.78394365 -39976.78394365
testbig 1.8300 21.6000 0.085 -60.42296073 -60.42296073
wood1p 0.1800 0.4400 0.409 1.44290241 1.44290241
bas1lp 4.4200 5.3100 0.832 363.00000000 363.00000000
cre-b 6.5000 41.9100 0.155 23129639.88683240 23129639.88683240
cre-d 3.2800 26.4500 0.124 24454969.76454920 24454969.76454920
fome13 1.7800 2.3100 0.771 0.00000000 0.00000000
kl02 0.9100 1.8000 0.506 215.25000000 215.25000000
nemsemm2 1.5900 17.5900 0.090 581079.57090469 581079.57090469
nsct1 2.1000 17.3100 0.121 -38922436.00000000 -38922436.00000000
nsct2 3.4700 3.7100 0.935 -37175082.00000000 -37175082.00000000
osa-14 1.7800 6.8200 0.261 1106462.84473625 1106462.84473626
osa-30 3.5900 25.3500 0.142 2142139.87320976 2142139.87320976
rail507 20.1300 58.4700 0.344 172.14556668 172.14556668
rail516 7.5100 21.4400 0.350 182.00000000 182.00000000
rail582 17.1600 65.5400 0.262 209.71223296 209.71223296
rat7a 34.4700 83.3100 0.414 2074371.41572828 2074371.41572798
rlfddd 0.5800 113.3400 0.005 -13.00000000 -13.00000000
rlfprim 5.2400 76.4400 0.069 1.00000000 1.00000000
route 0.6700 45.1500 0.015 5941.65027667 5941.65027667
scsd8-2r-432 1.6100 154.5200 0.010 25.79996945 25.79997076
t0331-4l 28.3700 105.8400 0.268 29730.03335194 29730.03335194
us04 14.0900 2.4800 5.681 17731.66666667 17731.66666667
dbir1 6.7600 32.3700 0.209 -8106707.00000000 -8106707.00000000
dbir2 6.0700 9.3500 0.649 -6116916.50000000 -6116916.50000000
nemsemm1 5.4600 22.7400 0.240 512959.60078798 512959.60078798
nw14 5.3100 6.1500 0.863 61844.00000000 61844.00000000
osa-60 13.5600 112.4900 0.121 4044072.50315751 4044072.50315744
self 11.5500 19.5200 0.592 0.00000000 0.00000000

Back to top





CBC2008: optimal -- GLPK2008: fail    Back to top

Modelname Time (CBC2008) Time (GLPK2008) Ratio (CBC2008/GLPK2008) Obj (CBC2008) Status (GLPK2008)
gen1 2.1900 NA --- 0.00000122 mstat(13) sstat(13)
gen4 103.8900 NA --- 0.00000287 mstat(13) sstat(13)
ken-13 2.3700 NA --- -1.0257394789482E+10 mstat(13) sstat(13)
l30 31.5900 NA --- 0.95266141 mstat(13) sstat(13)
lp22 60.6600 NA --- 458.94459411 mstat(13) sstat(13)
mod2 10.8200 NA --- 27737371.36444060 mstat(13) sstat(13)
model11 4.9300 NA --- 0.00000000 mstat(13) sstat(13)
nemswrld 93.8100 NA --- 260.30896600 mstat(13) sstat(13)
south31 69.1500 NA --- 1818940197.10106000 mstat(13) sstat(13)
ulevimin 58.5700 NA --- -5191101861.43196900 mstat(13) sstat(13)
world 10.5800 NA --- 40364873.11417370 mstat(13) sstat(13)
fome20 8.1800 NA --- 23821658640.00000000 mstat(13) sstat(13)
fome21 17.1400 NA --- 47346318912.00000000 mstat(13) sstat(13)
ken-18 15.9200 NA --- -5.2217025287397E+10 mstat(13) sstat(13)
pds-20 8.1400 NA --- 23821658640.00000000 mstat(13) sstat(13)
pds-30 18.0500 NA --- 21385445736.00000000 mstat(13) sstat(13)
pds-40 33.6700 NA --- 18855198824.00000000 mstat(13) sstat(13)
pds-50 59.4300 NA --- 16603525724.00000000 mstat(13) sstat(13)
pds-60 77.9000 NA --- 14265904407.00000000 mstat(13) sstat(13)
rlfdual 97.3100 NA --- -1.00000000 mstat(13) sstat(13)
watson_1 176.9900 NA --- -1609.28070454 mstat(13) sstat(13)
dbic1 562.3000 NA --- -9768973.00000000 mstat(13) sstat(13)
pds-100 171.1700 NA --- 10928229968.00000000 mstat(13) sstat(13)
pds-70 118.2300 NA --- 12241162812.00000000 mstat(13) sstat(13)
pds-80 141.4600 NA --- 11469077462.00000000 mstat(13) sstat(13)
pds-90 176.7900 NA --- 11087561635.00000000 mstat(13) sstat(13)
rail2586 3319.3900 NA --- 935.92182057 mstat(13) sstat(13)

Back to top





CBC2008: infeasible -- GLPK2008: infeasible    Back to top

Modelname Time (CBC2008) Time (GLPK2008) Ratio (CBC2008/GLPK2008) Status (CBC2008) Status (GLPK2008)
bgindy 0.0800 0.5500 --- mstat(19) sstat( 1) mstat(19) sstat( 1)
gosh 1.6600 2.8800 --- mstat(19) sstat( 1) mstat(19) sstat( 1)
sgpf5y6 21.2200 0.5700 --- mstat(19) sstat( 1) mstat(19) sstat( 1)

Back to top





CBC2008: infeasible -- GLPK2008: fail    Back to top

Modelname Time (CBC2008) Time (GLPK2008) Ratio (CBC2008/GLPK2008) Status (CBC2008) Status (GLPK2008)
lpl1 0.9300 NA --- mstat(19) sstat( 1) mstat(13) sstat(13)

Back to top





CBC2008: fail -- GLPK2008: fail    Back to top

Modelname Time (CBC2008) Time (GLPK2008) Ratio (CBC2008/GLPK2008) Status (CBC2008) Status (GLPK2008)
nug15 3601.1600 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
qap15 3600.7400 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
nug20 3600.8100 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
nug30 3609.2000 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
rail4284 3605.0200 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)

Back to top





CBC2008: optimal:     Back to top

Modelname Time (CBC2008) Obj (CBC2008)
aa01 3.9100 55535.43638822
aa03 2.1200 49616.36363636
aa3 0.0000 0.00000000
aa4 0.0000 0.00000000
aa5 0.0000 0.00000000
aa6 0.0100 0.00000000
air02 0.1200 7640.00000000
air06 2.1400 49616.36363636
baxter 1.9200 56007255.67225311
car4 2.7700 35.46037017
cari 0.6400 581.89305779
co5 4.8400 714469.55375105
co9 28.2300 946920.43028456
cq5 2.1300 400133.80747262
cq9 12.4500 505541.70980727
crew1 0.3100 20.55555556
ex3sta1 133.1100 -63.07540325
fit2d 8.1000 -68464.29329383
fit2p 8.1700 68464.29329383
fome11 0.3700 0.00000000
fome12 0.8200 0.00000000
gen1 2.1900 0.00000122
gen2 75.5100 3.29279078
gen4 103.8900 0.00000287
jendrec1 4.9700 7028.46051135
ken-11 0.8100 -6972382262.51996900
ken-13 2.3700 -1.0257394789482E+10
l30 31.5900 0.95266141
lp22 60.6600 458.94459411
lpl3 1.3700 27318.00000000
maros-r7 7.3400 1497185.16647964
mod2 10.8200 27737371.36444060
model10 64.4700 -154599.62130064
model11 4.9300 0.00000000
model5 6.0100 -858440.72907343
model7 5.3500 49380.08549287
model9 2.0700 -141123.09361336
nemspmm1 5.8100 -327415.83567076
nemspmm2 6.9700 -291794.83608908
nemswrld 93.8100 260.30896600
nsir1 0.5200 -28909033.00000000
nsir2 0.8700 -27175593.50000000
osa-07 0.5200 535722.51729935
p010 1.6200 1115047.91511082
p05 0.6000 556000.27662588
pcb3000 1.3200 137416.41961282
pds-06 0.7600 27761037600.00000000
pds-10 1.6100 26727094976.00000000
pilot87 25.7700 301.71034746
r05 0.7000 557831.85904066
rat1 0.6800 1999531.66287928
rat5 2.7700 3083707.01043841
rosen10 0.2300 -174215.45613870
scfxm1-2b-64 7.1700 2877.56386371
scfxm1-2r-64 2.2300 2877.56386371
scfxm1-2r-96 4.3200 2891.70611371
scrs8-2r-512 0.3400 1074.09934157
scsd8-2b-64 0.6700 15.99866803
scsd8-2c-64 0.6800 14.99923200
scsd8-2r-108 0.1800 23.69999434
scsd8-2r-216 0.5100 23.39998388
sctap1-2b-64 1.6000 484.56000000
slptsk 3.5600 29.89536602
south31 69.1500 1818940197.10106000
stocfor3 1.9300 -39976.78394365
testbig 1.8300 -60.42296073
ulevimin 58.5700 -5191101861.43196900
wood1p 0.1800 1.44290241
world 10.5800 40364873.11417370
bas1lp 4.4200 363.00000000
cre-b 6.5000 23129639.88683240
cre-d 3.2800 24454969.76454920
fome13 1.7800 0.00000000
fome20 8.1800 23821658640.00000000
fome21 17.1400 47346318912.00000000
ken-18 15.9200 -5.2217025287397E+10
kl02 0.9100 215.25000000
nemsemm2 1.5900 581079.57090469
nsct1 2.1000 -38922436.00000000
nsct2 3.4700 -37175082.00000000
osa-14 1.7800 1106462.84473625
osa-30 3.5900 2142139.87320976
pds-20 8.1400 23821658640.00000000
pds-30 18.0500 21385445736.00000000
pds-40 33.6700 18855198824.00000000
pds-50 59.4300 16603525724.00000000
pds-60 77.9000 14265904407.00000000
rail507 20.1300 172.14556668
rail516 7.5100 182.00000000
rail582 17.1600 209.71223296
rat7a 34.4700 2074371.41572828
rlfddd 0.5800 -13.00000000
rlfdual 97.3100 -1.00000000
rlfprim 5.2400 1.00000000
route 0.6700 5941.65027667
scsd8-2r-432 1.6100 25.79996945
t0331-4l 28.3700 29730.03335194
us04 14.0900 17731.66666667
watson_1 176.9900 -1609.28070454
dbic1 562.3000 -9768973.00000000
dbir1 6.7600 -8106707.00000000
dbir2 6.0700 -6116916.50000000
nemsemm1 5.4600 512959.60078798
nw14 5.3100 61844.00000000
osa-60 13.5600 4044072.50315751
pds-100 171.1700 10928229968.00000000
pds-70 118.2300 12241162812.00000000
pds-80 141.4600 11469077462.00000000
pds-90 176.7900 11087561635.00000000
rail2586 3319.3900 935.92182057
self 11.5500 0.00000000

Back to top





CBC2008: infeasible:     Back to top

Modelname Time (CBC2008) Status (CBC2008)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
lpl1 -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





CBC2008: fail:     Back to top

Modelname Time (CBC2008) Status (CBC2008)
nug15 -- mstat(14) sstat( 3)
qap15 -- mstat(14) sstat( 3)
nug20 -- mstat(14) sstat( 3)
nug30 -- mstat(14) sstat( 3)
rail4284 -- mstat(14) sstat( 3)

Back to top





GLPK2008: optimal:     Back to top

Modelname Time (GLPK2008) Obj (GLPK2008)
aa01 21.1600 55535.43638822
aa03 28.0400 49616.36363636
aa3 0.0000 0.00000000
aa4 0.0000 0.00000000
aa5 0.0000 0.00000000
aa6 0.0000 0.00000000
air02 0.2300 7640.00000000
air06 28.0400 49616.36363636
baxter 53.6100 56007255.67225311
car4 1.3100 35.46037017
cari 0.3800 581.89305779
co5 17.8600 714469.55375105
co9 103.0000 946920.43028456
cq5 12.4900 400133.80747262
cq9 59.8500 505541.70980727
crew1 0.4900 20.55555556
ex3sta1 12.0500 -63.07540325
fit2d 24.6100 -68464.29329383
fit2p 12.0400 68464.29329383
fome11 0.2200 0.00000000
fome12 0.6700 0.00000000
gen2 79.8000 3.29279078
jendrec1 16.4200 7028.46051135
ken-11 28.0900 -6972382262.51996900
lpl3 25.6000 27318.00000000
maros-r7 14.0500 1497185.16647964
model10 40.8800 -154599.62130064
model5 5.3100 -858440.72907341
model7 7.9200 49380.08549293
model9 6.2100 -141123.09361336
nemspmm1 10.7200 -327415.83567076
nemspmm2 12.8200 -291794.83608908
nsir1 1.7300 -28909033.00000000
nsir2 0.9800 -27175593.50000000
osa-07 1.3300 535722.51729935
p010 35.8100 1115047.91511082
p05 8.1900 556000.27662588
pcb3000 7.6400 137416.41961282
pds-06 9.8500 27761037600.00000000
pds-10 42.2700 26727094976.00000000
pilot87 37.2000 301.71034744
r05 9.5900 557831.85904066
rat1 7.3700 1999531.66287928
rat5 11.3300 3083707.01043819
rosen10 3.0700 -174215.45613870
scfxm1-2b-64 76.3400 2877.56386371
scfxm1-2r-64 14.8500 2877.56386371
scfxm1-2r-96 43.5200 2891.70611371
scrs8-2r-512 34.3400 1074.09934157
scsd8-2b-64 51.4100 15.99866803
scsd8-2c-64 56.4000 14.99923200
scsd8-2r-108 7.2800 23.69999434
scsd8-2r-216 32.4500 23.39998416
sctap1-2b-64 12.9400 484.56000000
slptsk 6.8800 29.89536602
stocfor3 16.5200 -39976.78394365
testbig 21.6000 -60.42296073
wood1p 0.4400 1.44290241
bas1lp 5.3100 363.00000000
cre-b 41.9100 23129639.88683240
cre-d 26.4500 24454969.76454920
fome13 2.3100 0.00000000
kl02 1.8000 215.25000000
nemsemm2 17.5900 581079.57090469
nsct1 17.3100 -38922436.00000000
nsct2 3.7100 -37175082.00000000
osa-14 6.8200 1106462.84473626
osa-30 25.3500 2142139.87320976
rail507 58.4700 172.14556668
rail516 21.4400 182.00000000
rail582 65.5400 209.71223296
rat7a 83.3100 2074371.41572798
rlfddd 113.3400 -13.00000000
rlfprim 76.4400 1.00000000
route 45.1500 5941.65027667
scsd8-2r-432 154.5200 25.79997076
t0331-4l 105.8400 29730.03335194
us04 2.4800 17731.66666667
dbir1 32.3700 -8106707.00000000
dbir2 9.3500 -6116916.50000000
nemsemm1 22.7400 512959.60078798
nw14 6.1500 61844.00000000
osa-60 112.4900 4044072.50315744
self 19.5200 0.00000000

Back to top





GLPK2008: infeasible:     Back to top

Modelname Time (GLPK2008) Status (GLPK2008)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





GLPK2008: fail:     Back to top

Modelname Time (GLPK2008) Status (GLPK2008)
gen1 -- mstat(13) sstat(13)
gen4 -- mstat(13) sstat(13)
ken-13 -- mstat(13) sstat(13)
l30 -- mstat(13) sstat(13)
lp22 -- mstat(13) sstat(13)
mod2 -- mstat(13) sstat(13)
model11 -- mstat(13) sstat(13)
nemswrld -- mstat(13) sstat(13)
nug15 -- mstat(13) sstat(13)
qap15 -- mstat(13) sstat(13)
south31 -- mstat(13) sstat(13)
ulevimin -- mstat(13) sstat(13)
world -- mstat(13) sstat(13)
fome20 -- mstat(13) sstat(13)
fome21 -- mstat(13) sstat(13)
ken-18 -- mstat(13) sstat(13)
lpl1 -- mstat(13) sstat(13)
nug20 -- mstat(13) sstat(13)
pds-20 -- mstat(13) sstat(13)
pds-30 -- mstat(13) sstat(13)
pds-40 -- mstat(13) sstat(13)
pds-50 -- mstat(13) sstat(13)
pds-60 -- mstat(13) sstat(13)
rlfdual -- mstat(13) sstat(13)
watson_1 -- mstat(13) sstat(13)
dbic1 -- mstat(13) sstat(13)
nug30 -- mstat(13) sstat(13)
pds-100 -- mstat(13) sstat(13)
pds-70 -- mstat(13) sstat(13)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail2586 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(13)

Back to top