Solver Square Comparison: Considers all models.

Date / Time: 01/28/08 11:14:03


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC2008 is represented on the left (rows) and solver IPOPT2008 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :2-CBC2008.trc
Tracefile 2 :5-IPOPT2008.trc
Solvers used : CBC2008
IPOPT2008
Modeltype(s)   LP



IPOPT2008:
optimal
IPOPT2008:
locally optimal
IPOPT2008:
feasible
IPOPT2008:
infeasible
IPOPT2008:
unbounded
IPOPT2008:
fail
IPOPT2008:
no data
total CBC2008
CBC2008:
optimal
90 - 3 - - 18 - 111
CBC2008:
locally optimal
- - - - - - - -
CBC2008:
feasible
- - - - - - - -
CBC2008:
infeasible
- - - - - 4 - 4
CBC2008:
unbounded
- - - - - - - -
CBC2008:
fail
- - 3 - - 2 - 5
CBC2008:
no data
- - - - - - - -
total IPOPT2008 90 - 6 - - 24 - 120




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CBC2008: optimal -- IPOPT2008: optimal    Back to top

Modelname Time (CBC2008) Time (IPOPT2008) Ratio (CBC2008/IPOPT2008) Obj (CBC2008) Obj (IPOPT2008)
aa01 3.9100 14.4700 0.270 55535.43638822 55535.43638976
aa03 2.1200 9.0200 0.235 49616.36363636 49616.36363779
aa3 0.0000 0.0000 --- 0.00000000 0.00000000
aa4 0.0000 0.0000 --- 0.00000000 0.00000000
aa5 0.0000 0.0000 --- 0.00000000 0.00000000
aa6 0.0100 0.0000 --- 0.00000000 0.00000000
air02 0.1200 2.5200 0.048 7640.00000000 7640.00000685
air06 2.1400 9.1400 0.234 49616.36363636 49616.36363779
baxter 1.9200 83.2600 0.023 56007255.67225311 56007255.68220460
car4 2.7700 2.4700 1.121 35.46037017 35.46038611
cari 0.6400 15.9200 0.040 581.89305779 581.89305780
co5 4.8400 11.8200 0.409 714469.55375105 714469.56285988
co9 28.2300 66.2300 0.426 946920.43028456 946920.43056586
cq5 2.1300 8.3000 0.257 400133.80747262 400133.85194598
cq9 12.4500 55.8300 0.223 505541.70980727 505541.70985527
crew1 0.3100 1.0000 0.310 20.55555556 20.55555579
ex3sta1 133.1100 110.8100 1.201 -63.07540325 -63.07540325
fit2d 8.1000 8.8900 0.911 -68464.29329383 -68464.29322686
fit2p 8.1700 1.6400 4.982 68464.29329383 68464.29329394
fome11 0.3700 496.5200 0.001 0.00000000 0.02571471
fome12 0.8200 1012.5000 0.001 0.00000000 0.05142942
gen1 2.1900 14.4600 0.151 0.00000122 0.00000165
gen2 75.5100 23.0900 3.270 3.29279078 3.29279078
gen4 103.8900 39.9400 2.601 0.00000287 0.00000934
jendrec1 4.9700 5.3700 0.926 7028.46051135 7028.46051883
ken-11 0.8100 5.7200 0.142 -6972382262.51996900 -6972382262.51996000
ken-13 2.3700 12.1900 0.194 -1.0257394789482E+10 -1.0257394789482E+10
l30 31.5900 2.7300 11.571 0.95266141 0.95217922
lp22 60.6600 312.5200 0.194 458.94459411 458.94466940
maros-r7 7.3400 36.6500 0.200 1497185.16647964 1497185.16647971
mod2 10.8200 482.1800 0.022 27737371.36444060 27737371.61389040
model10 64.4700 253.0800 0.255 -154599.62130064 -154599.60152150
model11 4.9300 3.8400 1.284 0.00000000 0.00102090
model5 6.0100 16.5900 0.362 -858440.72907343 -858440.71278465
model7 5.3500 378.0900 0.014 49380.08549287 49380.08549939
model9 2.0700 4.2000 0.493 -141123.09361336 -141123.07764086
nemspmm1 5.8100 3.4800 1.670 -327415.83567076 -327415.83567071
nemspmm2 6.9700 5.9100 1.179 -291794.83608908 -291794.82815232
nemswrld 93.8100 133.0500 0.705 260.30896600 260.30906234
nsir1 0.5200 58.4900 0.009 -28909033.00000000 -28909033.00000000
nsir2 0.8700 18.8000 0.046 -27175593.50000000 -27175593.49999990
osa-07 0.5200 27.4100 0.019 535722.51729935 535722.51731281
p010 1.6200 6.6700 0.243 1115047.91511082 1115047.91511097
p05 0.6000 2.8200 0.213 556000.27662588 556000.27662606
pcb3000 1.3200 3.0900 0.427 137416.41961282 137416.43123403
pilot87 25.7700 100.2800 0.257 301.71034746 301.71335719
r05 0.7000 15.0900 0.046 557831.85904066 557831.85904078
rat1 0.6800 62.0000 0.011 1999531.66287928 1999531.66288582
rat5 2.7700 55.0400 0.050 3083707.01043841 3083707.01043848
rosen10 0.2300 1.3400 0.172 -174215.45613870 -174215.45613866
scfxm1-2b-64 7.1700 7.4200 0.966 2877.56386371 2877.56386391
scfxm1-2r-64 2.2300 2.7200 0.820 2877.56386371 2877.56386378
scfxm1-2r-96 4.3200 5.2400 0.824 2891.70611371 2891.70612391
scrs8-2r-512 0.3400 203.2200 0.002 1074.09934157 1074.09934625
scsd8-2b-64 0.6700 1.6900 0.396 15.99866803 15.99866840
scsd8-2c-64 0.6800 1.7800 0.382 14.99923200 14.99923237
scsd8-2r-108 0.1800 1.0900 0.165 23.69999434 23.69999449
scsd8-2r-216 0.5100 2.2500 0.227 23.39998388 23.39998427
sctap1-2b-64 1.6000 3.9000 0.410 484.56000000 484.56000007
slptsk 3.5600 18.5200 0.192 29.89536602 29.89536603
south31 69.1500 6.4800 10.671 1818940197.10106000 1818940197.10111000
stocfor3 1.9300 4.4600 0.433 -39976.78394365 -39976.78394145
testbig 1.8300 2.4100 0.759 -60.42296073 -60.42296055
ulevimin 58.5700 149.3700 0.392 -5191101861.43196900 -5191101861.43196900
wood1p 0.1800 3.8100 0.047 1.44290241 1.44290249
world 10.5800 330.2500 0.032 40364873.11417370 40364873.11466320
bas1lp 4.4200 110.3300 0.040 363.00000000 363.00000000
fome13 1.7800 2111.0800 0.001 0.00000000 0.10285884
ken-18 15.9200 578.4100 0.028 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.9100 19.3800 0.047 215.25000000 215.25000045
nemsemm2 1.5900 10.6500 0.149 581079.57090469 581079.64415549
nsct2 3.4700 1777.2900 0.002 -37175082.00000000 -37175081.99630610
osa-14 1.7800 155.4600 0.011 1106462.84473625 1106462.84478892
osa-30 3.5900 621.6700 0.006 2142139.87320976 2142139.87326934
rail507 20.1300 40.4400 0.498 172.14556668 172.14556730
rail516 7.5100 35.9400 0.209 182.00000000 182.00000081
rail582 17.1600 58.8100 0.292 209.71223296 209.71223351
rat7a 34.4700 160.2000 0.215 2074371.41572828 2074371.41572835
rlfddd 0.5800 33.0200 0.018 -13.00000000 -12.99999932
rlfdual 97.3100 188.9900 0.515 -1.00000000 -0.99999942
rlfprim 5.2400 248.1000 0.021 1.00000000 1.00000074
route 0.6700 18.6800 0.036 5941.65027667 5941.65028001
scsd8-2r-432 1.6100 5.1000 0.316 25.79996945 25.79997250
t0331-4l 28.3700 49.8500 0.569 29730.03335194 29730.03335564
us04 14.0900 31.6100 0.446 17731.66666667 17731.66667683
dbic1 562.3000 3290.6800 0.171 -9768973.00000000 -9768973.00014886
dbir2 6.0700 637.7000 0.010 -6116916.50000000 -6116916.49999329
nemsemm1 5.4600 74.8300 0.073 512959.60078798 512959.68358962
nw14 5.3100 759.7700 0.007 61844.00000000 61844.00014182
self 11.5500 418.5400 0.028 0.00000000 0.00000000

Back to top





CBC2008: optimal -- IPOPT2008: feasible    Back to top

Modelname Time (CBC2008) Time (IPOPT2008) Ratio (CBC2008/IPOPT2008) Obj (CBC2008) Obj (IPOPT2008)
lpl3 1.3700 3825.6600 0.000 27318.00000000 42132.34654202
cre-d 3.2800 3809.3600 0.001 24454969.76454920 24454970.27821420
watson_1 176.9900 3972.5200 0.045 -1609.28070454 -1586.14352600

Back to top





CBC2008: optimal -- IPOPT2008: fail    Back to top

Modelname Time (CBC2008) Time (IPOPT2008) Ratio (CBC2008/IPOPT2008) Obj (CBC2008) Status (IPOPT2008)
pds-06 0.7600 3600.6200 --- 27761037600.00000000 mstat( 6) sstat( 3)
pds-10 1.6100 3600.6200 --- 26727094976.00000000 mstat( 6) sstat( 3)
cre-b 6.5000 3672.1700 --- 23129639.88683240 mstat( 6) sstat( 3)
fome20 8.1800 3775.4900 --- 23821658640.00000000 mstat( 6) sstat( 3)
fome21 17.1400 3704.2600 --- 47346318912.00000000 mstat( 6) sstat( 3)
nsct1 2.1000 3611.3600 --- -38922436.00000000 mstat( 6) sstat( 3)
pds-20 8.1400 3702.6200 --- 23821658640.00000000 mstat( 6) sstat( 3)
pds-30 18.0500 3884.7500 --- 21385445736.00000000 mstat( 6) sstat( 3)
pds-40 33.6700 3643.7100 --- 18855198824.00000000 mstat( 6) sstat( 3)
pds-50 59.4300 4138.4800 --- 16603525724.00000000 mstat( 6) sstat( 3)
pds-60 77.9000 NA --- 14265904407.00000000 mstat(13) sstat(13)
dbir1 6.7600 3738.7500 --- -8106707.00000000 mstat( 6) sstat( 3)
osa-60 13.5600 3601.3400 --- 4044072.50315751 mstat( 6) sstat( 3)
pds-100 171.1700 4025.6200 --- 10928229968.00000000 mstat( 6) sstat( 3)
pds-70 118.2300 3741.4300 --- 12241162812.00000000 mstat( 6) sstat( 3)
pds-80 141.4600 NA --- 11469077462.00000000 mstat(13) sstat(13)
pds-90 176.7900 NA --- 11087561635.00000000 mstat(13) sstat(13)
rail2586 3319.3900 NA --- 935.92182057 mstat(13) sstat(13)

Back to top





CBC2008: infeasible -- IPOPT2008: fail    Back to top

Modelname Time (CBC2008) Time (IPOPT2008) Ratio (CBC2008/IPOPT2008) Status (CBC2008) Status (IPOPT2008)
bgindy 0.0800 3600.3700 --- mstat(19) sstat( 1) mstat( 6) sstat( 3)
gosh 1.6600 3600.8200 --- mstat(19) sstat( 1) mstat( 6) sstat( 3)
lpl1 0.9300 3694.0400 --- mstat(19) sstat( 1) mstat( 6) sstat( 3)
sgpf5y6 21.2200 NA --- mstat(19) sstat( 1) mstat(13) sstat(10)

Back to top





CBC2008: fail -- IPOPT2008: feasible    Back to top

Modelname Time (CBC2008) Time (IPOPT2008) Ratio (CBC2008/IPOPT2008) Status (CBC2008) Obj (IPOPT2008)
nug15 3601.1600 3640.1900 --- mstat(14) sstat( 3) 1040.99789653
qap15 3600.7400 3748.4000 --- mstat(14) sstat( 3) 1040.99450919
rail4284 3605.0200 7231.9500 --- mstat(14) sstat( 3) 21191980.00000000

Back to top





CBC2008: fail -- IPOPT2008: fail    Back to top

Modelname Time (CBC2008) Time (IPOPT2008) Ratio (CBC2008/IPOPT2008) Status (CBC2008) Status (IPOPT2008)
nug20 3600.8100 6895.3000 --- mstat(14) sstat( 3) mstat( 6) sstat( 3)
nug30 3609.2000 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)

Back to top





CBC2008: optimal:     Back to top

Modelname Time (CBC2008) Obj (CBC2008)
aa01 3.9100 55535.43638822
aa03 2.1200 49616.36363636
aa3 0.0000 0.00000000
aa4 0.0000 0.00000000
aa5 0.0000 0.00000000
aa6 0.0100 0.00000000
air02 0.1200 7640.00000000
air06 2.1400 49616.36363636
baxter 1.9200 56007255.67225311
car4 2.7700 35.46037017
cari 0.6400 581.89305779
co5 4.8400 714469.55375105
co9 28.2300 946920.43028456
cq5 2.1300 400133.80747262
cq9 12.4500 505541.70980727
crew1 0.3100 20.55555556
ex3sta1 133.1100 -63.07540325
fit2d 8.1000 -68464.29329383
fit2p 8.1700 68464.29329383
fome11 0.3700 0.00000000
fome12 0.8200 0.00000000
gen1 2.1900 0.00000122
gen2 75.5100 3.29279078
gen4 103.8900 0.00000287
jendrec1 4.9700 7028.46051135
ken-11 0.8100 -6972382262.51996900
ken-13 2.3700 -1.0257394789482E+10
l30 31.5900 0.95266141
lp22 60.6600 458.94459411
lpl3 1.3700 27318.00000000
maros-r7 7.3400 1497185.16647964
mod2 10.8200 27737371.36444060
model10 64.4700 -154599.62130064
model11 4.9300 0.00000000
model5 6.0100 -858440.72907343
model7 5.3500 49380.08549287
model9 2.0700 -141123.09361336
nemspmm1 5.8100 -327415.83567076
nemspmm2 6.9700 -291794.83608908
nemswrld 93.8100 260.30896600
nsir1 0.5200 -28909033.00000000
nsir2 0.8700 -27175593.50000000
osa-07 0.5200 535722.51729935
p010 1.6200 1115047.91511082
p05 0.6000 556000.27662588
pcb3000 1.3200 137416.41961282
pds-06 0.7600 27761037600.00000000
pds-10 1.6100 26727094976.00000000
pilot87 25.7700 301.71034746
r05 0.7000 557831.85904066
rat1 0.6800 1999531.66287928
rat5 2.7700 3083707.01043841
rosen10 0.2300 -174215.45613870
scfxm1-2b-64 7.1700 2877.56386371
scfxm1-2r-64 2.2300 2877.56386371
scfxm1-2r-96 4.3200 2891.70611371
scrs8-2r-512 0.3400 1074.09934157
scsd8-2b-64 0.6700 15.99866803
scsd8-2c-64 0.6800 14.99923200
scsd8-2r-108 0.1800 23.69999434
scsd8-2r-216 0.5100 23.39998388
sctap1-2b-64 1.6000 484.56000000
slptsk 3.5600 29.89536602
south31 69.1500 1818940197.10106000
stocfor3 1.9300 -39976.78394365
testbig 1.8300 -60.42296073
ulevimin 58.5700 -5191101861.43196900
wood1p 0.1800 1.44290241
world 10.5800 40364873.11417370
bas1lp 4.4200 363.00000000
cre-b 6.5000 23129639.88683240
cre-d 3.2800 24454969.76454920
fome13 1.7800 0.00000000
fome20 8.1800 23821658640.00000000
fome21 17.1400 47346318912.00000000
ken-18 15.9200 -5.2217025287397E+10
kl02 0.9100 215.25000000
nemsemm2 1.5900 581079.57090469
nsct1 2.1000 -38922436.00000000
nsct2 3.4700 -37175082.00000000
osa-14 1.7800 1106462.84473625
osa-30 3.5900 2142139.87320976
pds-20 8.1400 23821658640.00000000
pds-30 18.0500 21385445736.00000000
pds-40 33.6700 18855198824.00000000
pds-50 59.4300 16603525724.00000000
pds-60 77.9000 14265904407.00000000
rail507 20.1300 172.14556668
rail516 7.5100 182.00000000
rail582 17.1600 209.71223296
rat7a 34.4700 2074371.41572828
rlfddd 0.5800 -13.00000000
rlfdual 97.3100 -1.00000000
rlfprim 5.2400 1.00000000
route 0.6700 5941.65027667
scsd8-2r-432 1.6100 25.79996945
t0331-4l 28.3700 29730.03335194
us04 14.0900 17731.66666667
watson_1 176.9900 -1609.28070454
dbic1 562.3000 -9768973.00000000
dbir1 6.7600 -8106707.00000000
dbir2 6.0700 -6116916.50000000
nemsemm1 5.4600 512959.60078798
nw14 5.3100 61844.00000000
osa-60 13.5600 4044072.50315751
pds-100 171.1700 10928229968.00000000
pds-70 118.2300 12241162812.00000000
pds-80 141.4600 11469077462.00000000
pds-90 176.7900 11087561635.00000000
rail2586 3319.3900 935.92182057
self 11.5500 0.00000000

Back to top





CBC2008: infeasible:     Back to top

Modelname Time (CBC2008) Status (CBC2008)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
lpl1 -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





CBC2008: fail:     Back to top

Modelname Time (CBC2008) Status (CBC2008)
nug15 -- mstat(14) sstat( 3)
qap15 -- mstat(14) sstat( 3)
nug20 -- mstat(14) sstat( 3)
nug30 -- mstat(14) sstat( 3)
rail4284 -- mstat(14) sstat( 3)

Back to top





IPOPT2008: optimal:     Back to top

Modelname Time (IPOPT2008) Obj (IPOPT2008)
aa01 14.4700 55535.43638976
aa03 9.0200 49616.36363779
aa3 0.0000 0.00000000
aa4 0.0000 0.00000000
aa5 0.0000 0.00000000
aa6 0.0000 0.00000000
air02 2.5200 7640.00000685
air06 9.1400 49616.36363779
baxter 83.2600 56007255.68220460
car4 2.4700 35.46038611
cari 15.9200 581.89305780
co5 11.8200 714469.56285988
co9 66.2300 946920.43056586
cq5 8.3000 400133.85194598
cq9 55.8300 505541.70985527
crew1 1.0000 20.55555579
ex3sta1 110.8100 -63.07540325
fit2d 8.8900 -68464.29322686
fit2p 1.6400 68464.29329394
fome11 496.5200 0.02571471
fome12 1012.5000 0.05142942
gen1 14.4600 0.00000165
gen2 23.0900 3.29279078
gen4 39.9400 0.00000934
jendrec1 5.3700 7028.46051883
ken-11 5.7200 -6972382262.51996000
ken-13 12.1900 -1.0257394789482E+10
l30 2.7300 0.95217922
lp22 312.5200 458.94466940
maros-r7 36.6500 1497185.16647971
mod2 482.1800 27737371.61389040
model10 253.0800 -154599.60152150
model11 3.8400 0.00102090
model5 16.5900 -858440.71278465
model7 378.0900 49380.08549939
model9 4.2000 -141123.07764086
nemspmm1 3.4800 -327415.83567071
nemspmm2 5.9100 -291794.82815232
nemswrld 133.0500 260.30906234
nsir1 58.4900 -28909033.00000000
nsir2 18.8000 -27175593.49999990
osa-07 27.4100 535722.51731281
p010 6.6700 1115047.91511097
p05 2.8200 556000.27662606
pcb3000 3.0900 137416.43123403
pilot87 100.2800 301.71335719
r05 15.0900 557831.85904078
rat1 62.0000 1999531.66288582
rat5 55.0400 3083707.01043848
rosen10 1.3400 -174215.45613866
scfxm1-2b-64 7.4200 2877.56386391
scfxm1-2r-64 2.7200 2877.56386378
scfxm1-2r-96 5.2400 2891.70612391
scrs8-2r-512 203.2200 1074.09934625
scsd8-2b-64 1.6900 15.99866840
scsd8-2c-64 1.7800 14.99923237
scsd8-2r-108 1.0900 23.69999449
scsd8-2r-216 2.2500 23.39998427
sctap1-2b-64 3.9000 484.56000007
slptsk 18.5200 29.89536603
south31 6.4800 1818940197.10111000
stocfor3 4.4600 -39976.78394145
testbig 2.4100 -60.42296055
ulevimin 149.3700 -5191101861.43196900
wood1p 3.8100 1.44290249
world 330.2500 40364873.11466320
bas1lp 110.3300 363.00000000
fome13 2111.0800 0.10285884
ken-18 578.4100 -5.2217025287397E+10
kl02 19.3800 215.25000045
nemsemm2 10.6500 581079.64415549
nsct2 1777.2900 -37175081.99630610
osa-14 155.4600 1106462.84478892
osa-30 621.6700 2142139.87326934
rail507 40.4400 172.14556730
rail516 35.9400 182.00000081
rail582 58.8100 209.71223351
rat7a 160.2000 2074371.41572835
rlfddd 33.0200 -12.99999932
rlfdual 188.9900 -0.99999942
rlfprim 248.1000 1.00000074
route 18.6800 5941.65028001
scsd8-2r-432 5.1000 25.79997250
t0331-4l 49.8500 29730.03335564
us04 31.6100 17731.66667683
dbic1 3290.6800 -9768973.00014886
dbir2 637.7000 -6116916.49999329
nemsemm1 74.8300 512959.68358962
nw14 759.7700 61844.00014182
self 418.5400 0.00000000

Back to top





IPOPT2008: feasible:     Back to top

Modelname Time (IPOPT2008) Obj (IPOPT2008)
lpl3 3825.6600 42132.34654202
nug15 3640.1900 1040.99789653
qap15 3748.4000 1040.99450919
cre-d 3809.3600 24454970.27821420
watson_1 3972.5200 -1586.14352600
rail4284 7231.9500 21191980.00000000

Back to top





IPOPT2008: fail:     Back to top

Modelname Time (IPOPT2008) Status (IPOPT2008)
bgindy -- mstat( 6) sstat( 3)
gosh -- mstat( 6) sstat( 3)
pds-06 -- mstat( 6) sstat( 3)
pds-10 -- mstat( 6) sstat( 3)
cre-b -- mstat( 6) sstat( 3)
fome20 -- mstat( 6) sstat( 3)
fome21 -- mstat( 6) sstat( 3)
lpl1 -- mstat( 6) sstat( 3)
nsct1 -- mstat( 6) sstat( 3)
nug20 -- mstat( 6) sstat( 3)
pds-20 -- mstat( 6) sstat( 3)
pds-30 -- mstat( 6) sstat( 3)
pds-40 -- mstat( 6) sstat( 3)
pds-50 -- mstat( 6) sstat( 3)
pds-60 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(10)
dbir1 -- mstat( 6) sstat( 3)
nug30 -- mstat(13) sstat(13)
osa-60 -- mstat( 6) sstat( 3)
pds-100 -- mstat( 6) sstat( 3)
pds-70 -- mstat( 6) sstat( 3)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail2586 -- mstat(13) sstat(13)

Back to top