Solver Square Comparison: Considers all models.

Date / Time: 01/07/08 20:11:19


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX11 is represented on the left (rows) and solver IPOPT-MEHROTRA on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :1-CPLEX-0.trc
Tracefile 2 :7-IPOPT-1.trc
Solvers used : CPLEX11
IPOPT-MEHROTRA
Modeltype(s)   LP



IPOPT-MEHROTRA:
optimal
IPOPT-MEHROTRA:
locally optimal
IPOPT-MEHROTRA:
feasible
IPOPT-MEHROTRA:
infeasible
IPOPT-MEHROTRA:
unbounded
IPOPT-MEHROTRA:
fail
IPOPT-MEHROTRA:
no data
total CPLEX11
CPLEX11:
optimal
94 - 2 - - 16 - 112
CPLEX11:
locally optimal
- - - - - - - -
CPLEX11:
feasible
- - - - - - - -
CPLEX11:
infeasible
- - - - - 4 - 4
CPLEX11:
unbounded
- - - - - - - -
CPLEX11:
fail
- - - - - 2 - 2
CPLEX11:
no data
- - - - - - - -
total IPOPT-MEHROTRA 94 - 2 - - 22 - 118




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CPLEX11: optimal -- IPOPT-MEHROTRA: optimal    Back to top

Modelname Time (CPLEX11) Time (IPOPT-MEHROTRA) Ratio (CPLEX11/IPOPT-MEHROTRA) Obj (CPLEX11) Obj (IPOPT-MEHROTRA)
aa01 1.5800 4.6500 0.340 55535.43638822 55535.43638976
aa03 0.8400 3.2500 0.258 49616.36363636 49616.36363779
air02 0.0600 1.5700 0.038 7640.00000000 7640.00000685
air06 0.8400 3.2600 0.258 49616.36363636 49616.36363779
baxter 0.8400 40.2200 0.021 56007255.67225311 56007255.68220491
car4 0.4200 1.2100 0.347 35.46037017 35.46038611
cari 0.1000 6.2300 0.016 581.89305779 581.89305780
co5 1.5300 5.3400 0.287 714469.55375105 714469.58102212
co9 6.4400 22.8100 0.282 946920.43028456 946920.49646302
cq5 1.1800 4.1700 0.283 400133.80747262 400133.80948837
cq9 3.5500 19.9100 0.178 505541.70980727 505541.70995496
crew1 0.2100 0.6400 0.328 20.55555556 20.55555579
ex3sta1 19.1400 41.0600 0.466 -63.07540325 -63.07540325
fit2d 0.4100 4.8800 0.084 -68464.29329383 -68464.29322686
fit2p 2.1300 0.9800 2.173 68464.29329383 68464.29329394
fome11 0.1800 170.9700 0.001 0.00000000 0.02571471
fome12 0.3400 350.2200 0.001 0.00000000 0.05142942
gen1 0.1200 4.5900 0.026 0.00000000 0.00000165
gen2 9.6300 7.1200 1.353 3.29279078 3.29279078
gen4 0.8600 12.6000 0.068 0.00000000 0.00000934
jendrec1 0.9600 3.1700 0.303 7028.46051135 7028.46051883
ken-11 0.2700 3.2900 0.082 -6972382262.51996900 -6972382262.51996000
ken-13 0.7800 6.9000 0.113 -1.0257394789482E+10 -1.0257394789482E+10
l30 12.7500 1.3300 9.586 0.95266138 0.94206073
lp22 17.3600 103.3100 0.168 458.94459411 458.94465074
maros-r7 1.3800 10.2000 0.135 1497185.16647964 1497185.16647971
mod2 3.1200 1183.6500 0.003 27737371.36444540 27737371.36747100
model10 7.2500 218.6100 0.033 -154599.62127674 -154599.62123266
model11 0.4600 2.0200 0.228 0.00000000 0.00102090
model5 2.2600 7.4700 0.303 -858440.72907282 -858440.71278465
model7 1.8900 25.3000 0.075 49380.08549287 49380.08549798
model9 0.7200 83.0200 0.009 -141123.09361307 -141123.09274295
nemspmm1 2.3200 2.0400 1.137 -327415.83567076 -327415.83567071
nemspmm2 2.2400 3.3700 0.665 -291794.83608908 -291794.82815276
nemswrld 23.5500 36.1000 0.652 260.30896600 260.30906290
nsir1 0.1000 24.4900 0.004 -28909033.00000000 -28909033.00000000
nsir2 0.2600 7.9100 0.033 -27175593.50000000 -27175593.49999990
nug15 1338.4500 2928.4300 0.457 1040.99404096 1040.99405336
osa-07 0.2000 19.4100 0.010 535722.51729935 535722.51731281
p010 0.5000 3.6300 0.138 1115047.91511082 1115047.91511097
p05 0.2400 1.5600 0.154 556000.27662588 556000.27662606
pcb3000 0.4900 1.7100 0.287 137416.41961282 137416.43123403
pilot87 8.0600 13.8600 0.582 301.71061586 301.71579925
qap15 1304.2100 2520.9100 0.517 1040.99404096 1040.99405335
r05 0.2600 7.6100 0.034 557831.85904066 557831.85904078
rat1 0.3200 14.8900 0.021 1999531.66287928 1999531.66288582
rat5 0.9000 13.4200 0.067 3083707.01043842 3083707.01043848
rosen10 0.2800 0.7700 0.364 -174215.45613870 -174215.45613866
scfxm1-2b-64 1.4000 4.1500 0.337 2877.56386371 2877.56386391
scfxm1-2r-64 0.9500 1.6300 0.583 2877.56386371 2877.56386378
scfxm1-2r-96 1.1200 7.5800 0.148 2891.70611371 2891.70611381
scrs8-2r-512 0.1600 101.6800 0.002 1074.09934157 1074.09934625
scsd8-2b-64 0.2600 1.0100 0.257 15.99866803 15.99866840
scsd8-2c-64 0.2800 1.0100 0.277 14.99923200 14.99923237
scsd8-2r-108 0.1100 0.5600 0.196 23.69999446 23.69999449
scsd8-2r-216 0.2300 1.2600 0.183 23.39998388 23.39998427
sctap1-2b-64 0.2800 2.0700 0.135 484.56000000 484.56000007
slptsk 0.8000 10.9700 0.073 29.89536602 29.89536603
south31 36.1200 3.2900 10.979 1818940197.10106000 1818940197.10111000
stocfor3 0.7200 2.2700 0.317 -39976.78394365 -39976.78394145
testbig 0.2400 1.1700 0.205 -60.42296073 -60.42296055
ulevimin 11.4800 48.5300 0.237 -5191101861.43196900 -5191101861.43194000
wood1p 0.0600 2.0200 0.030 1.44290241 1.44290249
world 2.6200 317.8000 0.008 40364873.11413520 40364873.11464940
bas1lp 8.1100 39.3900 0.206 363.00000000 363.00000000
cre-b 1.6800 3461.4800 0.000 23129639.88683240 23129639.88775590
cre-d 0.9400 2397.6500 0.000 24454969.76454920 24454969.76567270
fome13 0.6300 746.8400 0.001 0.00000000 0.10285884
fome20 2.9600 3440.8100 0.001 23821658640.00000000 23821658640.00090000
ken-18 5.0500 307.3200 0.016 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.3000 10.7300 0.028 215.25000000 215.25000045
nemsemm2 0.4900 5.8600 0.084 581079.57090469 581079.64415548
nsct2 0.8700 750.4900 0.001 -37175082.00000000 -37175081.99630610
osa-14 0.4500 91.1500 0.005 1106462.84473625 1106462.84478891
osa-30 1.0600 330.9300 0.003 2142139.87320976 2142139.87327632
pds-20 2.9800 3437.3600 0.001 23821658640.00000000 23821658640.00090000
rail507 5.3500 22.9600 0.233 172.14556668 172.14556730
rail516 2.4300 19.3900 0.125 182.00000000 182.00000081
rail582 3.3600 31.8800 0.105 209.71223296 209.71223351
rat7a 6.6500 37.5800 0.177 2074371.41572829 2074371.41572835
rlfddd 0.3600 12.2700 0.029 -13.00000000 -12.99999932
rlfdual 5.1500 57.9300 0.089 -1.00000000 -0.99999942
rlfprim 0.7800 82.3500 0.009 1.00000000 1.00000074
route 0.3200 9.6300 0.033 5941.65027667 5941.65028001
scfxm1-2r-256 5.9200 11.1800 0.530 2891.70611371 2891.70611409
scsd8-2r-432 0.5400 2.9600 0.182 25.79996956 25.79997250
sctap1-2r-480 0.8400 4.7800 0.176 248.50000000 248.50000011
t0331-4l 11.7100 22.9500 0.510 29730.03335194 29730.03335564
us04 0.3200 18.0200 0.018 17731.66666667 17731.66667683
dbic1 63.0600 1590.9200 0.040 -9768973.00000000 -9768973.00014886
dbir2 1.2800 227.6700 0.006 -6116916.50000000 -6116916.49999329
nemsemm1 1.0200 44.1500 0.023 512959.60078798 512959.68358962
nw14 1.0000 295.5400 0.003 61844.00000000 61844.00014182
osa-60 2.6900 1977.1600 0.001 4044072.50315742 4044072.50396332

Back to top





CPLEX11: optimal -- IPOPT-MEHROTRA: feasible    Back to top

Modelname Time (CPLEX11) Time (IPOPT-MEHROTRA) Ratio (CPLEX11/IPOPT-MEHROTRA) Obj (CPLEX11) Obj (IPOPT-MEHROTRA)
lpl3 1.0100 3853.7000 0.000 27318.00000000 30010.04036022
rail2586 974.3800 3601.2100 0.271 935.92182057 940.56063377

Back to top





CPLEX11: optimal -- IPOPT-MEHROTRA: fail    Back to top

Modelname Time (CPLEX11) Time (IPOPT-MEHROTRA) Ratio (CPLEX11/IPOPT-MEHROTRA) Obj (CPLEX11) Status (IPOPT-MEHROTRA)
pds-06 0.3000 3600.2300 --- 27761037600.00000000 mstat( 6) sstat( 3)
pds-10 0.6200 3600.2300 --- 26727094976.00000000 mstat( 6) sstat( 3)
fome21 7.8200 3631.3600 --- 47346318912.00000000 mstat( 6) sstat( 3)
nsct1 0.4900 3608.9800 --- -38922436.00000000 mstat( 6) sstat( 3)
pds-30 6.5800 3663.2600 --- 21385445736.00000000 mstat( 6) sstat( 3)
pds-40 11.1400 4005.3300 --- 18855198824.00000000 mstat( 6) sstat( 3)
pds-50 18.1700 NA --- 16603525724.00000000 mstat(13) sstat(10)
pds-60 26.6000 NA --- 14265904407.00000000 mstat(13) sstat(13)
watson_1 15.4400 NA --- -1609.28079835 mstat(13) sstat(10)
dbir1 0.7800 3614.5900 --- -8106707.00000000 mstat( 6) sstat( 3)
pds-100 53.8100 29393.0100 --- 10928229968.00000000 mstat( 6) sstat( 3)
pds-70 34.4900 NA --- 12241162812.00000000 mstat(13) sstat(10)
pds-80 44.2700 NA --- 11469077462.00000000 mstat(13) sstat(13)
pds-90 52.9900 NA --- 11087561635.00000000 mstat(13) sstat(13)
rail4284 2431.5700 NA --- 1054.05449127 mstat(13) sstat(10)
self 5.4800 NA --- 0.00000000 mstat(13) sstat(10)

Back to top





CPLEX11: infeasible -- IPOPT-MEHROTRA: fail    Back to top

Modelname Time (CPLEX11) Time (IPOPT-MEHROTRA) Ratio (CPLEX11/IPOPT-MEHROTRA) Status (CPLEX11) Status (IPOPT-MEHROTRA)
bgindy 0.1300 3604.1900 --- mstat( 4) sstat( 1) mstat( 6) sstat( 3)
gosh 1.0000 3600.1600 --- mstat( 4) sstat( 1) mstat( 6) sstat( 3)
lpl1 35.5700 3609.3600 --- mstat( 4) sstat( 1) mstat( 6) sstat( 3)
sgpf5y6 24.3500 NA --- mstat( 4) sstat( 1) mstat(13) sstat(10)

Back to top





CPLEX11: fail -- IPOPT-MEHROTRA: fail    Back to top

Modelname Time (CPLEX11) Time (IPOPT-MEHROTRA) Ratio (CPLEX11/IPOPT-MEHROTRA) Status (CPLEX11) Status (IPOPT-MEHROTRA)
nug20 3604.0600 NA --- mstat( 6) sstat( 3) mstat(13) sstat(10)
nug30 3678.4000 NA --- mstat( 6) sstat( 3) mstat(13) sstat(10)

Back to top





CPLEX11: optimal:     Back to top

Modelname Time (CPLEX11) Obj (CPLEX11)
aa01 1.5800 55535.43638822
aa03 0.8400 49616.36363636
air02 0.0600 7640.00000000
air06 0.8400 49616.36363636
baxter 0.8400 56007255.67225311
car4 0.4200 35.46037017
cari 0.1000 581.89305779
co5 1.5300 714469.55375105
co9 6.4400 946920.43028456
cq5 1.1800 400133.80747262
cq9 3.5500 505541.70980727
crew1 0.2100 20.55555556
ex3sta1 19.1400 -63.07540325
fit2d 0.4100 -68464.29329383
fit2p 2.1300 68464.29329383
fome11 0.1800 0.00000000
fome12 0.3400 0.00000000
gen1 0.1200 0.00000000
gen2 9.6300 3.29279078
gen4 0.8600 0.00000000
jendrec1 0.9600 7028.46051135
ken-11 0.2700 -6972382262.51996900
ken-13 0.7800 -1.0257394789482E+10
l30 12.7500 0.95266138
lp22 17.3600 458.94459411
lpl3 1.0100 27318.00000000
maros-r7 1.3800 1497185.16647964
mod2 3.1200 27737371.36444540
model10 7.2500 -154599.62127674
model11 0.4600 0.00000000
model5 2.2600 -858440.72907282
model7 1.8900 49380.08549287
model9 0.7200 -141123.09361307
nemspmm1 2.3200 -327415.83567076
nemspmm2 2.2400 -291794.83608908
nemswrld 23.5500 260.30896600
nsir1 0.1000 -28909033.00000000
nsir2 0.2600 -27175593.50000000
nug15 1338.4500 1040.99404096
osa-07 0.2000 535722.51729935
p010 0.5000 1115047.91511082
p05 0.2400 556000.27662588
pcb3000 0.4900 137416.41961282
pds-06 0.3000 27761037600.00000000
pds-10 0.6200 26727094976.00000000
pilot87 8.0600 301.71061586
qap15 1304.2100 1040.99404096
r05 0.2600 557831.85904066
rat1 0.3200 1999531.66287928
rat5 0.9000 3083707.01043842
rosen10 0.2800 -174215.45613870
scfxm1-2b-64 1.4000 2877.56386371
scfxm1-2r-64 0.9500 2877.56386371
scfxm1-2r-96 1.1200 2891.70611371
scrs8-2r-512 0.1600 1074.09934157
scsd8-2b-64 0.2600 15.99866803
scsd8-2c-64 0.2800 14.99923200
scsd8-2r-108 0.1100 23.69999446
scsd8-2r-216 0.2300 23.39998388
sctap1-2b-64 0.2800 484.56000000
slptsk 0.8000 29.89536602
south31 36.1200 1818940197.10106000
stocfor3 0.7200 -39976.78394365
testbig 0.2400 -60.42296073
ulevimin 11.4800 -5191101861.43196900
wood1p 0.0600 1.44290241
world 2.6200 40364873.11413520
bas1lp 8.1100 363.00000000
cre-b 1.6800 23129639.88683240
cre-d 0.9400 24454969.76454920
fome13 0.6300 0.00000000
fome20 2.9600 23821658640.00000000
fome21 7.8200 47346318912.00000000
ken-18 5.0500 -5.2217025287397E+10
kl02 0.3000 215.25000000
nemsemm2 0.4900 581079.57090469
nsct1 0.4900 -38922436.00000000
nsct2 0.8700 -37175082.00000000
osa-14 0.4500 1106462.84473625
osa-30 1.0600 2142139.87320976
pds-20 2.9800 23821658640.00000000
pds-30 6.5800 21385445736.00000000
pds-40 11.1400 18855198824.00000000
pds-50 18.1700 16603525724.00000000
pds-60 26.6000 14265904407.00000000
rail507 5.3500 172.14556668
rail516 2.4300 182.00000000
rail582 3.3600 209.71223296
rat7a 6.6500 2074371.41572829
rlfddd 0.3600 -13.00000000
rlfdual 5.1500 -1.00000000
rlfprim 0.7800 1.00000000
route 0.3200 5941.65027667
scfxm1-2r-256 5.9200 2891.70611371
scsd8-2r-432 0.5400 25.79996956
sctap1-2r-480 0.8400 248.50000000
t0331-4l 11.7100 29730.03335194
us04 0.3200 17731.66666667
watson_1 15.4400 -1609.28079835
dbic1 63.0600 -9768973.00000000
dbir1 0.7800 -8106707.00000000
dbir2 1.2800 -6116916.50000000
nemsemm1 1.0200 512959.60078798
nw14 1.0000 61844.00000000
osa-60 2.6900 4044072.50315742
pds-100 53.8100 10928229968.00000000
pds-70 34.4900 12241162812.00000000
pds-80 44.2700 11469077462.00000000
pds-90 52.9900 11087561635.00000000
rail2586 974.3800 935.92182057
rail4284 2431.5700 1054.05449127
self 5.4800 0.00000000

Back to top





CPLEX11: infeasible:     Back to top

Modelname Time (CPLEX11) Status (CPLEX11)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)
lpl1 -- mstat( 4) sstat( 1)
sgpf5y6 -- mstat( 4) sstat( 1)

Back to top





CPLEX11: fail:     Back to top

Modelname Time (CPLEX11) Status (CPLEX11)
nug20 -- mstat( 6) sstat( 3)
nug30 -- mstat( 6) sstat( 3)

Back to top





IPOPT-MEHROTRA: optimal:     Back to top

Modelname Time (IPOPT-MEHROTRA) Obj (IPOPT-MEHROTRA)
aa01 4.6500 55535.43638976
aa03 3.2500 49616.36363779
air02 1.5700 7640.00000685
air06 3.2600 49616.36363779
baxter 40.2200 56007255.68220491
car4 1.2100 35.46038611
cari 6.2300 581.89305780
co5 5.3400 714469.58102212
co9 22.8100 946920.49646302
cq5 4.1700 400133.80948837
cq9 19.9100 505541.70995496
crew1 0.6400 20.55555579
ex3sta1 41.0600 -63.07540325
fit2d 4.8800 -68464.29322686
fit2p 0.9800 68464.29329394
fome11 170.9700 0.02571471
fome12 350.2200 0.05142942
gen1 4.5900 0.00000165
gen2 7.1200 3.29279078
gen4 12.6000 0.00000934
jendrec1 3.1700 7028.46051883
ken-11 3.2900 -6972382262.51996000
ken-13 6.9000 -1.0257394789482E+10
l30 1.3300 0.94206073
lp22 103.3100 458.94465074
maros-r7 10.2000 1497185.16647971
mod2 1183.6500 27737371.36747100
model10 218.6100 -154599.62123266
model11 2.0200 0.00102090
model5 7.4700 -858440.71278465
model7 25.3000 49380.08549798
model9 83.0200 -141123.09274295
nemspmm1 2.0400 -327415.83567071
nemspmm2 3.3700 -291794.82815276
nemswrld 36.1000 260.30906290
nsir1 24.4900 -28909033.00000000
nsir2 7.9100 -27175593.49999990
nug15 2928.4300 1040.99405336
osa-07 19.4100 535722.51731281
p010 3.6300 1115047.91511097
p05 1.5600 556000.27662606
pcb3000 1.7100 137416.43123403
pilot87 13.8600 301.71579925
qap15 2520.9100 1040.99405335
r05 7.6100 557831.85904078
rat1 14.8900 1999531.66288582
rat5 13.4200 3083707.01043848
rosen10 0.7700 -174215.45613866
scfxm1-2b-64 4.1500 2877.56386391
scfxm1-2r-64 1.6300 2877.56386378
scfxm1-2r-96 7.5800 2891.70611381
scrs8-2r-512 101.6800 1074.09934625
scsd8-2b-64 1.0100 15.99866840
scsd8-2c-64 1.0100 14.99923237
scsd8-2r-108 0.5600 23.69999449
scsd8-2r-216 1.2600 23.39998427
sctap1-2b-64 2.0700 484.56000007
slptsk 10.9700 29.89536603
south31 3.2900 1818940197.10111000
stocfor3 2.2700 -39976.78394145
testbig 1.1700 -60.42296055
ulevimin 48.5300 -5191101861.43194000
wood1p 2.0200 1.44290249
world 317.8000 40364873.11464940
bas1lp 39.3900 363.00000000
cre-b 3461.4800 23129639.88775590
cre-d 2397.6500 24454969.76567270
fome13 746.8400 0.10285884
fome20 3440.8100 23821658640.00090000
ken-18 307.3200 -5.2217025287397E+10
kl02 10.7300 215.25000045
nemsemm2 5.8600 581079.64415548
nsct2 750.4900 -37175081.99630610
osa-14 91.1500 1106462.84478891
osa-30 330.9300 2142139.87327632
pds-20 3437.3600 23821658640.00090000
rail507 22.9600 172.14556730
rail516 19.3900 182.00000081
rail582 31.8800 209.71223351
rat7a 37.5800 2074371.41572835
rlfddd 12.2700 -12.99999932
rlfdual 57.9300 -0.99999942
rlfprim 82.3500 1.00000074
route 9.6300 5941.65028001
scfxm1-2r-256 11.1800 2891.70611409
scsd8-2r-432 2.9600 25.79997250
sctap1-2r-480 4.7800 248.50000011
t0331-4l 22.9500 29730.03335564
us04 18.0200 17731.66667683
dbic1 1590.9200 -9768973.00014886
dbir2 227.6700 -6116916.49999329
nemsemm1 44.1500 512959.68358962
nw14 295.5400 61844.00014182
osa-60 1977.1600 4044072.50396332

Back to top





IPOPT-MEHROTRA: feasible:     Back to top

Modelname Time (IPOPT-MEHROTRA) Obj (IPOPT-MEHROTRA)
lpl3 3853.7000 30010.04036022
rail2586 3601.2100 940.56063377

Back to top





IPOPT-MEHROTRA: fail:     Back to top

Modelname Time (IPOPT-MEHROTRA) Status (IPOPT-MEHROTRA)
bgindy -- mstat( 6) sstat( 3)
gosh -- mstat( 6) sstat( 3)
pds-06 -- mstat( 6) sstat( 3)
pds-10 -- mstat( 6) sstat( 3)
fome21 -- mstat( 6) sstat( 3)
lpl1 -- mstat( 6) sstat( 3)
nsct1 -- mstat( 6) sstat( 3)
nug20 -- mstat(13) sstat(10)
pds-30 -- mstat( 6) sstat( 3)
pds-40 -- mstat( 6) sstat( 3)
pds-50 -- mstat(13) sstat(10)
pds-60 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(10)
watson_1 -- mstat(13) sstat(10)
dbir1 -- mstat( 6) sstat( 3)
nug30 -- mstat(13) sstat(10)
pds-100 -- mstat( 6) sstat( 3)
pds-70 -- mstat(13) sstat(10)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(10)
self -- mstat(13) sstat(10)

Back to top