Solver Square Comparison: Considers all models.

Date / Time: 10/01/07 10:36:19


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX is represented on the left (rows) and solver IPOPT-MEHROTRA on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :1-CPLEX-0.trc
Tracefile 2 :5-IPOPT-1.trc
Solvers used : CPLEX
IPOPT-MEHROTRA
Modeltype(s)   LP



IPOPT-MEHROTRA:
optimal
IPOPT-MEHROTRA:
locally optimal
IPOPT-MEHROTRA:
feasible
IPOPT-MEHROTRA:
infeasible
IPOPT-MEHROTRA:
unbounded
IPOPT-MEHROTRA:
fail
IPOPT-MEHROTRA:
no data
total CPLEX
CPLEX:
optimal
93 - 3 - - 16 - 112
CPLEX:
locally optimal
- - - - - - - -
CPLEX:
feasible
- - - - - - - -
CPLEX:
infeasible
- - - - - 4 - 4
CPLEX:
unbounded
- - - - - - - -
CPLEX:
fail
- - - - - 2 - 2
CPLEX:
no data
- - - - - - - -
total IPOPT-MEHROTRA 93 - 3 - - 22 - 118




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CPLEX: optimal -- IPOPT-MEHROTRA: optimal    Back to top

Modelname Time (CPLEX) Time (IPOPT-MEHROTRA) Ratio (CPLEX/IPOPT-MEHROTRA) Obj (CPLEX) Obj (IPOPT-MEHROTRA)
aa01 1.5400 4.6500 0.331 55535.43638822 55535.43638838
aa03 1.0000 3.2600 0.307 49616.36363636 49616.36363651
air02 0.0600 1.5900 0.038 7640.00000000 7640.00000112
air06 1.0200 3.2600 0.313 49616.36363636 49616.36363651
baxter 0.8500 40.1900 0.021 56007255.67225311 56007255.68220491
car4 0.4100 1.2300 0.333 35.46037017 35.46038611
cari 0.0600 6.2300 0.010 581.89305779 581.89305779
co5 1.3700 5.3200 0.258 714469.55375105 714469.58102212
co9 6.6700 23.0600 0.289 946920.43028456 946920.49646302
cq5 1.2000 4.1800 0.287 400133.80747262 400133.80948837
cq9 4.3800 19.8700 0.220 505541.70980727 505541.70995496
crew1 0.2000 0.6400 0.313 20.55555556 20.55555577
ex3sta1 21.2200 40.6800 0.522 -63.07540325 -63.07540325
fit2d 0.4200 4.9100 0.086 -68464.29329383 -68464.29322924
fit2p 2.2000 0.9900 2.222 68464.29329383 68464.29329384
fome11 0.1500 171.3600 0.001 0.00000000 0.00257121
fome12 0.3200 347.7300 0.001 0.00000000 0.00514243
gen1 0.1300 4.6100 0.028 0.00000000 0.00000165
gen2 8.9200 7.0000 1.274 3.29279078 3.29279078
gen4 0.8100 12.9200 0.063 0.00000000 0.00000934
jendrec1 0.9500 3.2600 0.291 7028.46051135 7028.46051883
ken-11 0.2700 3.2900 0.082 -6972382262.51996900 -6972382262.51996900
ken-13 0.7800 6.9600 0.112 -1.0257394789482E+10 -1.0257394789482E+10
l30 11.9900 1.3300 9.015 0.95266133 0.94206073
lp22 17.4800 102.8600 0.170 458.94459411 458.94465074
maros-r7 1.3900 10.2600 0.135 1497185.16647964 1497185.16647965
mod2 2.7600 1184.6600 0.002 27737371.36444530 27737371.36747100
model10 7.0000 209.0000 0.033 -154599.62130064 -154599.62123990
model11 0.4600 2.0200 0.228 0.00000000 0.00016867
model5 1.8600 7.4900 0.248 -858440.72907343 -858440.71278465
model7 2.8100 32.9100 0.085 49380.08549287 49380.08553648
model9 0.7200 61.8900 0.012 -141123.09361215 -141123.09326554
nemspmm1 2.4400 2.0400 1.196 -327415.83567077 -327415.83567076
nemspmm2 2.3200 3.3600 0.690 -291794.83608908 -291794.82815276
nemswrld 23.3900 36.7600 0.636 260.30896600 260.30906290
nsir1 0.0900 24.2000 0.004 -28909033.00000000 -28909033.00000000
nsir2 0.2500 7.9200 0.032 -27175593.50000000 -27175593.49999990
nug15 1349.7700 2944.4900 0.458 1040.99404096 1040.99405336
osa-07 0.1800 18.6300 0.010 535722.51729935 535722.51730081
p010 0.5200 3.6500 0.142 1115047.91511082 1115047.91511083
p05 0.2400 1.5500 0.155 556000.27662588 556000.27662600
pcb3000 0.4800 1.7100 0.281 137416.41961282 137416.43123403
pilot87 8.0700 13.8700 0.582 301.71035949 301.71579925
qap15 1318.5300 2537.0500 0.520 1040.99404096 1040.99405335
r05 0.2100 7.6200 0.028 557831.85904066 557831.85904067
rat1 0.3000 14.9400 0.020 1999531.66287928 1999531.66288583
rat5 0.9000 13.4200 0.067 3083707.01043842 3083707.01043842
rosen10 0.4000 0.7800 0.513 -174215.45613870 -174215.45613870
scfxm1-2b-64 1.6300 4.1100 0.397 2877.56386371 2877.56386373
scfxm1-2r-64 0.8200 1.6200 0.506 2877.56386371 2877.56386371
scfxm1-2r-96 1.1600 8.0300 0.144 2891.70611371 2891.70611372
scrs8-2r-512 0.1400 126.9600 0.001 1074.09934157 1074.09934213
scsd8-2b-64 0.2600 0.9900 0.263 15.99866803 15.99866807
scsd8-2c-64 0.2400 1.0100 0.238 14.99923200 14.99923204
scsd8-2r-108 0.1100 0.5600 0.196 23.69999446 23.69999436
scsd8-2r-216 0.2200 1.2600 0.175 23.39998388 23.39998406
sctap1-2b-64 0.3000 2.0700 0.145 484.56000000 484.56000001
slptsk 0.8100 11.1600 0.073 29.89536602 29.89536602
south31 39.1100 3.2900 11.888 1818940197.10106000 1818940197.10107000
stocfor3 0.6800 2.2800 0.298 -39976.78394365 -39976.78394143
testbig 0.2400 1.1800 0.203 -60.42296073 -60.42296063
ulevimin 11.8700 68.9700 0.172 -5191101861.43196900 -5191101860.83442000
wood1p 0.0500 2.0400 0.025 1.44290241 1.44290249
world 2.7900 317.4900 0.009 40364873.11413520 40364873.11446890
bas1lp 3.2000 39.3100 0.081 363.00000000 363.00000000
cre-d 1.0800 2394.9500 0.000 24454969.76454920 24454969.76555750
fome13 0.6600 738.4000 0.001 0.00000000 0.01028485
fome20 3.0800 3468.3500 0.001 23821658640.00000000 23821658640.00010000
ken-18 5.1400 307.2900 0.017 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.2700 11.0100 0.025 215.25000000 215.25000010
nemsemm2 0.4600 5.8600 0.078 581079.57090468 581079.64415548
nsct2 0.8300 749.4100 0.001 -37175082.00000000 -37175081.99630621
osa-14 0.5000 87.0800 0.006 1106462.84473625 1106462.84474349
osa-30 1.0500 321.4500 0.003 2142139.87320976 2142139.87321565
pds-20 3.0800 3497.0400 0.001 23821658640.00000000 23821658640.00010000
rail507 5.9600 23.1700 0.257 172.14556668 172.14556691
rail516 2.5200 19.7300 0.128 182.00000000 182.00000071
rail582 3.4200 31.6400 0.108 209.71223296 209.71223301
rat7a 6.5400 38.3500 0.171 2074371.41572829 2074371.41572829
rlfddd 0.3200 12.3000 0.026 -13.00000000 -12.99999991
rlfdual 5.3400 56.7000 0.094 -1.00000000 -0.99999994
rlfprim 0.7400 81.7800 0.009 1.00000000 1.00000069
route 0.3200 9.6200 0.033 5941.65027667 5941.65027701
scfxm1-2r-256 6.6600 11.1500 0.597 2891.70611371 2891.70611386
scsd8-2r-432 0.4700 2.9500 0.159 25.79996956 25.79997250
sctap1-2r-480 0.8800 4.8200 0.183 248.50000000 248.50000001
t0331-4l 13.8400 23.0100 0.601 29730.03335194 29730.03335310
us04 0.3100 17.6800 0.018 17731.66666667 17731.66667227
dbic1 66.5000 1592.5100 0.042 -9768973.00000000 -9768973.00014886
dbir2 1.2800 229.4000 0.006 -6116916.50000000 -6116916.49999326
nemsemm1 1.0400 44.4600 0.023 512959.60078798 512959.68358962
nw14 1.0100 351.4600 0.003 61844.00000000 61844.00003897
osa-60 2.4000 2070.4700 0.001 4044072.50315742 4044072.50389521

Back to top





CPLEX: optimal -- IPOPT-MEHROTRA: feasible    Back to top

Modelname Time (CPLEX) Time (IPOPT-MEHROTRA) Ratio (CPLEX/IPOPT-MEHROTRA) Obj (CPLEX) Obj (IPOPT-MEHROTRA)
lpl3 0.9800 3706.6500 0.000 27318.00000000 34530.67856900
cre-b 1.8000 3644.3600 0.000 23129639.88683240 23129639.88704360
rail2586 929.8800 3607.5800 0.258 935.92182057 6557.33662890

Back to top





CPLEX: optimal -- IPOPT-MEHROTRA: fail    Back to top

Modelname Time (CPLEX) Time (IPOPT-MEHROTRA) Ratio (CPLEX/IPOPT-MEHROTRA) Obj (CPLEX) Status (IPOPT-MEHROTRA)
pds-06 0.2700 3600.2400 --- 27761037600.00000000 mstat( 6) sstat( 3)
pds-10 0.6100 3600.0600 --- 26727094976.00000000 mstat( 6) sstat( 3)
fome21 7.9700 3609.3300 --- 47346318912.00000000 mstat( 6) sstat( 3)
nsct1 0.4400 3606.6400 --- -38922436.00000000 mstat( 6) sstat( 3)
pds-30 7.4100 3630.3700 --- 21385445736.00000000 mstat( 6) sstat( 3)
pds-40 11.7000 4024.9000 --- 18855198824.00000000 mstat( 6) sstat( 3)
pds-50 18.2200 NA --- 16603525724.00000000 mstat(13) sstat(10)
pds-60 25.6600 NA --- 14265904407.00000000 mstat(13) sstat(13)
watson_1 14.3400 NA --- -1609.28079534 mstat(13) sstat(10)
dbir1 0.8100 3614.7600 --- -8106707.00000000 mstat( 6) sstat( 3)
pds-100 56.0300 35438.4600 --- 10928229968.00000000 mstat( 6) sstat( 3)
pds-70 34.4800 NA --- 12241162812.00000000 mstat(13) sstat(10)
pds-80 44.8600 NA --- 11469077462.00000000 mstat(13) sstat(13)
pds-90 54.9600 NA --- 11087561635.00000000 mstat(13) sstat(13)
rail4284 2681.7200 NA --- 1054.05449127 mstat(13) sstat(10)
self 3.8700 NA --- 0.00000000 mstat(13) sstat(10)

Back to top





CPLEX: infeasible -- IPOPT-MEHROTRA: fail    Back to top

Modelname Time (CPLEX) Time (IPOPT-MEHROTRA) Ratio (CPLEX/IPOPT-MEHROTRA) Status (CPLEX) Status (IPOPT-MEHROTRA)
bgindy 0.1200 3603.5700 --- mstat( 4) sstat( 1) mstat( 6) sstat( 3)
gosh 1.4300 3600.2300 --- mstat( 4) sstat( 1) mstat( 6) sstat( 3)
lpl1 38.2100 3606.3000 --- mstat( 4) sstat( 1) mstat( 6) sstat( 3)
sgpf5y6 22.9000 NA --- mstat( 4) sstat( 1) mstat(13) sstat(10)

Back to top





CPLEX: fail -- IPOPT-MEHROTRA: fail    Back to top

Modelname Time (CPLEX) Time (IPOPT-MEHROTRA) Ratio (CPLEX/IPOPT-MEHROTRA) Status (CPLEX) Status (IPOPT-MEHROTRA)
nug20 3616.8200 NA --- mstat( 6) sstat( 3) mstat(13) sstat(10)
nug30 3674.2200 NA --- mstat( 6) sstat( 3) mstat(13) sstat(10)

Back to top





CPLEX: optimal:     Back to top

Modelname Time (CPLEX) Obj (CPLEX)
aa01 1.5400 55535.43638822
aa03 1.0000 49616.36363636
air02 0.0600 7640.00000000
air06 1.0200 49616.36363636
baxter 0.8500 56007255.67225311
car4 0.4100 35.46037017
cari 0.0600 581.89305779
co5 1.3700 714469.55375105
co9 6.6700 946920.43028456
cq5 1.2000 400133.80747262
cq9 4.3800 505541.70980727
crew1 0.2000 20.55555556
ex3sta1 21.2200 -63.07540325
fit2d 0.4200 -68464.29329383
fit2p 2.2000 68464.29329383
fome11 0.1500 0.00000000
fome12 0.3200 0.00000000
gen1 0.1300 0.00000000
gen2 8.9200 3.29279078
gen4 0.8100 0.00000000
jendrec1 0.9500 7028.46051135
ken-11 0.2700 -6972382262.51996900
ken-13 0.7800 -1.0257394789482E+10
l30 11.9900 0.95266133
lp22 17.4800 458.94459411
lpl3 0.9800 27318.00000000
maros-r7 1.3900 1497185.16647964
mod2 2.7600 27737371.36444530
model10 7.0000 -154599.62130064
model11 0.4600 0.00000000
model5 1.8600 -858440.72907343
model7 2.8100 49380.08549287
model9 0.7200 -141123.09361215
nemspmm1 2.4400 -327415.83567077
nemspmm2 2.3200 -291794.83608908
nemswrld 23.3900 260.30896600
nsir1 0.0900 -28909033.00000000
nsir2 0.2500 -27175593.50000000
nug15 1349.7700 1040.99404096
osa-07 0.1800 535722.51729935
p010 0.5200 1115047.91511082
p05 0.2400 556000.27662588
pcb3000 0.4800 137416.41961282
pds-06 0.2700 27761037600.00000000
pds-10 0.6100 26727094976.00000000
pilot87 8.0700 301.71035949
qap15 1318.5300 1040.99404096
r05 0.2100 557831.85904066
rat1 0.3000 1999531.66287928
rat5 0.9000 3083707.01043842
rosen10 0.4000 -174215.45613870
scfxm1-2b-64 1.6300 2877.56386371
scfxm1-2r-64 0.8200 2877.56386371
scfxm1-2r-96 1.1600 2891.70611371
scrs8-2r-512 0.1400 1074.09934157
scsd8-2b-64 0.2600 15.99866803
scsd8-2c-64 0.2400 14.99923200
scsd8-2r-108 0.1100 23.69999446
scsd8-2r-216 0.2200 23.39998388
sctap1-2b-64 0.3000 484.56000000
slptsk 0.8100 29.89536602
south31 39.1100 1818940197.10106000
stocfor3 0.6800 -39976.78394365
testbig 0.2400 -60.42296073
ulevimin 11.8700 -5191101861.43196900
wood1p 0.0500 1.44290241
world 2.7900 40364873.11413520
bas1lp 3.2000 363.00000000
cre-b 1.8000 23129639.88683240
cre-d 1.0800 24454969.76454920
fome13 0.6600 0.00000000
fome20 3.0800 23821658640.00000000
fome21 7.9700 47346318912.00000000
ken-18 5.1400 -5.2217025287397E+10
kl02 0.2700 215.25000000
nemsemm2 0.4600 581079.57090468
nsct1 0.4400 -38922436.00000000
nsct2 0.8300 -37175082.00000000
osa-14 0.5000 1106462.84473625
osa-30 1.0500 2142139.87320976
pds-20 3.0800 23821658640.00000000
pds-30 7.4100 21385445736.00000000
pds-40 11.7000 18855198824.00000000
pds-50 18.2200 16603525724.00000000
pds-60 25.6600 14265904407.00000000
rail507 5.9600 172.14556668
rail516 2.5200 182.00000000
rail582 3.4200 209.71223296
rat7a 6.5400 2074371.41572829
rlfddd 0.3200 -13.00000000
rlfdual 5.3400 -1.00000000
rlfprim 0.7400 1.00000000
route 0.3200 5941.65027667
scfxm1-2r-256 6.6600 2891.70611371
scsd8-2r-432 0.4700 25.79996956
sctap1-2r-480 0.8800 248.50000000
t0331-4l 13.8400 29730.03335194
us04 0.3100 17731.66666667
watson_1 14.3400 -1609.28079534
dbic1 66.5000 -9768973.00000000
dbir1 0.8100 -8106707.00000000
dbir2 1.2800 -6116916.50000000
nemsemm1 1.0400 512959.60078798
nw14 1.0100 61844.00000000
osa-60 2.4000 4044072.50315742
pds-100 56.0300 10928229968.00000000
pds-70 34.4800 12241162812.00000000
pds-80 44.8600 11469077462.00000000
pds-90 54.9600 11087561635.00000000
rail2586 929.8800 935.92182057
rail4284 2681.7200 1054.05449127
self 3.8700 0.00000000

Back to top





CPLEX: infeasible:     Back to top

Modelname Time (CPLEX) Status (CPLEX)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)
lpl1 -- mstat( 4) sstat( 1)
sgpf5y6 -- mstat( 4) sstat( 1)

Back to top





CPLEX: fail:     Back to top

Modelname Time (CPLEX) Status (CPLEX)
nug20 -- mstat( 6) sstat( 3)
nug30 -- mstat( 6) sstat( 3)

Back to top





IPOPT-MEHROTRA: optimal:     Back to top

Modelname Time (IPOPT-MEHROTRA) Obj (IPOPT-MEHROTRA)
aa01 4.6500 55535.43638838
aa03 3.2600 49616.36363651
air02 1.5900 7640.00000112
air06 3.2600 49616.36363651
baxter 40.1900 56007255.68220491
car4 1.2300 35.46038611
cari 6.2300 581.89305779
co5 5.3200 714469.58102212
co9 23.0600 946920.49646302
cq5 4.1800 400133.80948837
cq9 19.8700 505541.70995496
crew1 0.6400 20.55555577
ex3sta1 40.6800 -63.07540325
fit2d 4.9100 -68464.29322924
fit2p 0.9900 68464.29329384
fome11 171.3600 0.00257121
fome12 347.7300 0.00514243
gen1 4.6100 0.00000165
gen2 7.0000 3.29279078
gen4 12.9200 0.00000934
jendrec1 3.2600 7028.46051883
ken-11 3.2900 -6972382262.51996900
ken-13 6.9600 -1.0257394789482E+10
l30 1.3300 0.94206073
lp22 102.8600 458.94465074
maros-r7 10.2600 1497185.16647965
mod2 1184.6600 27737371.36747100
model10 209.0000 -154599.62123990
model11 2.0200 0.00016867
model5 7.4900 -858440.71278465
model7 32.9100 49380.08553648
model9 61.8900 -141123.09326554
nemspmm1 2.0400 -327415.83567076
nemspmm2 3.3600 -291794.82815276
nemswrld 36.7600 260.30906290
nsir1 24.2000 -28909033.00000000
nsir2 7.9200 -27175593.49999990
nug15 2944.4900 1040.99405336
osa-07 18.6300 535722.51730081
p010 3.6500 1115047.91511083
p05 1.5500 556000.27662600
pcb3000 1.7100 137416.43123403
pilot87 13.8700 301.71579925
qap15 2537.0500 1040.99405335
r05 7.6200 557831.85904067
rat1 14.9400 1999531.66288583
rat5 13.4200 3083707.01043842
rosen10 0.7800 -174215.45613870
scfxm1-2b-64 4.1100 2877.56386373
scfxm1-2r-64 1.6200 2877.56386371
scfxm1-2r-96 8.0300 2891.70611372
scrs8-2r-512 126.9600 1074.09934213
scsd8-2b-64 0.9900 15.99866807
scsd8-2c-64 1.0100 14.99923204
scsd8-2r-108 0.5600 23.69999436
scsd8-2r-216 1.2600 23.39998406
sctap1-2b-64 2.0700 484.56000001
slptsk 11.1600 29.89536602
south31 3.2900 1818940197.10107000
stocfor3 2.2800 -39976.78394143
testbig 1.1800 -60.42296063
ulevimin 68.9700 -5191101860.83442000
wood1p 2.0400 1.44290249
world 317.4900 40364873.11446890
bas1lp 39.3100 363.00000000
cre-d 2394.9500 24454969.76555750
fome13 738.4000 0.01028485
fome20 3468.3500 23821658640.00010000
ken-18 307.2900 -5.2217025287397E+10
kl02 11.0100 215.25000010
nemsemm2 5.8600 581079.64415548
nsct2 749.4100 -37175081.99630621
osa-14 87.0800 1106462.84474349
osa-30 321.4500 2142139.87321565
pds-20 3497.0400 23821658640.00010000
rail507 23.1700 172.14556691
rail516 19.7300 182.00000071
rail582 31.6400 209.71223301
rat7a 38.3500 2074371.41572829
rlfddd 12.3000 -12.99999991
rlfdual 56.7000 -0.99999994
rlfprim 81.7800 1.00000069
route 9.6200 5941.65027701
scfxm1-2r-256 11.1500 2891.70611386
scsd8-2r-432 2.9500 25.79997250
sctap1-2r-480 4.8200 248.50000001
t0331-4l 23.0100 29730.03335310
us04 17.6800 17731.66667227
dbic1 1592.5100 -9768973.00014886
dbir2 229.4000 -6116916.49999326
nemsemm1 44.4600 512959.68358962
nw14 351.4600 61844.00003897
osa-60 2070.4700 4044072.50389521

Back to top





IPOPT-MEHROTRA: feasible:     Back to top

Modelname Time (IPOPT-MEHROTRA) Obj (IPOPT-MEHROTRA)
lpl3 3706.6500 34530.67856900
cre-b 3644.3600 23129639.88704360
rail2586 3607.5800 6557.33662890

Back to top





IPOPT-MEHROTRA: fail:     Back to top

Modelname Time (IPOPT-MEHROTRA) Status (IPOPT-MEHROTRA)
bgindy -- mstat( 6) sstat( 3)
gosh -- mstat( 6) sstat( 3)
pds-06 -- mstat( 6) sstat( 3)
pds-10 -- mstat( 6) sstat( 3)
fome21 -- mstat( 6) sstat( 3)
lpl1 -- mstat( 6) sstat( 3)
nsct1 -- mstat( 6) sstat( 3)
nug20 -- mstat(13) sstat(10)
pds-30 -- mstat( 6) sstat( 3)
pds-40 -- mstat( 6) sstat( 3)
pds-50 -- mstat(13) sstat(10)
pds-60 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(10)
watson_1 -- mstat(13) sstat(10)
dbir1 -- mstat( 6) sstat( 3)
nug30 -- mstat(13) sstat(10)
pds-100 -- mstat( 6) sstat( 3)
pds-70 -- mstat(13) sstat(10)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(10)
self -- mstat(13) sstat(10)

Back to top