Solver Square Comparison: Considers all models.

Date / Time: 01/07/08 20:11:20


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX11-Barrier is represented on the left (rows) and solver IPOPT on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :2-CPLEX-1.trc
Tracefile 2 :6-IPOPT-0.trc
Solvers used : CPLEX11-Barrier
IPOPT
Modeltype(s)   LP



IPOPT:
optimal
IPOPT:
locally optimal
IPOPT:
feasible
IPOPT:
infeasible
IPOPT:
unbounded
IPOPT:
fail
IPOPT:
no data
total CPLEX11-Barrier
CPLEX11-Barrier:
optimal
86 - 8 - - 19 - 113
CPLEX11-Barrier:
locally optimal
- - - - - - - -
CPLEX11-Barrier:
feasible
- - - - - - - -
CPLEX11-Barrier:
infeasible
- - - 2 - - - 2
CPLEX11-Barrier:
unbounded
- - - - - - - -
CPLEX11-Barrier:
fail
- - - - - 3 - 3
CPLEX11-Barrier:
no data
- - - - - - - -
total IPOPT 86 - 8 2 - 22 - 118




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CPLEX11-Barrier: optimal -- IPOPT: optimal    Back to top

Modelname Time (CPLEX11-Barrier) Time (IPOPT) Ratio (CPLEX11-Barrier/IPOPT) Obj (CPLEX11-Barrier) Obj (IPOPT)
aa01 0.7100 12.3600 0.057 55535.43638822 55535.43638976
aa03 0.5700 9.7600 0.058 49616.36363636 49616.36363764
air02 0.1100 2.6400 0.042 7640.00000000 7640.00000649
air06 0.5600 9.7100 0.058 49616.36363636 49616.36363764
car4 0.4100 2.7900 0.147 35.46037017 35.46037049
cari 0.0500 6.8800 0.007 581.89305779 581.89305792
co5 0.7400 13.4400 0.055 714469.55375789 714469.73326788
co9 2.1600 33.0000 0.065 946920.43032251 946920.50625303
cq5 0.6700 12.8100 0.052 400133.80747262 400134.39901265
cq9 2.0900 50.5400 0.041 505541.70980727 505541.71044040
crew1 0.1200 1.3000 0.092 20.55555556 20.55556533
ex3sta1 1.8600 34.5600 0.054 -63.07540325 -63.07540325
fit2d 0.3400 5.7300 0.059 -68464.29329383 -68464.29328530
fit2p 0.2900 1.8900 0.153 68464.29329383 68464.29330257
fome11 0.1400 141.2700 0.001 0.00000000 0.02915743
fome12 0.3000 285.3700 0.001 0.00000000 0.05831487
gen1 0.6000 3.9500 0.152 0.00000038 0.00000797
gen2 3.0300 10.4500 0.290 3.29279078 3.29279078
gen4 29.9700 13.8700 2.161 0.00000036 0.00001303
jendrec1 0.9200 6.1500 0.150 7028.46051135 7028.46051765
ken-11 0.3800 6.8200 0.056 -6972382262.51996900 -6972382262.51996000
ken-13 1.0500 25.5600 0.041 -1.0257394789482E+10 -1.0257394789482E+10
l30 18.5400 3.1200 5.942 0.95266137 0.95213670
lp22 4.0600 189.6500 0.021 458.94459411 459.00933769
maros-r7 1.1000 44.3000 0.025 1497185.16647964 1497185.16647971
mod2 6.3300 183.7800 0.034 27737371.36445580 27737371.36472430
model11 0.4800 16.2900 0.029 0.00000000 0.00102069
model5 0.7300 325.9300 0.002 -858440.72907149 -858440.72885225
model7 0.4600 6.7100 0.069 49380.08549628 49380.08570984
model9 0.3300 14.9600 0.022 -141123.09360707 -141123.01524906
nemspmm1 0.5500 5.6700 0.097 -327415.83567076 -327415.83567071
nemspmm2 0.6700 9.4600 0.071 -291794.83608908 -291794.77219164
nemswrld 3.1600 68.0800 0.046 260.30896600 260.30950771
nsir1 1.2600 9.1600 0.138 -28909033.00000000 -28909033.00000000
nsir2 1.4100 11.6700 0.121 -27175593.50000000 -27175593.49999990
osa-07 0.2800 52.1000 0.005 535722.51729935 535722.51966222
p010 0.9900 208.0300 0.005 1115047.91511082 1115047.91511092
p05 0.3500 102.9900 0.003 556000.27662588 556000.27662593
pcb3000 0.5200 3.6400 0.143 137416.41961282 137416.45014264
pds-06 1.1000 115.5100 0.010 27761037600.00000000 27761037600.00020000
pds-10 3.8500 1188.9500 0.003 26727094976.00000000 26727094976.00040000
pilot87 2.4900 48.7900 0.051 301.71034746 301.71036899
r05 0.3800 21.4800 0.018 557831.85904066 557831.85904074
rat1 0.2700 941.4600 0.000 1999531.66287928 1999531.66287934
rat5 0.6100 268.7100 0.002 3083707.01043842 3083707.01043848
rosen10 0.1500 1.5700 0.096 -174215.45613870 -174215.45613866
scfxm1-2b-64 2.2300 11.9400 0.187 2877.56386371 2877.56386502
scfxm1-2r-64 0.7000 4.8900 0.143 2877.56386371 2877.56397453
scfxm1-2r-96 1.1100 8.2300 0.135 2891.70611371 2891.70613527
scrs8-2r-512 0.1400 620.8200 0.000 1074.09934157 1074.09934613
scsd8-2b-64 0.4900 1.8100 0.271 15.99866803 15.99866838
scsd8-2c-64 0.4600 1.9600 0.235 14.99923200 14.99923234
scsd8-2r-108 0.8800 1.1700 0.752 23.70000000 23.69999901
scsd8-2r-216 1.5200 2.7700 0.549 23.39998576 23.40001016
sctap1-2b-64 0.4900 3.6300 0.135 484.56000000 484.56000007
slptsk 1.4900 19.7100 0.076 29.89536602 29.89536603
south31 0.8000 10.1300 0.079 1818940197.10106000 1818940197.10111000
stocfor3 0.6300 10.7400 0.059 -39976.78394365 -39976.78394355
testbig 0.2800 2.8100 0.100 -60.42296073 -59.71377151
wood1p 0.1000 2.7000 0.037 1.44290241 1.44290243
world 6.2400 207.3300 0.030 40364873.11417350 40364873.43040490
bas1lp 9.0900 337.6200 0.027 363.00000000 363.00000000
fome13 0.6700 610.7900 0.001 0.00000000 0.11662974
ken-18 6.9000 219.6100 0.031 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.3600 17.3100 0.021 215.25000000 215.25001839
nsct1 67.2600 1006.0100 0.067 -38922436.00000000 -38922435.93294140
nsct2 47.4700 2581.9800 0.018 -37175082.00000000 -37175081.99999980
osa-14 0.6800 107.6000 0.006 1106462.84473625 1106462.97722514
osa-30 1.6600 340.9000 0.005 2142139.87320976 2142140.84747442
rail507 1.3200 45.3000 0.029 172.14556668 172.14556730
rail516 0.9600 49.8800 0.019 182.00000000 182.00000041
rail582 1.3800 52.9000 0.026 209.71223296 209.71223433
rat7a 3.6000 502.1800 0.007 2074371.41572829 2074371.41572835
rlfddd 1.8900 9.8200 0.192 -13.00000000 -12.99999327
rlfdual 7.5700 52.9900 0.143 -1.00000000 -0.99999942
rlfprim 2.6400 70.9300 0.037 1.00000000 1.00001341
route 4.3900 15.2600 0.288 5941.65027667 5941.65028002
scfxm1-2r-256 4.1000 21.0100 0.195 2891.70611371 2892.02010444
scsd8-2r-432 1.1800 5.4300 0.217 25.79999802 25.80002199
sctap1-2r-480 1.0800 6.7800 0.159 248.50000000 248.50005301
t0331-4l 1.8000 49.2900 0.037 29730.03335194 29730.03339568
us04 0.3600 19.6100 0.018 17731.66666667 17731.66666807
dbir2 20.4100 287.1000 0.071 -6116916.50000000 -6116916.49999969
nemsemm1 4.1900 93.5200 0.045 512959.60078798 512961.33657851
nw14 3.3400 325.8000 0.010 61844.00000000 61844.00012271
osa-60 3.9200 2188.0000 0.002 4044072.50315742 4044072.78288264

Back to top





CPLEX11-Barrier: optimal -- IPOPT: feasible    Back to top

Modelname Time (CPLEX11-Barrier) Time (IPOPT) Ratio (CPLEX11-Barrier/IPOPT) Obj (CPLEX11-Barrier) Obj (IPOPT)
lpl3 1.2000 4012.5000 0.000 27318.00000000 85862.06506435
model10 1.4800 3636.8400 0.000 -154599.62122930 -154596.55370901
nug15 51.6300 3704.2200 0.014 1040.99404096 1040.99847639
qap15 49.1100 3877.4700 0.013 1040.99404096 1040.99431703
fome20 16.6900 3754.2400 0.004 23821658640.00000000 23824323635.80390000
nemsemm2 0.7400 5386.9500 0.000 581079.57090469 590853.36666951
pds-20 16.5600 3763.9900 0.004 23821658640.00000000 23824323635.80390000
rail2586 62.4500 3602.5400 0.017 935.92182057 1174.25360797

Back to top





CPLEX11-Barrier: optimal -- IPOPT: fail    Back to top

Modelname Time (CPLEX11-Barrier) Time (IPOPT) Ratio (CPLEX11-Barrier/IPOPT) Obj (CPLEX11-Barrier) Status (IPOPT)
baxter 3.2000 NA --- 56007255.67225311 mstat(13) sstat(10)
ulevimin 3.8800 3600.4600 --- -5191101861.43196900 mstat( 6) sstat( 3)
cre-b 2.3300 4393.6500 --- 23129639.88683240 mstat( 6) sstat( 3)
cre-d 1.7400 NA --- 24454969.76454920 mstat(13) sstat(10)
fome21 41.4100 3677.8200 --- 47346318912.00000000 mstat( 6) sstat( 3)
nug20 730.1200 NA --- 2181.60332164 mstat(13) sstat(10)
pds-30 47.3700 3690.6200 --- 21385445736.00000000 mstat( 6) sstat( 3)
pds-40 92.8500 3651.3200 --- 18855198824.00000000 mstat( 6) sstat( 3)
pds-50 133.8200 NA --- 16603525724.00000000 mstat(13) sstat(10)
pds-60 193.9800 NA --- 14265904407.00000000 mstat(13) sstat(13)
watson_1 35.1200 NA --- -1609.27855376 mstat(13) sstat(10)
dbic1 38.8200 NA --- -9768973.00000000 mstat(13) sstat(13)
dbir1 29.0600 3603.5200 --- -8106707.00000000 mstat( 6) sstat( 3)
pds-100 510.1200 29813.5800 --- 10928229968.00000000 mstat( 6) sstat( 3)
pds-70 268.5000 NA --- 12241162812.00000000 mstat(13) sstat(10)
pds-80 329.2600 NA --- 11469077462.00000000 mstat(13) sstat(13)
pds-90 385.6200 NA --- 11087561635.00000000 mstat(13) sstat(13)
rail4284 147.2300 NA --- 1054.05449127 mstat(13) sstat(10)
self 3.3600 NA --- 0.00000000 mstat(13) sstat(10)

Back to top





CPLEX11-Barrier: infeasible -- IPOPT: infeasible    Back to top

Modelname Time (CPLEX11-Barrier) Time (IPOPT) Ratio (CPLEX11-Barrier/IPOPT) Status (CPLEX11-Barrier) Status (IPOPT)
bgindy 0.2500 6.3700 --- mstat( 4) sstat( 1) mstat( 4) sstat( 1)
gosh 1.8100 896.3200 --- mstat( 4) sstat( 1) mstat( 4) sstat( 1)

Back to top





CPLEX11-Barrier: fail -- IPOPT: fail    Back to top

Modelname Time (CPLEX11-Barrier) Time (IPOPT) Ratio (CPLEX11-Barrier/IPOPT) Status (CPLEX11-Barrier) Status (IPOPT)
lpl1 NA NA --- mstat(13) sstat(13) mstat(13) sstat(10)
sgpf5y6 NA NA --- mstat(13) sstat(13) mstat(13) sstat(10)
nug30 163.0500 NA --- mstat(14) sstat( 4) mstat(13) sstat(13)

Back to top





CPLEX11-Barrier: optimal:     Back to top

Modelname Time (CPLEX11-Barrier) Obj (CPLEX11-Barrier)
aa01 0.7100 55535.43638822
aa03 0.5700 49616.36363636
air02 0.1100 7640.00000000
air06 0.5600 49616.36363636
baxter 3.2000 56007255.67225311
car4 0.4100 35.46037017
cari 0.0500 581.89305779
co5 0.7400 714469.55375789
co9 2.1600 946920.43032251
cq5 0.6700 400133.80747262
cq9 2.0900 505541.70980727
crew1 0.1200 20.55555556
ex3sta1 1.8600 -63.07540325
fit2d 0.3400 -68464.29329383
fit2p 0.2900 68464.29329383
fome11 0.1400 0.00000000
fome12 0.3000 0.00000000
gen1 0.6000 0.00000038
gen2 3.0300 3.29279078
gen4 29.9700 0.00000036
jendrec1 0.9200 7028.46051135
ken-11 0.3800 -6972382262.51996900
ken-13 1.0500 -1.0257394789482E+10
l30 18.5400 0.95266137
lp22 4.0600 458.94459411
lpl3 1.2000 27318.00000000
maros-r7 1.1000 1497185.16647964
mod2 6.3300 27737371.36445580
model10 1.4800 -154599.62122930
model11 0.4800 0.00000000
model5 0.7300 -858440.72907149
model7 0.4600 49380.08549628
model9 0.3300 -141123.09360707
nemspmm1 0.5500 -327415.83567076
nemspmm2 0.6700 -291794.83608908
nemswrld 3.1600 260.30896600
nsir1 1.2600 -28909033.00000000
nsir2 1.4100 -27175593.50000000
nug15 51.6300 1040.99404096
osa-07 0.2800 535722.51729935
p010 0.9900 1115047.91511082
p05 0.3500 556000.27662588
pcb3000 0.5200 137416.41961282
pds-06 1.1000 27761037600.00000000
pds-10 3.8500 26727094976.00000000
pilot87 2.4900 301.71034746
qap15 49.1100 1040.99404096
r05 0.3800 557831.85904066
rat1 0.2700 1999531.66287928
rat5 0.6100 3083707.01043842
rosen10 0.1500 -174215.45613870
scfxm1-2b-64 2.2300 2877.56386371
scfxm1-2r-64 0.7000 2877.56386371
scfxm1-2r-96 1.1100 2891.70611371
scrs8-2r-512 0.1400 1074.09934157
scsd8-2b-64 0.4900 15.99866803
scsd8-2c-64 0.4600 14.99923200
scsd8-2r-108 0.8800 23.70000000
scsd8-2r-216 1.5200 23.39998576
sctap1-2b-64 0.4900 484.56000000
slptsk 1.4900 29.89536602
south31 0.8000 1818940197.10106000
stocfor3 0.6300 -39976.78394365
testbig 0.2800 -60.42296073
ulevimin 3.8800 -5191101861.43196900
wood1p 0.1000 1.44290241
world 6.2400 40364873.11417350
bas1lp 9.0900 363.00000000
cre-b 2.3300 23129639.88683240
cre-d 1.7400 24454969.76454920
fome13 0.6700 0.00000000
fome20 16.6900 23821658640.00000000
fome21 41.4100 47346318912.00000000
ken-18 6.9000 -5.2217025287397E+10
kl02 0.3600 215.25000000
nemsemm2 0.7400 581079.57090469
nsct1 67.2600 -38922436.00000000
nsct2 47.4700 -37175082.00000000
nug20 730.1200 2181.60332164
osa-14 0.6800 1106462.84473625
osa-30 1.6600 2142139.87320976
pds-20 16.5600 23821658640.00000000
pds-30 47.3700 21385445736.00000000
pds-40 92.8500 18855198824.00000000
pds-50 133.8200 16603525724.00000000
pds-60 193.9800 14265904407.00000000
rail507 1.3200 172.14556668
rail516 0.9600 182.00000000
rail582 1.3800 209.71223296
rat7a 3.6000 2074371.41572829
rlfddd 1.8900 -13.00000000
rlfdual 7.5700 -1.00000000
rlfprim 2.6400 1.00000000
route 4.3900 5941.65027667
scfxm1-2r-256 4.1000 2891.70611371
scsd8-2r-432 1.1800 25.79999802
sctap1-2r-480 1.0800 248.50000000
t0331-4l 1.8000 29730.03335194
us04 0.3600 17731.66666667
watson_1 35.1200 -1609.27855376
dbic1 38.8200 -9768973.00000000
dbir1 29.0600 -8106707.00000000
dbir2 20.4100 -6116916.50000000
nemsemm1 4.1900 512959.60078798
nw14 3.3400 61844.00000000
osa-60 3.9200 4044072.50315742
pds-100 510.1200 10928229968.00000000
pds-70 268.5000 12241162812.00000000
pds-80 329.2600 11469077462.00000000
pds-90 385.6200 11087561635.00000000
rail2586 62.4500 935.92182057
rail4284 147.2300 1054.05449127
self 3.3600 0.00000000

Back to top





CPLEX11-Barrier: infeasible:     Back to top

Modelname Time (CPLEX11-Barrier) Status (CPLEX11-Barrier)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)

Back to top





CPLEX11-Barrier: fail:     Back to top

Modelname Time (CPLEX11-Barrier) Status (CPLEX11-Barrier)
lpl1 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(13)
nug30 -- mstat(14) sstat( 4)

Back to top





IPOPT: optimal:     Back to top

Modelname Time (IPOPT) Obj (IPOPT)
aa01 12.3600 55535.43638976
aa03 9.7600 49616.36363764
air02 2.6400 7640.00000649
air06 9.7100 49616.36363764
car4 2.7900 35.46037049
cari 6.8800 581.89305792
co5 13.4400 714469.73326788
co9 33.0000 946920.50625303
cq5 12.8100 400134.39901265
cq9 50.5400 505541.71044040
crew1 1.3000 20.55556533
ex3sta1 34.5600 -63.07540325
fit2d 5.7300 -68464.29328530
fit2p 1.8900 68464.29330257
fome11 141.2700 0.02915743
fome12 285.3700 0.05831487
gen1 3.9500 0.00000797
gen2 10.4500 3.29279078
gen4 13.8700 0.00001303
jendrec1 6.1500 7028.46051765
ken-11 6.8200 -6972382262.51996000
ken-13 25.5600 -1.0257394789482E+10
l30 3.1200 0.95213670
lp22 189.6500 459.00933769
maros-r7 44.3000 1497185.16647971
mod2 183.7800 27737371.36472430
model11 16.2900 0.00102069
model5 325.9300 -858440.72885225
model7 6.7100 49380.08570984
model9 14.9600 -141123.01524906
nemspmm1 5.6700 -327415.83567071
nemspmm2 9.4600 -291794.77219164
nemswrld 68.0800 260.30950771
nsir1 9.1600 -28909033.00000000
nsir2 11.6700 -27175593.49999990
osa-07 52.1000 535722.51966222
p010 208.0300 1115047.91511092
p05 102.9900 556000.27662593
pcb3000 3.6400 137416.45014264
pds-06 115.5100 27761037600.00020000
pds-10 1188.9500 26727094976.00040000
pilot87 48.7900 301.71036899
r05 21.4800 557831.85904074
rat1 941.4600 1999531.66287934
rat5 268.7100 3083707.01043848
rosen10 1.5700 -174215.45613866
scfxm1-2b-64 11.9400 2877.56386502
scfxm1-2r-64 4.8900 2877.56397453
scfxm1-2r-96 8.2300 2891.70613527
scrs8-2r-512 620.8200 1074.09934613
scsd8-2b-64 1.8100 15.99866838
scsd8-2c-64 1.9600 14.99923234
scsd8-2r-108 1.1700 23.69999901
scsd8-2r-216 2.7700 23.40001016
sctap1-2b-64 3.6300 484.56000007
slptsk 19.7100 29.89536603
south31 10.1300 1818940197.10111000
stocfor3 10.7400 -39976.78394355
testbig 2.8100 -59.71377151
wood1p 2.7000 1.44290243
world 207.3300 40364873.43040490
bas1lp 337.6200 363.00000000
fome13 610.7900 0.11662974
ken-18 219.6100 -5.2217025287397E+10
kl02 17.3100 215.25001839
nsct1 1006.0100 -38922435.93294140
nsct2 2581.9800 -37175081.99999980
osa-14 107.6000 1106462.97722514
osa-30 340.9000 2142140.84747442
rail507 45.3000 172.14556730
rail516 49.8800 182.00000041
rail582 52.9000 209.71223433
rat7a 502.1800 2074371.41572835
rlfddd 9.8200 -12.99999327
rlfdual 52.9900 -0.99999942
rlfprim 70.9300 1.00001341
route 15.2600 5941.65028002
scfxm1-2r-256 21.0100 2892.02010444
scsd8-2r-432 5.4300 25.80002199
sctap1-2r-480 6.7800 248.50005301
t0331-4l 49.2900 29730.03339568
us04 19.6100 17731.66666807
dbir2 287.1000 -6116916.49999969
nemsemm1 93.5200 512961.33657851
nw14 325.8000 61844.00012271
osa-60 2188.0000 4044072.78288264

Back to top





IPOPT: feasible:     Back to top

Modelname Time (IPOPT) Obj (IPOPT)
lpl3 4012.5000 85862.06506435
model10 3636.8400 -154596.55370901
nug15 3704.2200 1040.99847639
qap15 3877.4700 1040.99431703
fome20 3754.2400 23824323635.80390000
nemsemm2 5386.9500 590853.36666951
pds-20 3763.9900 23824323635.80390000
rail2586 3602.5400 1174.25360797

Back to top





IPOPT: infeasible:     Back to top

Modelname Time (IPOPT) Status (IPOPT)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)

Back to top





IPOPT: fail:     Back to top

Modelname Time (IPOPT) Status (IPOPT)
baxter -- mstat(13) sstat(10)
ulevimin -- mstat( 6) sstat( 3)
cre-b -- mstat( 6) sstat( 3)
cre-d -- mstat(13) sstat(10)
fome21 -- mstat( 6) sstat( 3)
lpl1 -- mstat(13) sstat(10)
nug20 -- mstat(13) sstat(10)
pds-30 -- mstat( 6) sstat( 3)
pds-40 -- mstat( 6) sstat( 3)
pds-50 -- mstat(13) sstat(10)
pds-60 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(10)
watson_1 -- mstat(13) sstat(10)
dbic1 -- mstat(13) sstat(13)
dbir1 -- mstat( 6) sstat( 3)
nug30 -- mstat(13) sstat(13)
pds-100 -- mstat( 6) sstat( 3)
pds-70 -- mstat(13) sstat(10)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(10)
self -- mstat(13) sstat(10)

Back to top