Solver Square Comparison: Considers all models.

Date / Time: 09/02/07 12:02:38


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX-BARRIER is represented on the left (rows) and solver IPOPT on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :2-CPLEX-1.trc
Tracefile 2 :5-IPOPT-0.trc
Solvers used : CPLEX-BARRIER
IPOPT
Modeltype(s)   LP



IPOPT:
optimal
IPOPT:
locally optimal
IPOPT:
feasible
IPOPT:
infeasible
IPOPT:
unbounded
IPOPT:
fail
IPOPT:
no data
total CPLEX-BARRIER
CPLEX-BARRIER:
optimal
86 - 8 - - 19 - 113
CPLEX-BARRIER:
locally optimal
- - - - - - - -
CPLEX-BARRIER:
feasible
- - - - - - - -
CPLEX-BARRIER:
infeasible
- - - 2 - - - 2
CPLEX-BARRIER:
unbounded
- - - - - - - -
CPLEX-BARRIER:
fail
- - - - - 3 - 3
CPLEX-BARRIER:
no data
- - - - - - - -
total IPOPT 86 - 8 2 - 22 - 118




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CPLEX-BARRIER: optimal -- IPOPT: optimal    Back to top

Modelname Time (CPLEX-BARRIER) Time (IPOPT) Ratio (CPLEX-BARRIER/IPOPT) Obj (CPLEX-BARRIER) Obj (IPOPT)
aa01 0.7300 11.8300 0.062 55535.43638822 55535.43640912
aa03 0.5800 9.6900 0.060 49616.36363636 49616.36363649
air02 0.1200 2.6200 0.046 7640.00000000 7640.00000065
air06 0.5700 9.7000 0.059 49616.36363636 49616.36363649
car4 0.4200 2.7900 0.151 35.46037017 35.46037020
cari 0.0400 7.1300 0.006 581.89305779 581.89305792
co5 0.7600 11.7700 0.065 714469.55375789 714469.64279909
co9 2.2200 32.9900 0.067 946920.43032251 946920.50623726
cq5 0.6700 11.9800 0.056 400133.80747262 400133.80773115
cq9 2.1500 56.5900 0.038 505541.70980727 505541.70980948
crew1 0.1200 1.2900 0.093 20.55555556 20.55556529
ex3sta1 1.9700 34.0400 0.058 -63.07540325 -63.07540325
fit2d 0.3400 5.7000 0.060 -68464.29329383 -68464.29329298
fit2p 0.3000 1.8800 0.160 68464.29329383 68464.29330248
fome11 0.1600 134.2800 0.001 0.00000000 0.00292352
fome12 0.3200 274.4000 0.001 0.00000000 0.00584704
gen1 0.7000 3.9600 0.177 0.00000054 0.00000796
gen2 2.9500 10.0500 0.294 3.29279078 3.29279078
gen4 20.4000 13.5000 1.511 0.00000084 0.00001301
jendrec1 0.9000 6.1200 0.147 7028.46051135 7028.46051757
ken-11 0.3800 6.6200 0.057 -6972382262.51996900 -6972382262.51996900
ken-13 1.0700 25.6900 0.042 -1.0257394789482E+10 -1.0257394789482E+10
l30 27.3600 3.0500 8.970 0.95266138 0.95207806
lp22 4.2000 186.6600 0.023 458.94459411 459.00933768
maros-r7 1.1500 44.4100 0.026 1497185.16647964 1497185.16647966
mod2 6.5500 198.4900 0.033 27737371.36445580 27737371.36448260
model11 0.5100 36.3500 0.014 0.00000000 0.00010208
model5 0.7200 297.0900 0.002 -858440.72907149 -858440.72839567
model7 0.4800 6.5400 0.073 49380.08549628 49380.08552185
model9 0.3400 76.5400 0.004 -141123.09360707 -141123.08766642
nemspmm1 0.5700 5.6700 0.101 -327415.83567076 -327415.83567074
nemspmm2 0.7100 9.4100 0.075 -291794.83608908 -291794.77219164
nemswrld 3.1400 67.0900 0.047 260.30896600 260.30950736
nsir1 1.3100 9.0800 0.144 -28909033.00000000 -28909033.00000000
nsir2 1.4600 12.1900 0.120 -27175593.50000000 -27175593.49999840
osa-07 0.2700 51.2200 0.005 535722.51729935 535722.51965037
p010 1.0100 171.5500 0.006 1115047.91511082 1115047.91511083
p05 0.3500 130.2200 0.003 556000.27662588 556000.27662589
pcb3000 0.5400 3.4000 0.159 137416.41961282 137416.53410574
pds-06 1.1600 121.1700 0.010 27761037600.00000000 27761037600.00000000
pds-10 4.1500 996.8400 0.004 26727094976.00000000 26727094976.03690000
pilot87 2.4700 49.5500 0.050 301.71034733 301.71037082
r05 0.3800 19.3100 0.020 557831.85904066 557831.85904191
rat1 0.2700 939.1400 0.000 1999531.66287928 1999531.66287930
rat5 0.6300 268.2000 0.002 3083707.01043842 3083707.01043842
rosen10 0.1800 1.5500 0.116 -174215.45613870 -174215.45613870
scfxm1-2b-64 1.6400 11.9400 0.137 2877.56386371 2877.56386534
scfxm1-2r-64 0.7700 4.8800 0.158 2877.56386371 2877.56397447
scfxm1-2r-96 1.5400 8.1500 0.189 2891.70611371 2891.70613518
scrs8-2r-512 0.1500 742.8900 0.000 1074.09934157 1074.09934203
scsd8-2b-64 0.4300 1.8200 0.236 15.99866803 15.99866807
scsd8-2c-64 0.5200 1.9600 0.265 14.99923200 14.99923203
scsd8-2r-108 0.9200 1.1800 0.780 23.70000000 23.69999891
scsd8-2r-216 1.5400 2.7200 0.566 23.39998576 23.40001016
sctap1-2b-64 0.5000 3.3800 0.148 484.56000000 484.56000206
slptsk 1.5200 19.6100 0.078 29.89536602 29.89536615
south31 0.8200 10.0700 0.081 1818940197.10106000 1818940197.10107000
stocfor3 0.6500 10.6500 0.061 -39976.78394365 -39976.78394364
testbig 0.3000 2.8000 0.107 -60.42296073 -59.71377151
wood1p 0.1000 3.0700 0.033 1.44290241 1.44290241
world 6.3800 207.4500 0.031 40364873.11417350 40364873.43011240
bas1lp 9.5200 443.5200 0.021 363.00000000 363.00000000
fome13 0.6700 599.0300 0.001 0.00000000 0.01169409
ken-18 7.1800 221.3000 0.032 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.3800 17.6400 0.022 215.25000000 215.25001806
nsct1 72.8100 1034.7000 0.070 -38922436.00000000 -38922435.93294140
nsct2 48.6600 2811.0700 0.017 -37175082.00000000 -37175082.00000000
osa-14 0.6500 96.8400 0.007 1106462.84473625 1106462.86972097
osa-30 1.7400 327.9500 0.005 2142139.87320976 2142140.84743002
rail507 1.3600 45.6000 0.030 172.14556668 172.14556674
rail516 0.9800 624.7800 0.002 182.00000000 182.00000004
rail582 1.4000 53.0600 0.026 209.71223296 209.71223435
rat7a 3.6600 499.0100 0.007 2074371.41572829 2074371.41572829
rlfddd 1.9300 9.8400 0.196 -13.00000000 -12.99999327
rlfdual 7.9900 53.1600 0.150 -1.00000000 -0.99999994
rlfprim 2.6800 71.1500 0.038 1.00000000 1.00001330
route 4.5600 15.1600 0.301 5941.65027667 5941.65027702
scfxm1-2r-256 3.8700 21.1500 0.183 2891.70611371 2892.02010444
scsd8-2r-432 1.1900 5.4500 0.218 25.79999802 25.80002199
sctap1-2r-480 1.1500 6.7500 0.170 248.50000000 248.50005291
t0331-4l 1.8400 49.6600 0.037 29730.03335194 29730.03339276
us04 0.3700 20.2100 0.018 17731.66666667 17731.66666680
dbir2 22.0200 289.0100 0.076 -6116916.50000000 -6116916.49999997
nemsemm1 4.2200 93.1200 0.045 512959.60078798 512961.33656058
nw14 3.4300 330.9900 0.010 61844.00000000 61844.00001227
osa-60 3.9700 2118.8600 0.002 4044072.50315742 4044072.77774503

Back to top





CPLEX-BARRIER: optimal -- IPOPT: feasible    Back to top

Modelname Time (CPLEX-BARRIER) Time (IPOPT) Ratio (CPLEX-BARRIER/IPOPT) Obj (CPLEX-BARRIER) Obj (IPOPT)
lpl3 1.2300 3667.9500 0.000 27318.00000000 92049.12139266
model10 1.6200 3749.7900 0.000 -154599.62122930 -154595.73840092
nug15 52.6600 3861.2500 0.014 1040.99404096 1040.99847628
qap15 48.4700 3687.2200 0.013 1040.99404096 1040.99438307
fome20 16.5100 3684.9000 0.004 23821658640.00000000 23824795566.33030000
nemsemm2 0.7800 5387.1300 0.000 581079.57090469 590853.36666951
pds-20 16.5300 3610.3500 0.005 23821658640.00000000 23824795566.33030000
rail2586 64.5500 3608.6000 0.018 935.92182057 1126.43249215

Back to top





CPLEX-BARRIER: optimal -- IPOPT: fail    Back to top

Modelname Time (CPLEX-BARRIER) Time (IPOPT) Ratio (CPLEX-BARRIER/IPOPT) Obj (CPLEX-BARRIER) Status (IPOPT)
baxter 2.9500 NA --- 56007255.67225311 mstat(13) sstat(10)
ulevimin 3.9700 3600.9100 --- -5191101861.43196900 mstat( 6) sstat( 3)
cre-b 2.3800 3799.6800 --- 23129639.88683240 mstat( 6) sstat( 3)
cre-d 1.8000 NA --- 24454969.76454920 mstat(13) sstat(10)
fome21 42.7700 3612.7400 --- 47346318912.00000000 mstat( 6) sstat( 3)
nug20 864.2800 NA --- 2181.60332164 mstat(13) sstat(10)
pds-30 43.6900 3727.3200 --- 21385445736.00000000 mstat( 6) sstat( 3)
pds-40 93.6200 3675.6500 --- 18855198824.00000000 mstat( 6) sstat( 3)
pds-50 135.6900 NA --- 16603525724.00000000 mstat(13) sstat(10)
pds-60 192.1500 NA --- 14265904407.00000000 mstat(13) sstat(13)
watson_1 35.8300 NA --- -1609.27855376 mstat(13) sstat(10)
dbic1 37.1500 NA --- -9768973.00000000 mstat(13) sstat(13)
dbir1 29.7200 NA --- -8106707.00000000 mstat(13) sstat(10)
pds-100 537.2500 29433.2100 --- 10928229968.00000000 mstat( 6) sstat( 3)
pds-70 274.7000 NA --- 12241162812.00000000 mstat(13) sstat(10)
pds-80 337.3500 NA --- 11469077462.00000000 mstat(13) sstat(13)
pds-90 375.3800 NA --- 11087561635.00000000 mstat(13) sstat(13)
rail4284 152.6600 NA --- 1054.05449127 mstat(13) sstat(10)
self 3.4500 NA --- 0.00000000 mstat(13) sstat(10)

Back to top





CPLEX-BARRIER: infeasible -- IPOPT: infeasible    Back to top

Modelname Time (CPLEX-BARRIER) Time (IPOPT) Ratio (CPLEX-BARRIER/IPOPT) Status (CPLEX-BARRIER) Status (IPOPT)
bgindy 0.2700 6.4800 --- mstat( 4) sstat( 1) mstat( 4) sstat( 1)
gosh 0.9000 1221.9600 --- mstat( 4) sstat( 1) mstat( 4) sstat( 1)

Back to top





CPLEX-BARRIER: fail -- IPOPT: fail    Back to top

Modelname Time (CPLEX-BARRIER) Time (IPOPT) Ratio (CPLEX-BARRIER/IPOPT) Status (CPLEX-BARRIER) Status (IPOPT)
lpl1 NA NA --- mstat(13) sstat(13) mstat(13) sstat(10)
sgpf5y6 NA NA --- mstat(13) sstat(13) mstat(13) sstat(10)
nug30 178.3800 NA --- mstat(14) sstat( 4) mstat(13) sstat(13)

Back to top





CPLEX-BARRIER: optimal:     Back to top

Modelname Time (CPLEX-BARRIER) Obj (CPLEX-BARRIER)
aa01 0.7300 55535.43638822
aa03 0.5800 49616.36363636
air02 0.1200 7640.00000000
air06 0.5700 49616.36363636
baxter 2.9500 56007255.67225311
car4 0.4200 35.46037017
cari 0.0400 581.89305779
co5 0.7600 714469.55375789
co9 2.2200 946920.43032251
cq5 0.6700 400133.80747262
cq9 2.1500 505541.70980727
crew1 0.1200 20.55555556
ex3sta1 1.9700 -63.07540325
fit2d 0.3400 -68464.29329383
fit2p 0.3000 68464.29329383
fome11 0.1600 0.00000000
fome12 0.3200 0.00000000
gen1 0.7000 0.00000054
gen2 2.9500 3.29279078
gen4 20.4000 0.00000084
jendrec1 0.9000 7028.46051135
ken-11 0.3800 -6972382262.51996900
ken-13 1.0700 -1.0257394789482E+10
l30 27.3600 0.95266138
lp22 4.2000 458.94459411
lpl3 1.2300 27318.00000000
maros-r7 1.1500 1497185.16647964
mod2 6.5500 27737371.36445580
model10 1.6200 -154599.62122930
model11 0.5100 0.00000000
model5 0.7200 -858440.72907149
model7 0.4800 49380.08549628
model9 0.3400 -141123.09360707
nemspmm1 0.5700 -327415.83567076
nemspmm2 0.7100 -291794.83608908
nemswrld 3.1400 260.30896600
nsir1 1.3100 -28909033.00000000
nsir2 1.4600 -27175593.50000000
nug15 52.6600 1040.99404096
osa-07 0.2700 535722.51729935
p010 1.0100 1115047.91511082
p05 0.3500 556000.27662588
pcb3000 0.5400 137416.41961282
pds-06 1.1600 27761037600.00000000
pds-10 4.1500 26727094976.00000000
pilot87 2.4700 301.71034733
qap15 48.4700 1040.99404096
r05 0.3800 557831.85904066
rat1 0.2700 1999531.66287928
rat5 0.6300 3083707.01043842
rosen10 0.1800 -174215.45613870
scfxm1-2b-64 1.6400 2877.56386371
scfxm1-2r-64 0.7700 2877.56386371
scfxm1-2r-96 1.5400 2891.70611371
scrs8-2r-512 0.1500 1074.09934157
scsd8-2b-64 0.4300 15.99866803
scsd8-2c-64 0.5200 14.99923200
scsd8-2r-108 0.9200 23.70000000
scsd8-2r-216 1.5400 23.39998576
sctap1-2b-64 0.5000 484.56000000
slptsk 1.5200 29.89536602
south31 0.8200 1818940197.10106000
stocfor3 0.6500 -39976.78394365
testbig 0.3000 -60.42296073
ulevimin 3.9700 -5191101861.43196900
wood1p 0.1000 1.44290241
world 6.3800 40364873.11417350
bas1lp 9.5200 363.00000000
cre-b 2.3800 23129639.88683240
cre-d 1.8000 24454969.76454920
fome13 0.6700 0.00000000
fome20 16.5100 23821658640.00000000
fome21 42.7700 47346318912.00000000
ken-18 7.1800 -5.2217025287397E+10
kl02 0.3800 215.25000000
nemsemm2 0.7800 581079.57090469
nsct1 72.8100 -38922436.00000000
nsct2 48.6600 -37175082.00000000
nug20 864.2800 2181.60332164
osa-14 0.6500 1106462.84473625
osa-30 1.7400 2142139.87320976
pds-20 16.5300 23821658640.00000000
pds-30 43.6900 21385445736.00000000
pds-40 93.6200 18855198824.00000000
pds-50 135.6900 16603525724.00000000
pds-60 192.1500 14265904407.00000000
rail507 1.3600 172.14556668
rail516 0.9800 182.00000000
rail582 1.4000 209.71223296
rat7a 3.6600 2074371.41572829
rlfddd 1.9300 -13.00000000
rlfdual 7.9900 -1.00000000
rlfprim 2.6800 1.00000000
route 4.5600 5941.65027667
scfxm1-2r-256 3.8700 2891.70611371
scsd8-2r-432 1.1900 25.79999802
sctap1-2r-480 1.1500 248.50000000
t0331-4l 1.8400 29730.03335194
us04 0.3700 17731.66666667
watson_1 35.8300 -1609.27855376
dbic1 37.1500 -9768973.00000000
dbir1 29.7200 -8106707.00000000
dbir2 22.0200 -6116916.50000000
nemsemm1 4.2200 512959.60078798
nw14 3.4300 61844.00000000
osa-60 3.9700 4044072.50315742
pds-100 537.2500 10928229968.00000000
pds-70 274.7000 12241162812.00000000
pds-80 337.3500 11469077462.00000000
pds-90 375.3800 11087561635.00000000
rail2586 64.5500 935.92182057
rail4284 152.6600 1054.05449127
self 3.4500 0.00000000

Back to top





CPLEX-BARRIER: infeasible:     Back to top

Modelname Time (CPLEX-BARRIER) Status (CPLEX-BARRIER)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)

Back to top





CPLEX-BARRIER: fail:     Back to top

Modelname Time (CPLEX-BARRIER) Status (CPLEX-BARRIER)
lpl1 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(13)
nug30 -- mstat(14) sstat( 4)

Back to top





IPOPT: optimal:     Back to top

Modelname Time (IPOPT) Obj (IPOPT)
aa01 11.8300 55535.43640912
aa03 9.6900 49616.36363649
air02 2.6200 7640.00000065
air06 9.7000 49616.36363649
car4 2.7900 35.46037020
cari 7.1300 581.89305792
co5 11.7700 714469.64279909
co9 32.9900 946920.50623726
cq5 11.9800 400133.80773115
cq9 56.5900 505541.70980948
crew1 1.2900 20.55556529
ex3sta1 34.0400 -63.07540325
fit2d 5.7000 -68464.29329298
fit2p 1.8800 68464.29330248
fome11 134.2800 0.00292352
fome12 274.4000 0.00584704
gen1 3.9600 0.00000796
gen2 10.0500 3.29279078
gen4 13.5000 0.00001301
jendrec1 6.1200 7028.46051757
ken-11 6.6200 -6972382262.51996900
ken-13 25.6900 -1.0257394789482E+10
l30 3.0500 0.95207806
lp22 186.6600 459.00933768
maros-r7 44.4100 1497185.16647966
mod2 198.4900 27737371.36448260
model11 36.3500 0.00010208
model5 297.0900 -858440.72839567
model7 6.5400 49380.08552185
model9 76.5400 -141123.08766642
nemspmm1 5.6700 -327415.83567074
nemspmm2 9.4100 -291794.77219164
nemswrld 67.0900 260.30950736
nsir1 9.0800 -28909033.00000000
nsir2 12.1900 -27175593.49999840
osa-07 51.2200 535722.51965037
p010 171.5500 1115047.91511083
p05 130.2200 556000.27662589
pcb3000 3.4000 137416.53410574
pds-06 121.1700 27761037600.00000000
pds-10 996.8400 26727094976.03690000
pilot87 49.5500 301.71037082
r05 19.3100 557831.85904191
rat1 939.1400 1999531.66287930
rat5 268.2000 3083707.01043842
rosen10 1.5500 -174215.45613870
scfxm1-2b-64 11.9400 2877.56386534
scfxm1-2r-64 4.8800 2877.56397447
scfxm1-2r-96 8.1500 2891.70613518
scrs8-2r-512 742.8900 1074.09934203
scsd8-2b-64 1.8200 15.99866807
scsd8-2c-64 1.9600 14.99923203
scsd8-2r-108 1.1800 23.69999891
scsd8-2r-216 2.7200 23.40001016
sctap1-2b-64 3.3800 484.56000206
slptsk 19.6100 29.89536615
south31 10.0700 1818940197.10107000
stocfor3 10.6500 -39976.78394364
testbig 2.8000 -59.71377151
wood1p 3.0700 1.44290241
world 207.4500 40364873.43011240
bas1lp 443.5200 363.00000000
fome13 599.0300 0.01169409
ken-18 221.3000 -5.2217025287397E+10
kl02 17.6400 215.25001806
nsct1 1034.7000 -38922435.93294140
nsct2 2811.0700 -37175082.00000000
osa-14 96.8400 1106462.86972097
osa-30 327.9500 2142140.84743002
rail507 45.6000 172.14556674
rail516 624.7800 182.00000004
rail582 53.0600 209.71223435
rat7a 499.0100 2074371.41572829
rlfddd 9.8400 -12.99999327
rlfdual 53.1600 -0.99999994
rlfprim 71.1500 1.00001330
route 15.1600 5941.65027702
scfxm1-2r-256 21.1500 2892.02010444
scsd8-2r-432 5.4500 25.80002199
sctap1-2r-480 6.7500 248.50005291
t0331-4l 49.6600 29730.03339276
us04 20.2100 17731.66666680
dbir2 289.0100 -6116916.49999997
nemsemm1 93.1200 512961.33656058
nw14 330.9900 61844.00001227
osa-60 2118.8600 4044072.77774503

Back to top





IPOPT: feasible:     Back to top

Modelname Time (IPOPT) Obj (IPOPT)
lpl3 3667.9500 92049.12139266
model10 3749.7900 -154595.73840092
nug15 3861.2500 1040.99847628
qap15 3687.2200 1040.99438307
fome20 3684.9000 23824795566.33030000
nemsemm2 5387.1300 590853.36666951
pds-20 3610.3500 23824795566.33030000
rail2586 3608.6000 1126.43249215

Back to top





IPOPT: infeasible:     Back to top

Modelname Time (IPOPT) Status (IPOPT)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)

Back to top





IPOPT: fail:     Back to top

Modelname Time (IPOPT) Status (IPOPT)
baxter -- mstat(13) sstat(10)
ulevimin -- mstat( 6) sstat( 3)
cre-b -- mstat( 6) sstat( 3)
cre-d -- mstat(13) sstat(10)
fome21 -- mstat( 6) sstat( 3)
lpl1 -- mstat(13) sstat(10)
nug20 -- mstat(13) sstat(10)
pds-30 -- mstat( 6) sstat( 3)
pds-40 -- mstat( 6) sstat( 3)
pds-50 -- mstat(13) sstat(10)
pds-60 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(10)
watson_1 -- mstat(13) sstat(10)
dbic1 -- mstat(13) sstat(13)
dbir1 -- mstat(13) sstat(10)
nug30 -- mstat(13) sstat(13)
pds-100 -- mstat( 6) sstat( 3)
pds-70 -- mstat(13) sstat(10)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(10)
self -- mstat(13) sstat(10)

Back to top