Solver Square Comparison: Considers all models.

Date / Time: 09/02/07 12:02:39


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver GLPK is represented on the left (rows) and solver IPOPT on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :4-GLPK-0.trc
Tracefile 2 :5-IPOPT-0.trc
Solvers used : GLPK
IPOPT
Modeltype(s)   LP



IPOPT:
optimal
IPOPT:
locally optimal
IPOPT:
feasible
IPOPT:
infeasible
IPOPT:
unbounded
IPOPT:
fail
IPOPT:
no data
total GLPK
GLPK:
optimal
75 - 5 - - 6 - 86
GLPK:
locally optimal
- - - - - - - -
GLPK:
feasible
- - - - - - - -
GLPK:
infeasible
- - - 2 - 2 - 4
GLPK:
unbounded
- - - - - - - -
GLPK:
fail
11 - 3 - - 14 - 28
GLPK:
no data
- - - - - - - -
total IPOPT 86 - 8 2 - 22 - 118




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


GLPK: optimal -- IPOPT: optimal    Back to top

Modelname Time (GLPK) Time (IPOPT) Ratio (GLPK/IPOPT) Obj (GLPK) Obj (IPOPT)
aa01 88.8300 11.8300 7.509 55535.43638822 55535.43640912
air02 0.0900 2.6200 0.034 7640.00000000 7640.00000065
car4 1.8700 2.7900 0.670 35.46037017 35.46037020
cari 0.1600 7.1300 0.022 581.89305779 581.89305792
co5 12.7800 11.7700 1.086 714469.55375105 714469.64279909
co9 67.2300 32.9900 2.038 946920.43028456 946920.50623726
cq5 10.3200 11.9800 0.861 400133.80747262 400133.80773115
cq9 63.5000 56.5900 1.122 505541.70980727 505541.70980948
crew1 0.2800 1.2900 0.217 20.55555556 20.55556529
ex3sta1 3.8700 34.0400 0.114 -63.07540325 -63.07540325
fit2d 7.7000 5.7000 1.351 -68464.29329383 -68464.29329298
fit2p 11.1500 1.8800 5.931 68464.29329383 68464.29330248
fome11 0.1000 134.2800 0.001 0.00000000 0.00292352
fome12 0.2700 274.4000 0.001 0.00000000 0.00584704
gen2 1192.2800 10.0500 118.635 3.29279079 3.29279078
jendrec1 6.9600 6.1200 1.137 7028.46051135 7028.46051757
ken-11 10.3400 6.6200 1.562 -6972382262.51996900 -6972382262.51996900
ken-13 67.3900 25.6900 2.623 -1.0257394789482E+10 -1.0257394789482E+10
maros-r7 2.3800 44.4100 0.054 1497185.16647964 1497185.16647966
mod2 488.1000 198.4900 2.459 27737371.36445520 27737371.36448260
model11 3.3000 36.3500 0.091 0.00000000 0.00010208
model5 3.2300 297.0900 0.011 -858440.72907343 -858440.72839567
model7 4.9200 6.5400 0.752 49380.08549293 49380.08552185
model9 2.7900 76.5400 0.036 -141123.09361330 -141123.08766642
nemspmm1 10.0400 5.6700 1.771 -327415.83567076 -327415.83567074
nemspmm2 10.2800 9.4100 1.092 -291794.83608908 -291794.77219164
nemswrld 340.3400 67.0900 5.073 260.30896600 260.30950736
nsir1 1.9800 9.0800 0.218 -28909033.00000000 -28909033.00000000
nsir2 0.9300 12.1900 0.076 -27175593.50000000 -27175593.49999840
osa-07 0.4300 51.2200 0.008 535722.51729935 535722.51965037
p010 21.1200 171.5500 0.123 1115047.91511082 1115047.91511083
p05 5.6000 130.2200 0.043 556000.27662588 556000.27662589
pcb3000 3.8100 3.4000 1.121 137416.41961282 137416.53410574
pds-06 17.0400 121.1700 0.141 27761037600.00000000 27761037600.00000000
pds-10 116.4800 996.8400 0.117 26727094976.00000000 26727094976.03690000
pilot87 54.4100 49.5500 1.098 301.71034744 301.71037082
r05 6.7700 19.3100 0.351 557831.85904066 557831.85904191
rat1 1.9600 939.1400 0.002 1999531.66287928 1999531.66287930
rat5 2.1500 268.2000 0.008 3083707.01043841 3083707.01043842
rosen10 2.8900 1.5500 1.865 -174215.45613870 -174215.45613870
scrs8-2r-512 10.0900 742.8900 0.014 1074.09934157 1074.09934203
scsd8-2b-64 10.5400 1.8200 5.791 15.99866803 15.99866807
scsd8-2c-64 9.6400 1.9600 4.918 14.99923200 14.99923203
scsd8-2r-108 2.5800 1.1800 2.186 23.69999434 23.69999891
scsd8-2r-216 11.0900 2.7200 4.077 23.39998423 23.40001016
sctap1-2b-64 4.1800 3.3800 1.237 484.56000000 484.56000206
slptsk 4.2900 19.6100 0.219 29.89536602 29.89536615
south31 108.1700 10.0700 10.742 1818940197.10106000 1818940197.10107000
stocfor3 6.1300 10.6500 0.576 -39976.78394365 -39976.78394364
testbig 6.2000 2.8000 2.214 -60.42296073 -59.71377151
wood1p 0.1300 3.0700 0.042 1.44290241 1.44290241
world 575.9200 207.4500 2.776 40364873.11417860 40364873.43011240
bas1lp 5.1500 443.5200 0.012 363.00000000 363.00000000
fome13 0.7800 599.0300 0.001 0.00000000 0.01169409
ken-18 1168.4900 221.3000 5.280 -5.2217025287397E+10 -5.2217025287397E+10
kl02 1.1500 17.6400 0.065 215.25000000 215.25001806
nsct1 9.5800 1034.7000 0.009 -38922436.00000000 -38922435.93294140
nsct2 2.9600 2811.0700 0.001 -37175082.00000000 -37175082.00000000
osa-14 1.8100 96.8400 0.019 1106462.84473626 1106462.86972097
osa-30 6.7200 327.9500 0.020 2142139.87320976 2142140.84743002
rail507 90.4300 45.6000 1.983 172.14556668 172.14556674
rail516 46.3900 624.7800 0.074 182.00000000 182.00000004
rail582 128.1500 53.0600 2.415 209.71223296 209.71223435
rat7a 16.8700 499.0100 0.034 2074371.41573149 2074371.41572829
rlfddd 17.8400 9.8400 1.813 -13.00000000 -12.99999327
rlfprim 575.4100 71.1500 8.087 1.00000000 1.00001330
route 388.8300 15.1600 25.648 5941.65027667 5941.65027702
scsd8-2r-432 49.6700 5.4500 9.114 25.79997080 25.80002199
sctap1-2r-480 16.1900 6.7500 2.399 248.50000000 248.50005291
t0331-4l 282.9800 49.6600 5.698 29730.03335194 29730.03339276
us04 4.7600 20.2100 0.236 17731.66666667 17731.66666680
dbir2 38.7500 289.0100 0.134 -6116916.50000000 -6116916.49999997
nemsemm1 5.9600 93.1200 0.064 512959.60078798 512961.33656058
nw14 3.6600 330.9900 0.011 61844.00000000 61844.00001227
osa-60 33.7400 2118.8600 0.016 4044072.50315742 4044072.77774503

Back to top





GLPK: optimal -- IPOPT: feasible    Back to top

Modelname Time (GLPK) Time (IPOPT) Ratio (GLPK/IPOPT) Obj (GLPK) Obj (IPOPT)
lpl3 11.2500 3667.9500 0.003 27318.00000000 92049.12139266
model10 35.1500 3749.7900 0.009 -154599.62130064 -154595.73840092
fome20 2210.8600 3684.9000 0.600 23821658640.00000000 23824795566.33030000
nemsemm2 7.2100 5387.1300 0.001 581079.57090469 590853.36666951
pds-20 2255.5100 3610.3500 0.625 23821658640.00000000 23824795566.33030000

Back to top





GLPK: optimal -- IPOPT: fail    Back to top

Modelname Time (GLPK) Time (IPOPT) Ratio (GLPK/IPOPT) Obj (GLPK) Status (IPOPT)
baxter 14.4500 NA --- 56007255.67225311 mstat(13) sstat(10)
cre-b 23.9600 3799.6800 --- 23129639.88683240 mstat( 6) sstat( 3)
cre-d 13.1300 NA --- 24454969.76454920 mstat(13) sstat(10)
dbic1 1392.6700 NA --- -9768973.00000000 mstat(13) sstat(13)
dbir1 34.4500 NA --- -8106707.00000000 mstat(13) sstat(10)
self 14.4700 NA --- 0.00000000 mstat(13) sstat(10)

Back to top





GLPK: infeasible -- IPOPT: infeasible    Back to top

Modelname Time (GLPK) Time (IPOPT) Ratio (GLPK/IPOPT) Status (GLPK) Status (IPOPT)
bgindy 0.2200 6.4800 --- mstat(19) sstat( 1) mstat( 4) sstat( 1)
gosh 1.4500 1221.9600 --- mstat(19) sstat( 1) mstat( 4) sstat( 1)

Back to top





GLPK: infeasible -- IPOPT: fail    Back to top

Modelname Time (GLPK) Time (IPOPT) Ratio (GLPK/IPOPT) Status (GLPK) Status (IPOPT)
lpl1 1185.1000 NA --- mstat(19) sstat( 1) mstat(13) sstat(10)
sgpf5y6 0.3700 NA --- mstat(19) sstat( 1) mstat(13) sstat(10)

Back to top





GLPK: fail -- IPOPT: optimal    Back to top

Modelname Time (GLPK) Time (IPOPT) Ratio (GLPK/IPOPT) Status (GLPK) Obj (IPOPT)
gen1 3594.1200 3.9600 --- mstat(14) sstat( 3) 0.00000796
gen4 NA 13.5000 --- mstat(13) sstat(13) 0.00001301
lp22 3597.2800 186.6600 --- mstat(14) sstat( 3) 459.00933768
rlfdual 1931.4800 53.1600 --- mstat(13) sstat(13) -0.99999994
scfxm1-2r-256 3596.6300 21.1500 --- mstat(14) sstat( 3) 2892.02010444
aa03 3593.7200 9.6900 --- mstat(14) sstat( 3) 49616.36363649
air06 3594.3400 9.7000 --- mstat(14) sstat( 3) 49616.36363649
l30 3595.8100 3.0500 --- mstat(14) sstat( 3) 0.95207806
scfxm1-2b-64 3596.3200 11.9400 --- mstat(14) sstat( 3) 2877.56386534
scfxm1-2r-64 3594.9500 4.8800 --- mstat(14) sstat( 3) 2877.56397447
scfxm1-2r-96 3596.3800 8.1500 --- mstat(14) sstat( 3) 2891.70613518

Back to top





GLPK: fail -- IPOPT: feasible    Back to top

Modelname Time (GLPK) Time (IPOPT) Ratio (GLPK/IPOPT) Status (GLPK) Obj (IPOPT)
nug15 3595.5900 3861.2500 --- mstat(14) sstat( 3) 1040.99847628
qap15 3598.2700 3687.2200 --- mstat(14) sstat( 3) 1040.99438307
rail2586 3606.5700 3608.6000 --- mstat(14) sstat( 3) 1126.43249215

Back to top





GLPK: fail -- IPOPT: fail    Back to top

Modelname Time (GLPK) Time (IPOPT) Ratio (GLPK/IPOPT) Status (GLPK) Status (IPOPT)
fome21 3597.5600 3612.7400 --- mstat(14) sstat( 3) mstat( 6) sstat( 3)
nug20 3622.4300 NA --- mstat(14) sstat( 3) mstat(13) sstat(10)
pds-30 3598.1200 3727.3200 --- mstat(14) sstat( 3) mstat( 6) sstat( 3)
pds-40 3597.6300 3675.6500 --- mstat(14) sstat( 3) mstat( 6) sstat( 3)
pds-50 3598.9600 NA --- mstat(14) sstat( 3) mstat(13) sstat(10)
pds-60 3599.0900 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
watson_1 3597.5800 NA --- mstat(14) sstat( 3) mstat(13) sstat(10)
nug30 3630.1700 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
pds-100 3570.4900 29433.2100 --- mstat(14) sstat( 3) mstat( 6) sstat( 3)
pds-70 3599.3300 NA --- mstat(14) sstat( 3) mstat(13) sstat(10)
pds-80 3599.9400 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
pds-90 3598.8000 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
rail4284 3610.3300 NA --- mstat(14) sstat( 3) mstat(13) sstat(10)
ulevimin 3594.6800 3600.9100 --- mstat(14) sstat( 3) mstat( 6) sstat( 3)

Back to top





GLPK: optimal:     Back to top

Modelname Time (GLPK) Obj (GLPK)
aa01 88.8300 55535.43638822
air02 0.0900 7640.00000000
baxter 14.4500 56007255.67225311
car4 1.8700 35.46037017
cari 0.1600 581.89305779
co5 12.7800 714469.55375105
co9 67.2300 946920.43028456
cq5 10.3200 400133.80747262
cq9 63.5000 505541.70980727
crew1 0.2800 20.55555556
ex3sta1 3.8700 -63.07540325
fit2d 7.7000 -68464.29329383
fit2p 11.1500 68464.29329383
fome11 0.1000 0.00000000
fome12 0.2700 0.00000000
gen2 1192.2800 3.29279079
jendrec1 6.9600 7028.46051135
ken-11 10.3400 -6972382262.51996900
ken-13 67.3900 -1.0257394789482E+10
lpl3 11.2500 27318.00000000
maros-r7 2.3800 1497185.16647964
mod2 488.1000 27737371.36445520
model10 35.1500 -154599.62130064
model11 3.3000 0.00000000
model5 3.2300 -858440.72907343
model7 4.9200 49380.08549293
model9 2.7900 -141123.09361330
nemspmm1 10.0400 -327415.83567076
nemspmm2 10.2800 -291794.83608908
nemswrld 340.3400 260.30896600
nsir1 1.9800 -28909033.00000000
nsir2 0.9300 -27175593.50000000
osa-07 0.4300 535722.51729935
p010 21.1200 1115047.91511082
p05 5.6000 556000.27662588
pcb3000 3.8100 137416.41961282
pds-06 17.0400 27761037600.00000000
pds-10 116.4800 26727094976.00000000
pilot87 54.4100 301.71034744
r05 6.7700 557831.85904066
rat1 1.9600 1999531.66287928
rat5 2.1500 3083707.01043841
rosen10 2.8900 -174215.45613870
scrs8-2r-512 10.0900 1074.09934157
scsd8-2b-64 10.5400 15.99866803
scsd8-2c-64 9.6400 14.99923200
scsd8-2r-108 2.5800 23.69999434
scsd8-2r-216 11.0900 23.39998423
sctap1-2b-64 4.1800 484.56000000
slptsk 4.2900 29.89536602
south31 108.1700 1818940197.10106000
stocfor3 6.1300 -39976.78394365
testbig 6.2000 -60.42296073
wood1p 0.1300 1.44290241
world 575.9200 40364873.11417860
bas1lp 5.1500 363.00000000
cre-b 23.9600 23129639.88683240
cre-d 13.1300 24454969.76454920
fome13 0.7800 0.00000000
fome20 2210.8600 23821658640.00000000
ken-18 1168.4900 -5.2217025287397E+10
kl02 1.1500 215.25000000
nemsemm2 7.2100 581079.57090469
nsct1 9.5800 -38922436.00000000
nsct2 2.9600 -37175082.00000000
osa-14 1.8100 1106462.84473626
osa-30 6.7200 2142139.87320976
pds-20 2255.5100 23821658640.00000000
rail507 90.4300 172.14556668
rail516 46.3900 182.00000000
rail582 128.1500 209.71223296
rat7a 16.8700 2074371.41573149
rlfddd 17.8400 -13.00000000
rlfprim 575.4100 1.00000000
route 388.8300 5941.65027667
scsd8-2r-432 49.6700 25.79997080
sctap1-2r-480 16.1900 248.50000000
t0331-4l 282.9800 29730.03335194
us04 4.7600 17731.66666667
dbic1 1392.6700 -9768973.00000000
dbir1 34.4500 -8106707.00000000
dbir2 38.7500 -6116916.50000000
nemsemm1 5.9600 512959.60078798
nw14 3.6600 61844.00000000
osa-60 33.7400 4044072.50315742
self 14.4700 0.00000000

Back to top





GLPK: infeasible:     Back to top

Modelname Time (GLPK) Status (GLPK)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
lpl1 -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





GLPK: fail:     Back to top

Modelname Time (GLPK) Status (GLPK)
gen1 -- mstat(14) sstat( 3)
gen4 -- mstat(13) sstat(13)
lp22 -- mstat(14) sstat( 3)
nug15 -- mstat(14) sstat( 3)
qap15 -- mstat(14) sstat( 3)
fome21 -- mstat(14) sstat( 3)
nug20 -- mstat(14) sstat( 3)
pds-30 -- mstat(14) sstat( 3)
pds-40 -- mstat(14) sstat( 3)
pds-50 -- mstat(14) sstat( 3)
pds-60 -- mstat(14) sstat( 3)
rlfdual -- mstat(13) sstat(13)
scfxm1-2r-256 -- mstat(14) sstat( 3)
watson_1 -- mstat(14) sstat( 3)
nug30 -- mstat(14) sstat( 3)
pds-100 -- mstat(14) sstat( 3)
pds-70 -- mstat(14) sstat( 3)
pds-80 -- mstat(14) sstat( 3)
pds-90 -- mstat(14) sstat( 3)
rail2586 -- mstat(14) sstat( 3)
rail4284 -- mstat(14) sstat( 3)
aa03 -- mstat(14) sstat( 3)
air06 -- mstat(14) sstat( 3)
l30 -- mstat(14) sstat( 3)
scfxm1-2b-64 -- mstat(14) sstat( 3)
scfxm1-2r-64 -- mstat(14) sstat( 3)
scfxm1-2r-96 -- mstat(14) sstat( 3)
ulevimin -- mstat(14) sstat( 3)

Back to top





IPOPT: optimal:     Back to top

Modelname Time (IPOPT) Obj (IPOPT)
aa01 11.8300 55535.43640912
air02 2.6200 7640.00000065
car4 2.7900 35.46037020
cari 7.1300 581.89305792
co5 11.7700 714469.64279909
co9 32.9900 946920.50623726
cq5 11.9800 400133.80773115
cq9 56.5900 505541.70980948
crew1 1.2900 20.55556529
ex3sta1 34.0400 -63.07540325
fit2d 5.7000 -68464.29329298
fit2p 1.8800 68464.29330248
fome11 134.2800 0.00292352
fome12 274.4000 0.00584704
gen1 3.9600 0.00000796
gen2 10.0500 3.29279078
gen4 13.5000 0.00001301
jendrec1 6.1200 7028.46051757
ken-11 6.6200 -6972382262.51996900
ken-13 25.6900 -1.0257394789482E+10
lp22 186.6600 459.00933768
maros-r7 44.4100 1497185.16647966
mod2 198.4900 27737371.36448260
model11 36.3500 0.00010208
model5 297.0900 -858440.72839567
model7 6.5400 49380.08552185
model9 76.5400 -141123.08766642
nemspmm1 5.6700 -327415.83567074
nemspmm2 9.4100 -291794.77219164
nemswrld 67.0900 260.30950736
nsir1 9.0800 -28909033.00000000
nsir2 12.1900 -27175593.49999840
osa-07 51.2200 535722.51965037
p010 171.5500 1115047.91511083
p05 130.2200 556000.27662589
pcb3000 3.4000 137416.53410574
pds-06 121.1700 27761037600.00000000
pds-10 996.8400 26727094976.03690000
pilot87 49.5500 301.71037082
r05 19.3100 557831.85904191
rat1 939.1400 1999531.66287930
rat5 268.2000 3083707.01043842
rosen10 1.5500 -174215.45613870
scrs8-2r-512 742.8900 1074.09934203
scsd8-2b-64 1.8200 15.99866807
scsd8-2c-64 1.9600 14.99923203
scsd8-2r-108 1.1800 23.69999891
scsd8-2r-216 2.7200 23.40001016
sctap1-2b-64 3.3800 484.56000206
slptsk 19.6100 29.89536615
south31 10.0700 1818940197.10107000
stocfor3 10.6500 -39976.78394364
testbig 2.8000 -59.71377151
wood1p 3.0700 1.44290241
world 207.4500 40364873.43011240
bas1lp 443.5200 363.00000000
fome13 599.0300 0.01169409
ken-18 221.3000 -5.2217025287397E+10
kl02 17.6400 215.25001806
nsct1 1034.7000 -38922435.93294140
nsct2 2811.0700 -37175082.00000000
osa-14 96.8400 1106462.86972097
osa-30 327.9500 2142140.84743002
rail507 45.6000 172.14556674
rail516 624.7800 182.00000004
rail582 53.0600 209.71223435
rat7a 499.0100 2074371.41572829
rlfddd 9.8400 -12.99999327
rlfdual 53.1600 -0.99999994
rlfprim 71.1500 1.00001330
route 15.1600 5941.65027702
scfxm1-2r-256 21.1500 2892.02010444
scsd8-2r-432 5.4500 25.80002199
sctap1-2r-480 6.7500 248.50005291
t0331-4l 49.6600 29730.03339276
us04 20.2100 17731.66666680
dbir2 289.0100 -6116916.49999997
nemsemm1 93.1200 512961.33656058
nw14 330.9900 61844.00001227
osa-60 2118.8600 4044072.77774503
aa03 9.6900 49616.36363649
air06 9.7000 49616.36363649
l30 3.0500 0.95207806
scfxm1-2b-64 11.9400 2877.56386534
scfxm1-2r-64 4.8800 2877.56397447
scfxm1-2r-96 8.1500 2891.70613518

Back to top





IPOPT: feasible:     Back to top

Modelname Time (IPOPT) Obj (IPOPT)
lpl3 3667.9500 92049.12139266
model10 3749.7900 -154595.73840092
nug15 3861.2500 1040.99847628
qap15 3687.2200 1040.99438307
fome20 3684.9000 23824795566.33030000
nemsemm2 5387.1300 590853.36666951
pds-20 3610.3500 23824795566.33030000
rail2586 3608.6000 1126.43249215

Back to top





IPOPT: infeasible:     Back to top

Modelname Time (IPOPT) Status (IPOPT)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)

Back to top





IPOPT: fail:     Back to top

Modelname Time (IPOPT) Status (IPOPT)
baxter -- mstat(13) sstat(10)
cre-b -- mstat( 6) sstat( 3)
cre-d -- mstat(13) sstat(10)
fome21 -- mstat( 6) sstat( 3)
lpl1 -- mstat(13) sstat(10)
nug20 -- mstat(13) sstat(10)
pds-30 -- mstat( 6) sstat( 3)
pds-40 -- mstat( 6) sstat( 3)
pds-50 -- mstat(13) sstat(10)
pds-60 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(10)
watson_1 -- mstat(13) sstat(10)
dbic1 -- mstat(13) sstat(13)
dbir1 -- mstat(13) sstat(10)
nug30 -- mstat(13) sstat(13)
pds-100 -- mstat( 6) sstat( 3)
pds-70 -- mstat(13) sstat(10)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(10)
self -- mstat(13) sstat(10)
ulevimin -- mstat( 6) sstat( 3)

Back to top