Solver Square Comparison: Considers all models.

Date / Time: 01/28/08 11:14:03


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver GLPK2008 is represented on the left (rows) and solver IPOPT2008 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :4-GLPK2008.trc
Tracefile 2 :5-IPOPT2008.trc
Solvers used : GLPK2008
IPOPT2008
Modeltype(s)   LP



IPOPT2008:
optimal
IPOPT2008:
locally optimal
IPOPT2008:
feasible
IPOPT2008:
infeasible
IPOPT2008:
unbounded
IPOPT2008:
fail
IPOPT2008:
no data
total GLPK2008
GLPK2008:
optimal
76 - 2 - - 6 - 84
GLPK2008:
locally optimal
- - - - - - - -
GLPK2008:
feasible
- - - - - - - -
GLPK2008:
infeasible
- - - - - 3 - 3
GLPK2008:
unbounded
- - - - - - - -
GLPK2008:
fail
14 - 4 - - 15 - 33
GLPK2008:
no data
- - - - - - - -
total IPOPT2008 90 - 6 - - 24 - 120




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


GLPK2008: optimal -- IPOPT2008: optimal    Back to top

Modelname Time (GLPK2008) Time (IPOPT2008) Ratio (GLPK2008/IPOPT2008) Obj (GLPK2008) Obj (IPOPT2008)
aa01 21.1600 14.4700 1.462 55535.43638822 55535.43638976
aa03 28.0400 9.0200 3.109 49616.36363636 49616.36363779
aa3 0.0000 0.0000 --- 0.00000000 0.00000000
aa4 0.0000 0.0000 --- 0.00000000 0.00000000
aa5 0.0000 0.0000 --- 0.00000000 0.00000000
aa6 0.0000 0.0000 --- 0.00000000 0.00000000
air02 0.2300 2.5200 0.091 7640.00000000 7640.00000685
air06 28.0400 9.1400 3.068 49616.36363636 49616.36363779
baxter 53.6100 83.2600 0.644 56007255.67225311 56007255.68220460
car4 1.3100 2.4700 0.530 35.46037017 35.46038611
cari 0.3800 15.9200 0.024 581.89305779 581.89305780
co5 17.8600 11.8200 1.511 714469.55375105 714469.56285988
co9 103.0000 66.2300 1.555 946920.43028456 946920.43056586
cq5 12.4900 8.3000 1.505 400133.80747262 400133.85194598
cq9 59.8500 55.8300 1.072 505541.70980727 505541.70985527
crew1 0.4900 1.0000 0.490 20.55555556 20.55555579
ex3sta1 12.0500 110.8100 0.109 -63.07540325 -63.07540325
fit2d 24.6100 8.8900 2.768 -68464.29329383 -68464.29322686
fit2p 12.0400 1.6400 7.341 68464.29329383 68464.29329394
fome11 0.2200 496.5200 0.000 0.00000000 0.02571471
fome12 0.6700 1012.5000 0.001 0.00000000 0.05142942
gen2 79.8000 23.0900 3.456 3.29279078 3.29279078
jendrec1 16.4200 5.3700 3.058 7028.46051135 7028.46051883
ken-11 28.0900 5.7200 4.911 -6972382262.51996900 -6972382262.51996000
maros-r7 14.0500 36.6500 0.383 1497185.16647964 1497185.16647971
model10 40.8800 253.0800 0.162 -154599.62130064 -154599.60152150
model5 5.3100 16.5900 0.320 -858440.72907341 -858440.71278465
model7 7.9200 378.0900 0.021 49380.08549293 49380.08549939
model9 6.2100 4.2000 1.479 -141123.09361336 -141123.07764086
nemspmm1 10.7200 3.4800 3.080 -327415.83567076 -327415.83567071
nemspmm2 12.8200 5.9100 2.169 -291794.83608908 -291794.82815232
nsir1 1.7300 58.4900 0.030 -28909033.00000000 -28909033.00000000
nsir2 0.9800 18.8000 0.052 -27175593.50000000 -27175593.49999990
osa-07 1.3300 27.4100 0.049 535722.51729935 535722.51731281
p010 35.8100 6.6700 5.369 1115047.91511082 1115047.91511097
p05 8.1900 2.8200 2.904 556000.27662588 556000.27662606
pcb3000 7.6400 3.0900 2.472 137416.41961282 137416.43123403
pilot87 37.2000 100.2800 0.371 301.71034744 301.71335719
r05 9.5900 15.0900 0.636 557831.85904066 557831.85904078
rat1 7.3700 62.0000 0.119 1999531.66287928 1999531.66288582
rat5 11.3300 55.0400 0.206 3083707.01043819 3083707.01043848
rosen10 3.0700 1.3400 2.291 -174215.45613870 -174215.45613866
scfxm1-2b-64 76.3400 7.4200 10.288 2877.56386371 2877.56386391
scfxm1-2r-64 14.8500 2.7200 5.460 2877.56386371 2877.56386378
scfxm1-2r-96 43.5200 5.2400 8.305 2891.70611371 2891.70612391
scrs8-2r-512 34.3400 203.2200 0.169 1074.09934157 1074.09934625
scsd8-2b-64 51.4100 1.6900 30.420 15.99866803 15.99866840
scsd8-2c-64 56.4000 1.7800 31.685 14.99923200 14.99923237
scsd8-2r-108 7.2800 1.0900 6.679 23.69999434 23.69999449
scsd8-2r-216 32.4500 2.2500 14.422 23.39998416 23.39998427
sctap1-2b-64 12.9400 3.9000 3.318 484.56000000 484.56000007
slptsk 6.8800 18.5200 0.371 29.89536602 29.89536603
stocfor3 16.5200 4.4600 3.704 -39976.78394365 -39976.78394145
testbig 21.6000 2.4100 8.963 -60.42296073 -60.42296055
wood1p 0.4400 3.8100 0.115 1.44290241 1.44290249
bas1lp 5.3100 110.3300 0.048 363.00000000 363.00000000
fome13 2.3100 2111.0800 0.001 0.00000000 0.10285884
kl02 1.8000 19.3800 0.093 215.25000000 215.25000045
nemsemm2 17.5900 10.6500 1.652 581079.57090469 581079.64415549
nsct2 3.7100 1777.2900 0.002 -37175082.00000000 -37175081.99630610
osa-14 6.8200 155.4600 0.044 1106462.84473626 1106462.84478892
osa-30 25.3500 621.6700 0.041 2142139.87320976 2142139.87326934
rail507 58.4700 40.4400 1.446 172.14556668 172.14556730
rail516 21.4400 35.9400 0.597 182.00000000 182.00000081
rail582 65.5400 58.8100 1.114 209.71223296 209.71223351
rat7a 83.3100 160.2000 0.520 2074371.41572798 2074371.41572835
rlfddd 113.3400 33.0200 3.432 -13.00000000 -12.99999932
rlfprim 76.4400 248.1000 0.308 1.00000000 1.00000074
route 45.1500 18.6800 2.417 5941.65027667 5941.65028001
scsd8-2r-432 154.5200 5.1000 30.298 25.79997076 25.79997250
t0331-4l 105.8400 49.8500 2.123 29730.03335194 29730.03335564
us04 2.4800 31.6100 0.078 17731.66666667 17731.66667683
dbir2 9.3500 637.7000 0.015 -6116916.50000000 -6116916.49999329
nemsemm1 22.7400 74.8300 0.304 512959.60078798 512959.68358962
nw14 6.1500 759.7700 0.008 61844.00000000 61844.00014182
self 19.5200 418.5400 0.047 0.00000000 0.00000000

Back to top





GLPK2008: optimal -- IPOPT2008: feasible    Back to top

Modelname Time (GLPK2008) Time (IPOPT2008) Ratio (GLPK2008/IPOPT2008) Obj (GLPK2008) Obj (IPOPT2008)
lpl3 25.6000 3825.6600 0.007 27318.00000000 42132.34654202
cre-d 26.4500 3809.3600 0.007 24454969.76454920 24454970.27821420

Back to top





GLPK2008: optimal -- IPOPT2008: fail    Back to top

Modelname Time (GLPK2008) Time (IPOPT2008) Ratio (GLPK2008/IPOPT2008) Obj (GLPK2008) Status (IPOPT2008)
pds-06 9.8500 3600.6200 --- 27761037600.00000000 mstat( 6) sstat( 3)
pds-10 42.2700 3600.6200 --- 26727094976.00000000 mstat( 6) sstat( 3)
cre-b 41.9100 3672.1700 --- 23129639.88683240 mstat( 6) sstat( 3)
nsct1 17.3100 3611.3600 --- -38922436.00000000 mstat( 6) sstat( 3)
dbir1 32.3700 3738.7500 --- -8106707.00000000 mstat( 6) sstat( 3)
osa-60 112.4900 3601.3400 --- 4044072.50315744 mstat( 6) sstat( 3)

Back to top





GLPK2008: infeasible -- IPOPT2008: fail    Back to top

Modelname Time (GLPK2008) Time (IPOPT2008) Ratio (GLPK2008/IPOPT2008) Status (GLPK2008) Status (IPOPT2008)
bgindy 0.5500 3600.3700 --- mstat(19) sstat( 1) mstat( 6) sstat( 3)
gosh 2.8800 3600.8200 --- mstat(19) sstat( 1) mstat( 6) sstat( 3)
sgpf5y6 0.5700 NA --- mstat(19) sstat( 1) mstat(13) sstat(10)

Back to top





GLPK2008: fail -- IPOPT2008: optimal    Back to top

Modelname Time (GLPK2008) Time (IPOPT2008) Ratio (GLPK2008/IPOPT2008) Status (GLPK2008) Obj (IPOPT2008)
gen1 NA 14.4600 --- mstat(13) sstat(13) 0.00000165
gen4 NA 39.9400 --- mstat(13) sstat(13) 0.00000934
ken-13 NA 12.1900 --- mstat(13) sstat(13) -1.0257394789482E+10
l30 NA 2.7300 --- mstat(13) sstat(13) 0.95217922
lp22 NA 312.5200 --- mstat(13) sstat(13) 458.94466940
mod2 NA 482.1800 --- mstat(13) sstat(13) 27737371.61389040
model11 NA 3.8400 --- mstat(13) sstat(13) 0.00102090
nemswrld NA 133.0500 --- mstat(13) sstat(13) 260.30906234
south31 NA 6.4800 --- mstat(13) sstat(13) 1818940197.10111000
ulevimin NA 149.3700 --- mstat(13) sstat(13) -5191101861.43196900
world NA 330.2500 --- mstat(13) sstat(13) 40364873.11466320
ken-18 NA 578.4100 --- mstat(13) sstat(13) -5.2217025287397E+10
rlfdual NA 188.9900 --- mstat(13) sstat(13) -0.99999942
dbic1 NA 3290.6800 --- mstat(13) sstat(13) -9768973.00014886

Back to top





GLPK2008: fail -- IPOPT2008: feasible    Back to top

Modelname Time (GLPK2008) Time (IPOPT2008) Ratio (GLPK2008/IPOPT2008) Status (GLPK2008) Obj (IPOPT2008)
nug15 NA 3640.1900 --- mstat(13) sstat(13) 1040.99789653
qap15 NA 3748.4000 --- mstat(13) sstat(13) 1040.99450919
watson_1 NA 3972.5200 --- mstat(13) sstat(13) -1586.14352600
rail4284 NA 7231.9500 --- mstat(13) sstat(13) 21191980.00000000

Back to top





GLPK2008: fail -- IPOPT2008: fail    Back to top

Modelname Time (GLPK2008) Time (IPOPT2008) Ratio (GLPK2008/IPOPT2008) Status (GLPK2008) Status (IPOPT2008)
fome20 NA 3775.4900 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
fome21 NA 3704.2600 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
lpl1 NA 3694.0400 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
nug20 NA 6895.3000 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
pds-20 NA 3702.6200 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
pds-30 NA 3884.7500 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
pds-40 NA 3643.7100 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
pds-50 NA 4138.4800 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
pds-60 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
nug30 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
pds-100 NA 4025.6200 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
pds-70 NA 3741.4300 --- mstat(13) sstat(13) mstat( 6) sstat( 3)
pds-80 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
pds-90 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)
rail2586 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)

Back to top





GLPK2008: optimal:     Back to top

Modelname Time (GLPK2008) Obj (GLPK2008)
aa01 21.1600 55535.43638822
aa03 28.0400 49616.36363636
aa3 0.0000 0.00000000
aa4 0.0000 0.00000000
aa5 0.0000 0.00000000
aa6 0.0000 0.00000000
air02 0.2300 7640.00000000
air06 28.0400 49616.36363636
baxter 53.6100 56007255.67225311
car4 1.3100 35.46037017
cari 0.3800 581.89305779
co5 17.8600 714469.55375105
co9 103.0000 946920.43028456
cq5 12.4900 400133.80747262
cq9 59.8500 505541.70980727
crew1 0.4900 20.55555556
ex3sta1 12.0500 -63.07540325
fit2d 24.6100 -68464.29329383
fit2p 12.0400 68464.29329383
fome11 0.2200 0.00000000
fome12 0.6700 0.00000000
gen2 79.8000 3.29279078
jendrec1 16.4200 7028.46051135
ken-11 28.0900 -6972382262.51996900
lpl3 25.6000 27318.00000000
maros-r7 14.0500 1497185.16647964
model10 40.8800 -154599.62130064
model5 5.3100 -858440.72907341
model7 7.9200 49380.08549293
model9 6.2100 -141123.09361336
nemspmm1 10.7200 -327415.83567076
nemspmm2 12.8200 -291794.83608908
nsir1 1.7300 -28909033.00000000
nsir2 0.9800 -27175593.50000000
osa-07 1.3300 535722.51729935
p010 35.8100 1115047.91511082
p05 8.1900 556000.27662588
pcb3000 7.6400 137416.41961282
pds-06 9.8500 27761037600.00000000
pds-10 42.2700 26727094976.00000000
pilot87 37.2000 301.71034744
r05 9.5900 557831.85904066
rat1 7.3700 1999531.66287928
rat5 11.3300 3083707.01043819
rosen10 3.0700 -174215.45613870
scfxm1-2b-64 76.3400 2877.56386371
scfxm1-2r-64 14.8500 2877.56386371
scfxm1-2r-96 43.5200 2891.70611371
scrs8-2r-512 34.3400 1074.09934157
scsd8-2b-64 51.4100 15.99866803
scsd8-2c-64 56.4000 14.99923200
scsd8-2r-108 7.2800 23.69999434
scsd8-2r-216 32.4500 23.39998416
sctap1-2b-64 12.9400 484.56000000
slptsk 6.8800 29.89536602
stocfor3 16.5200 -39976.78394365
testbig 21.6000 -60.42296073
wood1p 0.4400 1.44290241
bas1lp 5.3100 363.00000000
cre-b 41.9100 23129639.88683240
cre-d 26.4500 24454969.76454920
fome13 2.3100 0.00000000
kl02 1.8000 215.25000000
nemsemm2 17.5900 581079.57090469
nsct1 17.3100 -38922436.00000000
nsct2 3.7100 -37175082.00000000
osa-14 6.8200 1106462.84473626
osa-30 25.3500 2142139.87320976
rail507 58.4700 172.14556668
rail516 21.4400 182.00000000
rail582 65.5400 209.71223296
rat7a 83.3100 2074371.41572798
rlfddd 113.3400 -13.00000000
rlfprim 76.4400 1.00000000
route 45.1500 5941.65027667
scsd8-2r-432 154.5200 25.79997076
t0331-4l 105.8400 29730.03335194
us04 2.4800 17731.66666667
dbir1 32.3700 -8106707.00000000
dbir2 9.3500 -6116916.50000000
nemsemm1 22.7400 512959.60078798
nw14 6.1500 61844.00000000
osa-60 112.4900 4044072.50315744
self 19.5200 0.00000000

Back to top





GLPK2008: infeasible:     Back to top

Modelname Time (GLPK2008) Status (GLPK2008)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





GLPK2008: fail:     Back to top

Modelname Time (GLPK2008) Status (GLPK2008)
gen1 -- mstat(13) sstat(13)
gen4 -- mstat(13) sstat(13)
ken-13 -- mstat(13) sstat(13)
l30 -- mstat(13) sstat(13)
lp22 -- mstat(13) sstat(13)
mod2 -- mstat(13) sstat(13)
model11 -- mstat(13) sstat(13)
nemswrld -- mstat(13) sstat(13)
nug15 -- mstat(13) sstat(13)
qap15 -- mstat(13) sstat(13)
south31 -- mstat(13) sstat(13)
ulevimin -- mstat(13) sstat(13)
world -- mstat(13) sstat(13)
fome20 -- mstat(13) sstat(13)
fome21 -- mstat(13) sstat(13)
ken-18 -- mstat(13) sstat(13)
lpl1 -- mstat(13) sstat(13)
nug20 -- mstat(13) sstat(13)
pds-20 -- mstat(13) sstat(13)
pds-30 -- mstat(13) sstat(13)
pds-40 -- mstat(13) sstat(13)
pds-50 -- mstat(13) sstat(13)
pds-60 -- mstat(13) sstat(13)
rlfdual -- mstat(13) sstat(13)
watson_1 -- mstat(13) sstat(13)
dbic1 -- mstat(13) sstat(13)
nug30 -- mstat(13) sstat(13)
pds-100 -- mstat(13) sstat(13)
pds-70 -- mstat(13) sstat(13)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail2586 -- mstat(13) sstat(13)
rail4284 -- mstat(13) sstat(13)

Back to top





IPOPT2008: optimal:     Back to top

Modelname Time (IPOPT2008) Obj (IPOPT2008)
aa01 14.4700 55535.43638976
aa03 9.0200 49616.36363779
aa3 0.0000 0.00000000
aa4 0.0000 0.00000000
aa5 0.0000 0.00000000
aa6 0.0000 0.00000000
air02 2.5200 7640.00000685
air06 9.1400 49616.36363779
baxter 83.2600 56007255.68220460
car4 2.4700 35.46038611
cari 15.9200 581.89305780
co5 11.8200 714469.56285988
co9 66.2300 946920.43056586
cq5 8.3000 400133.85194598
cq9 55.8300 505541.70985527
crew1 1.0000 20.55555579
ex3sta1 110.8100 -63.07540325
fit2d 8.8900 -68464.29322686
fit2p 1.6400 68464.29329394
fome11 496.5200 0.02571471
fome12 1012.5000 0.05142942
gen1 14.4600 0.00000165
gen2 23.0900 3.29279078
gen4 39.9400 0.00000934
jendrec1 5.3700 7028.46051883
ken-11 5.7200 -6972382262.51996000
ken-13 12.1900 -1.0257394789482E+10
l30 2.7300 0.95217922
lp22 312.5200 458.94466940
maros-r7 36.6500 1497185.16647971
mod2 482.1800 27737371.61389040
model10 253.0800 -154599.60152150
model11 3.8400 0.00102090
model5 16.5900 -858440.71278465
model7 378.0900 49380.08549939
model9 4.2000 -141123.07764086
nemspmm1 3.4800 -327415.83567071
nemspmm2 5.9100 -291794.82815232
nemswrld 133.0500 260.30906234
nsir1 58.4900 -28909033.00000000
nsir2 18.8000 -27175593.49999990
osa-07 27.4100 535722.51731281
p010 6.6700 1115047.91511097
p05 2.8200 556000.27662606
pcb3000 3.0900 137416.43123403
pilot87 100.2800 301.71335719
r05 15.0900 557831.85904078
rat1 62.0000 1999531.66288582
rat5 55.0400 3083707.01043848
rosen10 1.3400 -174215.45613866
scfxm1-2b-64 7.4200 2877.56386391
scfxm1-2r-64 2.7200 2877.56386378
scfxm1-2r-96 5.2400 2891.70612391
scrs8-2r-512 203.2200 1074.09934625
scsd8-2b-64 1.6900 15.99866840
scsd8-2c-64 1.7800 14.99923237
scsd8-2r-108 1.0900 23.69999449
scsd8-2r-216 2.2500 23.39998427
sctap1-2b-64 3.9000 484.56000007
slptsk 18.5200 29.89536603
south31 6.4800 1818940197.10111000
stocfor3 4.4600 -39976.78394145
testbig 2.4100 -60.42296055
ulevimin 149.3700 -5191101861.43196900
wood1p 3.8100 1.44290249
world 330.2500 40364873.11466320
bas1lp 110.3300 363.00000000
fome13 2111.0800 0.10285884
ken-18 578.4100 -5.2217025287397E+10
kl02 19.3800 215.25000045
nemsemm2 10.6500 581079.64415549
nsct2 1777.2900 -37175081.99630610
osa-14 155.4600 1106462.84478892
osa-30 621.6700 2142139.87326934
rail507 40.4400 172.14556730
rail516 35.9400 182.00000081
rail582 58.8100 209.71223351
rat7a 160.2000 2074371.41572835
rlfddd 33.0200 -12.99999932
rlfdual 188.9900 -0.99999942
rlfprim 248.1000 1.00000074
route 18.6800 5941.65028001
scsd8-2r-432 5.1000 25.79997250
t0331-4l 49.8500 29730.03335564
us04 31.6100 17731.66667683
dbic1 3290.6800 -9768973.00014886
dbir2 637.7000 -6116916.49999329
nemsemm1 74.8300 512959.68358962
nw14 759.7700 61844.00014182
self 418.5400 0.00000000

Back to top





IPOPT2008: feasible:     Back to top

Modelname Time (IPOPT2008) Obj (IPOPT2008)
lpl3 3825.6600 42132.34654202
nug15 3640.1900 1040.99789653
qap15 3748.4000 1040.99450919
cre-d 3809.3600 24454970.27821420
watson_1 3972.5200 -1586.14352600
rail4284 7231.9500 21191980.00000000

Back to top





IPOPT2008: fail:     Back to top

Modelname Time (IPOPT2008) Status (IPOPT2008)
bgindy -- mstat( 6) sstat( 3)
gosh -- mstat( 6) sstat( 3)
pds-06 -- mstat( 6) sstat( 3)
pds-10 -- mstat( 6) sstat( 3)
cre-b -- mstat( 6) sstat( 3)
fome20 -- mstat( 6) sstat( 3)
fome21 -- mstat( 6) sstat( 3)
lpl1 -- mstat( 6) sstat( 3)
nsct1 -- mstat( 6) sstat( 3)
nug20 -- mstat( 6) sstat( 3)
pds-20 -- mstat( 6) sstat( 3)
pds-30 -- mstat( 6) sstat( 3)
pds-40 -- mstat( 6) sstat( 3)
pds-50 -- mstat( 6) sstat( 3)
pds-60 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(10)
dbir1 -- mstat( 6) sstat( 3)
nug30 -- mstat(13) sstat(13)
osa-60 -- mstat( 6) sstat( 3)
pds-100 -- mstat( 6) sstat( 3)
pds-70 -- mstat( 6) sstat( 3)
pds-80 -- mstat(13) sstat(13)
pds-90 -- mstat(13) sstat(13)
rail2586 -- mstat(13) sstat(13)

Back to top