Solver Square Comparison: Considers all models.

Date / Time: 09/02/07 12:02:38


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX-BARRIER is represented on the left (rows) and solver CLP on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :2-CPLEX-1.trc
Tracefile 2 :3-CBC-0.trc
Solvers used : CPLEX-BARRIER
CLP
Modeltype(s)   LP



CLP:
optimal
CLP:
locally optimal
CLP:
feasible
CLP:
infeasible
CLP:
unbounded
CLP:
fail
CLP:
no data
total CPLEX-BARRIER
CPLEX-BARRIER:
optimal
109 - - - - 4 - 113
CPLEX-BARRIER:
locally optimal
- - - - - - - -
CPLEX-BARRIER:
feasible
- - - - - - - -
CPLEX-BARRIER:
infeasible
- - - 2 - - - 2
CPLEX-BARRIER:
unbounded
- - - - - - - -
CPLEX-BARRIER:
fail
- - - 2 - 1 - 3
CPLEX-BARRIER:
no data
- - - - - - - -
total CLP 109 - - 4 - 5 - 118




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CPLEX-BARRIER: optimal -- CLP: optimal    Back to top

Modelname Time (CPLEX-BARRIER) Time (CLP) Ratio (CPLEX-BARRIER/CLP) Obj (CPLEX-BARRIER) Obj (CLP)
aa01 0.7300 1.9600 0.372 55535.43638822 55535.43638822
aa03 0.5800 1.1000 0.527 49616.36363636 49616.36363636
air02 0.1200 0.0600 2.000 7640.00000000 7640.00000000
air06 0.5700 1.1100 0.514 49616.36363636 49616.36363636
baxter 2.9500 1.0300 2.864 56007255.67225311 56007255.67225311
car4 0.4200 1.5900 0.264 35.46037017 35.46037017
cari 0.0400 0.3400 0.118 581.89305779 581.89305779
co5 0.7600 2.9400 0.259 714469.55375789 714469.55375105
co9 2.2200 13.9500 0.159 946920.43032251 946920.43028456
cq5 0.6700 1.3300 0.504 400133.80747262 400133.80747262
cq9 2.1500 6.5100 0.330 505541.70980727 505541.70980727
crew1 0.1200 0.1600 0.750 20.55555556 20.55555556
ex3sta1 1.9700 123.2200 0.016 -63.07540325 -63.07540325
fit2d 0.3400 3.5100 0.097 -68464.29329383 -68464.29329383
fit2p 0.3000 4.0700 0.074 68464.29329383 68464.29329383
fome11 0.1600 0.2400 0.667 0.00000000 0.00000000
fome12 0.3200 0.4800 0.667 0.00000000 0.00000000
gen1 0.7000 1.2100 0.579 0.00000054 0.00000122
gen2 2.9500 46.6100 0.063 3.29279078 3.29279078
gen4 20.4000 62.6100 0.326 0.00000084 0.00000285
jendrec1 0.9000 2.6900 0.335 7028.46051135 7028.46051135
ken-11 0.3800 0.4700 0.809 -6972382262.51996900 -6972382262.51996900
ken-13 1.0700 1.3000 0.823 -1.0257394789482E+10 -1.0257394789482E+10
l30 27.3600 17.8900 1.529 0.95266138 0.95266142
lp22 4.2000 34.1800 0.123 458.94459411 458.94459411
lpl3 1.2300 0.8100 1.519 27318.00000000 27318.00000000
maros-r7 1.1500 2.9100 0.395 1497185.16647964 1497185.16647964
mod2 6.5500 5.6000 1.170 27737371.36445580 27737371.36444000
model10 1.6200 27.4100 0.059 -154599.62122930 -154599.62130064
model11 0.5100 2.6500 0.192 0.00000000 0.00000000
model5 0.7200 3.9200 0.184 -858440.72907149 -858440.72907343
model7 0.4800 2.7100 0.177 49380.08549628 49380.08549287
model9 0.3400 1.6300 0.209 -141123.09360707 -141123.09361336
nemspmm1 0.5700 3.3600 0.170 -327415.83567076 -327415.83567076
nemspmm2 0.7100 3.4000 0.209 -291794.83608908 -291794.83608908
nemswrld 3.1400 50.8000 0.062 260.30896600 260.30896600
nsir1 1.3100 0.3200 4.094 -28909033.00000000 -28909033.00000000
nsir2 1.4600 0.5000 2.920 -27175593.50000000 -27175593.50000000
osa-07 0.2700 0.2600 1.038 535722.51729935 535722.51729935
p010 1.0100 0.9200 1.098 1115047.91511082 1115047.91511082
p05 0.3500 0.3400 1.029 556000.27662588 556000.27662588
pcb3000 0.5400 0.7500 0.720 137416.41961282 137416.41961282
pds-06 1.1600 0.4400 2.636 27761037600.00000000 27761037600.00000000
pds-10 4.1500 1.0000 4.150 26727094976.00000000 26727094976.00000000
pilot87 2.4700 12.5300 0.197 301.71034733 301.71036566
r05 0.3800 0.3800 1.000 557831.85904066 557831.85904066
rat1 0.2700 0.4100 0.659 1999531.66287928 1999531.66287928
rat5 0.6300 1.5200 0.414 3083707.01043842 3083707.01043841
rosen10 0.1800 0.1300 1.385 -174215.45613870 -174215.45613870
scfxm1-2b-64 1.6400 3.7000 0.443 2877.56386371 2877.56386371
scfxm1-2r-64 0.7700 1.1200 0.688 2877.56386371 2877.56386371
scfxm1-2r-96 1.5400 2.2800 0.675 2891.70611371 2891.70611371
scrs8-2r-512 0.1500 0.2100 0.714 1074.09934157 1074.09934157
scsd8-2b-64 0.4300 0.3700 1.162 15.99866803 15.99866803
scsd8-2c-64 0.5200 0.4000 1.300 14.99923200 14.99923200
scsd8-2r-108 0.9200 0.1200 7.667 23.70000000 23.69999434
scsd8-2r-216 1.5400 0.3000 5.133 23.39998576 23.39998388
sctap1-2b-64 0.5000 0.8800 0.568 484.56000000 484.56000000
slptsk 1.5200 2.0800 0.731 29.89536602 29.89536602
south31 0.8200 30.4900 0.027 1818940197.10106000 1818940197.10106000
stocfor3 0.6500 1.1100 0.586 -39976.78394365 -39976.78394365
testbig 0.3000 1.0100 0.297 -60.42296073 -60.42296073
ulevimin 3.9700 33.3700 0.119 -5191101861.43196900 -5191101861.43196900
wood1p 0.1000 0.1200 0.833 1.44290241 1.44290241
world 6.3800 6.3600 1.003 40364873.11417350 40364873.11417430
bas1lp 9.5200 2.0700 4.599 363.00000000 363.00000000
cre-b 2.3800 3.1700 0.751 23129639.88683240 23129639.88683240
cre-d 1.8000 1.9600 0.918 24454969.76454920 24454969.76454920
fome13 0.6700 1.0100 0.663 0.00000000 0.00000000
fome20 16.5100 4.3100 3.831 23821658640.00000000 23821658640.00000000
fome21 42.7700 9.1500 4.674 47346318912.00000000 47346318912.00000000
ken-18 7.1800 8.4400 0.851 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.3800 0.5500 0.691 215.25000000 215.25000000
nemsemm2 0.7800 0.8700 0.897 581079.57090469 581079.57090469
nsct1 72.8100 1.2100 60.174 -38922436.00000000 -38922436.00000000
nsct2 48.6600 2.0400 23.853 -37175082.00000000 -37175082.00000000
osa-14 0.6500 0.8200 0.793 1106462.84473625 1106462.84473625
osa-30 1.7400 1.6500 1.055 2142139.87320976 2142139.87320976
pds-20 16.5300 4.2100 3.926 23821658640.00000000 23821658640.00000000
pds-30 43.6900 10.0100 4.365 21385445736.00000000 21385445736.00000000
pds-40 93.6200 18.3800 5.094 18855198824.00000000 18855198824.00000000
pds-50 135.6900 26.3100 5.157 16603525724.00000000 16603525724.00000000
pds-60 192.1500 39.7900 4.829 14265904407.00000000 14265904407.00000000
rail507 1.3600 11.0000 0.124 172.14556668 172.14556668
rail516 0.9800 3.6300 0.270 182.00000000 182.00000000
rail582 1.4000 7.8600 0.178 209.71223296 209.71223296
rat7a 3.6600 20.9300 0.175 2074371.41572829 2074371.41572828
rlfddd 1.9300 0.3200 6.031 -13.00000000 -13.00000000
rlfdual 7.9900 60.2200 0.133 -1.00000000 -1.00000000
rlfprim 2.6800 1.1900 2.252 1.00000000 1.00000000
route 4.5600 0.4000 11.400 5941.65027667 5941.65027667
scfxm1-2r-256 3.8700 16.2800 0.238 2891.70611371 2891.70611371
scsd8-2r-432 1.1900 0.8500 1.400 25.79999802 25.79996945
sctap1-2r-480 1.1500 2.0500 0.561 248.50000000 248.50000000
t0331-4l 1.8400 18.0500 0.102 29730.03335194 29730.03335194
us04 0.3700 6.4800 0.057 17731.66666667 17731.66666667
watson_1 35.8300 104.6500 0.342 -1609.27855376 -1609.28071548
dbic1 37.1500 306.5800 0.121 -9768973.00000000 -9768973.00000000
dbir1 29.7200 3.9100 7.601 -8106707.00000000 -8106707.00000000
dbir2 22.0200 3.0800 7.149 -6116916.50000000 -6116916.50000000
nemsemm1 4.2200 2.8700 1.470 512959.60078798 512959.60078798
nw14 3.4300 2.7800 1.234 61844.00000000 61844.00000000
osa-60 3.9700 5.9400 0.668 4044072.50315742 4044072.50315751
pds-100 537.2500 90.0600 5.965 10928229968.00000000 10928229968.00000000
pds-70 274.7000 53.7600 5.110 12241162812.00000000 12241162812.00000000
pds-80 337.3500 71.0200 4.750 11469077462.00000000 11469077462.00000000
pds-90 375.3800 76.1900 4.927 11087561635.00000000 11087561635.00000000
rail2586 64.5500 2059.1800 0.031 935.92182057 935.92182057
self 3.4500 6.5600 0.526 0.00000000 0.00000000

Back to top





CPLEX-BARRIER: optimal -- CLP: fail    Back to top

Modelname Time (CPLEX-BARRIER) Time (CLP) Ratio (CPLEX-BARRIER/CLP) Obj (CPLEX-BARRIER) Status (CLP)
nug15 52.6600 3600.3300 --- 1040.99404096 mstat(14) sstat( 3)
qap15 48.4700 3600.4300 --- 1040.99404096 mstat(14) sstat( 3)
nug20 864.2800 3600.1600 --- 2181.60332164 mstat(14) sstat( 3)
rail4284 152.6600 3602.7800 --- 1054.05449127 mstat(14) sstat( 3)

Back to top





CPLEX-BARRIER: infeasible -- CLP: infeasible    Back to top

Modelname Time (CPLEX-BARRIER) Time (CLP) Ratio (CPLEX-BARRIER/CLP) Status (CPLEX-BARRIER) Status (CLP)
bgindy 0.2700 0.0500 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)
gosh 0.9000 0.8800 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)

Back to top





CPLEX-BARRIER: fail -- CLP: infeasible    Back to top

Modelname Time (CPLEX-BARRIER) Time (CLP) Ratio (CPLEX-BARRIER/CLP) Status (CPLEX-BARRIER) Status (CLP)
lpl1 NA 0.5200 --- mstat(13) sstat(13) mstat(19) sstat( 1)
sgpf5y6 NA 14.7300 --- mstat(13) sstat(13) mstat(19) sstat( 1)

Back to top





CPLEX-BARRIER: fail -- CLP: fail    Back to top

Modelname Time (CPLEX-BARRIER) Time (CLP) Ratio (CPLEX-BARRIER/CLP) Status (CPLEX-BARRIER) Status (CLP)
nug30 178.3800 3606.7000 --- mstat(14) sstat( 4) mstat(14) sstat( 3)

Back to top





CPLEX-BARRIER: optimal:     Back to top

Modelname Time (CPLEX-BARRIER) Obj (CPLEX-BARRIER)
aa01 0.7300 55535.43638822
aa03 0.5800 49616.36363636
air02 0.1200 7640.00000000
air06 0.5700 49616.36363636
baxter 2.9500 56007255.67225311
car4 0.4200 35.46037017
cari 0.0400 581.89305779
co5 0.7600 714469.55375789
co9 2.2200 946920.43032251
cq5 0.6700 400133.80747262
cq9 2.1500 505541.70980727
crew1 0.1200 20.55555556
ex3sta1 1.9700 -63.07540325
fit2d 0.3400 -68464.29329383
fit2p 0.3000 68464.29329383
fome11 0.1600 0.00000000
fome12 0.3200 0.00000000
gen1 0.7000 0.00000054
gen2 2.9500 3.29279078
gen4 20.4000 0.00000084
jendrec1 0.9000 7028.46051135
ken-11 0.3800 -6972382262.51996900
ken-13 1.0700 -1.0257394789482E+10
l30 27.3600 0.95266138
lp22 4.2000 458.94459411
lpl3 1.2300 27318.00000000
maros-r7 1.1500 1497185.16647964
mod2 6.5500 27737371.36445580
model10 1.6200 -154599.62122930
model11 0.5100 0.00000000
model5 0.7200 -858440.72907149
model7 0.4800 49380.08549628
model9 0.3400 -141123.09360707
nemspmm1 0.5700 -327415.83567076
nemspmm2 0.7100 -291794.83608908
nemswrld 3.1400 260.30896600
nsir1 1.3100 -28909033.00000000
nsir2 1.4600 -27175593.50000000
nug15 52.6600 1040.99404096
osa-07 0.2700 535722.51729935
p010 1.0100 1115047.91511082
p05 0.3500 556000.27662588
pcb3000 0.5400 137416.41961282
pds-06 1.1600 27761037600.00000000
pds-10 4.1500 26727094976.00000000
pilot87 2.4700 301.71034733
qap15 48.4700 1040.99404096
r05 0.3800 557831.85904066
rat1 0.2700 1999531.66287928
rat5 0.6300 3083707.01043842
rosen10 0.1800 -174215.45613870
scfxm1-2b-64 1.6400 2877.56386371
scfxm1-2r-64 0.7700 2877.56386371
scfxm1-2r-96 1.5400 2891.70611371
scrs8-2r-512 0.1500 1074.09934157
scsd8-2b-64 0.4300 15.99866803
scsd8-2c-64 0.5200 14.99923200
scsd8-2r-108 0.9200 23.70000000
scsd8-2r-216 1.5400 23.39998576
sctap1-2b-64 0.5000 484.56000000
slptsk 1.5200 29.89536602
south31 0.8200 1818940197.10106000
stocfor3 0.6500 -39976.78394365
testbig 0.3000 -60.42296073
ulevimin 3.9700 -5191101861.43196900
wood1p 0.1000 1.44290241
world 6.3800 40364873.11417350
bas1lp 9.5200 363.00000000
cre-b 2.3800 23129639.88683240
cre-d 1.8000 24454969.76454920
fome13 0.6700 0.00000000
fome20 16.5100 23821658640.00000000
fome21 42.7700 47346318912.00000000
ken-18 7.1800 -5.2217025287397E+10
kl02 0.3800 215.25000000
nemsemm2 0.7800 581079.57090469
nsct1 72.8100 -38922436.00000000
nsct2 48.6600 -37175082.00000000
nug20 864.2800 2181.60332164
osa-14 0.6500 1106462.84473625
osa-30 1.7400 2142139.87320976
pds-20 16.5300 23821658640.00000000
pds-30 43.6900 21385445736.00000000
pds-40 93.6200 18855198824.00000000
pds-50 135.6900 16603525724.00000000
pds-60 192.1500 14265904407.00000000
rail507 1.3600 172.14556668
rail516 0.9800 182.00000000
rail582 1.4000 209.71223296
rat7a 3.6600 2074371.41572829
rlfddd 1.9300 -13.00000000
rlfdual 7.9900 -1.00000000
rlfprim 2.6800 1.00000000
route 4.5600 5941.65027667
scfxm1-2r-256 3.8700 2891.70611371
scsd8-2r-432 1.1900 25.79999802
sctap1-2r-480 1.1500 248.50000000
t0331-4l 1.8400 29730.03335194
us04 0.3700 17731.66666667
watson_1 35.8300 -1609.27855376
dbic1 37.1500 -9768973.00000000
dbir1 29.7200 -8106707.00000000
dbir2 22.0200 -6116916.50000000
nemsemm1 4.2200 512959.60078798
nw14 3.4300 61844.00000000
osa-60 3.9700 4044072.50315742
pds-100 537.2500 10928229968.00000000
pds-70 274.7000 12241162812.00000000
pds-80 337.3500 11469077462.00000000
pds-90 375.3800 11087561635.00000000
rail2586 64.5500 935.92182057
rail4284 152.6600 1054.05449127
self 3.4500 0.00000000

Back to top





CPLEX-BARRIER: infeasible:     Back to top

Modelname Time (CPLEX-BARRIER) Status (CPLEX-BARRIER)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)

Back to top





CPLEX-BARRIER: fail:     Back to top

Modelname Time (CPLEX-BARRIER) Status (CPLEX-BARRIER)
lpl1 -- mstat(13) sstat(13)
sgpf5y6 -- mstat(13) sstat(13)
nug30 -- mstat(14) sstat( 4)

Back to top





CLP: optimal:     Back to top

Modelname Time (CLP) Obj (CLP)
aa01 1.9600 55535.43638822
aa03 1.1000 49616.36363636
air02 0.0600 7640.00000000
air06 1.1100 49616.36363636
baxter 1.0300 56007255.67225311
car4 1.5900 35.46037017
cari 0.3400 581.89305779
co5 2.9400 714469.55375105
co9 13.9500 946920.43028456
cq5 1.3300 400133.80747262
cq9 6.5100 505541.70980727
crew1 0.1600 20.55555556
ex3sta1 123.2200 -63.07540325
fit2d 3.5100 -68464.29329383
fit2p 4.0700 68464.29329383
fome11 0.2400 0.00000000
fome12 0.4800 0.00000000
gen1 1.2100 0.00000122
gen2 46.6100 3.29279078
gen4 62.6100 0.00000285
jendrec1 2.6900 7028.46051135
ken-11 0.4700 -6972382262.51996900
ken-13 1.3000 -1.0257394789482E+10
l30 17.8900 0.95266142
lp22 34.1800 458.94459411
lpl3 0.8100 27318.00000000
maros-r7 2.9100 1497185.16647964
mod2 5.6000 27737371.36444000
model10 27.4100 -154599.62130064
model11 2.6500 0.00000000
model5 3.9200 -858440.72907343
model7 2.7100 49380.08549287
model9 1.6300 -141123.09361336
nemspmm1 3.3600 -327415.83567076
nemspmm2 3.4000 -291794.83608908
nemswrld 50.8000 260.30896600
nsir1 0.3200 -28909033.00000000
nsir2 0.5000 -27175593.50000000
osa-07 0.2600 535722.51729935
p010 0.9200 1115047.91511082
p05 0.3400 556000.27662588
pcb3000 0.7500 137416.41961282
pds-06 0.4400 27761037600.00000000
pds-10 1.0000 26727094976.00000000
pilot87 12.5300 301.71036566
r05 0.3800 557831.85904066
rat1 0.4100 1999531.66287928
rat5 1.5200 3083707.01043841
rosen10 0.1300 -174215.45613870
scfxm1-2b-64 3.7000 2877.56386371
scfxm1-2r-64 1.1200 2877.56386371
scfxm1-2r-96 2.2800 2891.70611371
scrs8-2r-512 0.2100 1074.09934157
scsd8-2b-64 0.3700 15.99866803
scsd8-2c-64 0.4000 14.99923200
scsd8-2r-108 0.1200 23.69999434
scsd8-2r-216 0.3000 23.39998388
sctap1-2b-64 0.8800 484.56000000
slptsk 2.0800 29.89536602
south31 30.4900 1818940197.10106000
stocfor3 1.1100 -39976.78394365
testbig 1.0100 -60.42296073
ulevimin 33.3700 -5191101861.43196900
wood1p 0.1200 1.44290241
world 6.3600 40364873.11417430
bas1lp 2.0700 363.00000000
cre-b 3.1700 23129639.88683240
cre-d 1.9600 24454969.76454920
fome13 1.0100 0.00000000
fome20 4.3100 23821658640.00000000
fome21 9.1500 47346318912.00000000
ken-18 8.4400 -5.2217025287397E+10
kl02 0.5500 215.25000000
nemsemm2 0.8700 581079.57090469
nsct1 1.2100 -38922436.00000000
nsct2 2.0400 -37175082.00000000
osa-14 0.8200 1106462.84473625
osa-30 1.6500 2142139.87320976
pds-20 4.2100 23821658640.00000000
pds-30 10.0100 21385445736.00000000
pds-40 18.3800 18855198824.00000000
pds-50 26.3100 16603525724.00000000
pds-60 39.7900 14265904407.00000000
rail507 11.0000 172.14556668
rail516 3.6300 182.00000000
rail582 7.8600 209.71223296
rat7a 20.9300 2074371.41572828
rlfddd 0.3200 -13.00000000
rlfdual 60.2200 -1.00000000
rlfprim 1.1900 1.00000000
route 0.4000 5941.65027667
scfxm1-2r-256 16.2800 2891.70611371
scsd8-2r-432 0.8500 25.79996945
sctap1-2r-480 2.0500 248.50000000
t0331-4l 18.0500 29730.03335194
us04 6.4800 17731.66666667
watson_1 104.6500 -1609.28071548
dbic1 306.5800 -9768973.00000000
dbir1 3.9100 -8106707.00000000
dbir2 3.0800 -6116916.50000000
nemsemm1 2.8700 512959.60078798
nw14 2.7800 61844.00000000
osa-60 5.9400 4044072.50315751
pds-100 90.0600 10928229968.00000000
pds-70 53.7600 12241162812.00000000
pds-80 71.0200 11469077462.00000000
pds-90 76.1900 11087561635.00000000
rail2586 2059.1800 935.92182057
self 6.5600 0.00000000

Back to top





CLP: infeasible:     Back to top

Modelname Time (CLP) Status (CLP)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
lpl1 -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





CLP: fail:     Back to top

Modelname Time (CLP) Status (CLP)
nug15 -- mstat(14) sstat( 3)
qap15 -- mstat(14) sstat( 3)
nug20 -- mstat(14) sstat( 3)
nug30 -- mstat(14) sstat( 3)
rail4284 -- mstat(14) sstat( 3)

Back to top