Solver Square Comparison: Considers all models.

Date / Time: 01/07/08 20:11:19


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX11 is represented on the left (rows) and solver CLP on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :1-CPLEX-0.trc
Tracefile 2 :4-CBC-0.trc
Solvers used : CPLEX11
CLP
Modeltype(s)   LP



CLP:
optimal
CLP:
locally optimal
CLP:
feasible
CLP:
infeasible
CLP:
unbounded
CLP:
fail
CLP:
no data
total CPLEX11
CPLEX11:
optimal
109 - - - - 3 - 112
CPLEX11:
locally optimal
- - - - - - - -
CPLEX11:
feasible
- - - - - - - -
CPLEX11:
infeasible
- - - 4 - - - 4
CPLEX11:
unbounded
- - - - - - - -
CPLEX11:
fail
- - - - - 2 - 2
CPLEX11:
no data
- - - - - - - -
total CLP 109 - - 4 - 5 - 118




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CPLEX11: optimal -- CLP: optimal    Back to top

Modelname Time (CPLEX11) Time (CLP) Ratio (CPLEX11/CLP) Obj (CPLEX11) Obj (CLP)
aa01 1.5800 1.8300 0.863 55535.43638822 55535.43638822
aa03 0.8400 1.0400 0.808 49616.36363636 49616.36363636
air02 0.0600 0.0700 0.857 7640.00000000 7640.00000000
air06 0.8400 1.0500 0.800 49616.36363636 49616.36363636
baxter 0.8400 0.9400 0.894 56007255.67225311 56007255.67225311
car4 0.4200 1.4000 0.300 35.46037017 35.46037017
cari 0.1000 0.3300 0.303 581.89305779 581.89305779
co5 1.5300 2.6600 0.575 714469.55375105 714469.55375105
co9 6.4400 11.5400 0.558 946920.43028456 946920.43028456
cq5 1.1800 1.2300 0.959 400133.80747262 400133.80747262
cq9 3.5500 5.6000 0.634 505541.70980727 505541.70980727
crew1 0.2100 0.1600 1.313 20.55555556 20.55555556
ex3sta1 19.1400 104.6300 0.183 -63.07540325 -63.07540325
fit2d 0.4100 3.4700 0.118 -68464.29329383 -68464.29329383
fit2p 2.1300 3.7700 0.565 68464.29329383 68464.29329383
fome11 0.1800 0.1900 0.947 0.00000000 0.00000000
fome12 0.3400 0.4100 0.829 0.00000000 0.00000000
gen1 0.1200 1.1400 0.105 0.00000000 0.00000122
gen2 9.6300 41.9100 0.230 3.29279078 3.29279078
gen4 0.8600 54.4500 0.016 0.00000000 0.00000285
jendrec1 0.9600 2.6200 0.366 7028.46051135 7028.46051135
ken-11 0.2700 0.4200 0.643 -6972382262.51996900 -6972382262.51996900
ken-13 0.7800 1.1600 0.672 -1.0257394789482E+10 -1.0257394789482E+10
l30 12.7500 14.9300 0.854 0.95266138 0.95266142
lp22 17.3600 29.7100 0.584 458.94459411 458.94459411
lpl3 1.0100 0.7400 1.365 27318.00000000 27318.00000000
maros-r7 1.3800 2.5500 0.541 1497185.16647964 1497185.16647964
mod2 3.1200 4.7800 0.653 27737371.36444540 27737371.36444000
model10 7.2500 24.0000 0.302 -154599.62127674 -154599.62130064
model11 0.4600 2.3300 0.197 0.00000000 0.00000000
model5 2.2600 3.6300 0.623 -858440.72907282 -858440.72907343
model7 1.8900 2.5600 0.738 49380.08549287 49380.08549287
model9 0.7200 1.5300 0.471 -141123.09361307 -141123.09361336
nemspmm1 2.3200 3.1300 0.741 -327415.83567076 -327415.83567076
nemspmm2 2.2400 3.1200 0.718 -291794.83608908 -291794.83608908
nemswrld 23.5500 43.4300 0.542 260.30896600 260.30896600
nsir1 0.1000 0.3200 0.313 -28909033.00000000 -28909033.00000000
nsir2 0.2600 0.4900 0.531 -27175593.50000000 -27175593.50000000
osa-07 0.2000 0.2500 0.800 535722.51729935 535722.51729935
p010 0.5000 0.8600 0.581 1115047.91511082 1115047.91511082
p05 0.2400 0.3400 0.706 556000.27662588 556000.27662588
pcb3000 0.4900 0.6900 0.710 137416.41961282 137416.41961282
pds-06 0.3000 0.4100 0.732 27761037600.00000000 27761037600.00000000
pds-10 0.6200 0.8900 0.697 26727094976.00000000 26727094976.00000000
pilot87 8.0600 10.9100 0.739 301.71061586 301.71036566
r05 0.2600 0.3400 0.765 557831.85904066 557831.85904066
rat1 0.3200 0.3900 0.821 1999531.66287928 1999531.66287928
rat5 0.9000 1.3900 0.647 3083707.01043842 3083707.01043841
rosen10 0.2800 0.1400 2.000 -174215.45613870 -174215.45613870
scfxm1-2b-64 1.4000 3.2800 0.427 2877.56386371 2877.56386371
scfxm1-2r-64 0.9500 1.0300 0.922 2877.56386371 2877.56386371
scfxm1-2r-96 1.1200 2.0400 0.549 2891.70611371 2891.70611371
scrs8-2r-512 0.1600 0.1900 0.842 1074.09934157 1074.09934157
scsd8-2b-64 0.2600 0.3700 0.703 15.99866803 15.99866803
scsd8-2c-64 0.2800 0.3700 0.757 14.99923200 14.99923200
scsd8-2r-108 0.1100 0.1000 1.100 23.69999446 23.69999434
scsd8-2r-216 0.2300 0.2600 0.885 23.39998388 23.39998388
sctap1-2b-64 0.2800 0.8200 0.341 484.56000000 484.56000000
slptsk 0.8000 1.9700 0.406 29.89536602 29.89536602
south31 36.1200 25.5100 1.416 1818940197.10106000 1818940197.10106000
stocfor3 0.7200 1.0100 0.713 -39976.78394365 -39976.78394365
testbig 0.2400 0.9400 0.255 -60.42296073 -60.42296073
ulevimin 11.4800 29.5800 0.388 -5191101861.43196900 -5191101861.43196900
wood1p 0.0600 0.1200 0.500 1.44290241 1.44290241
world 2.6200 5.4000 0.485 40364873.11413520 40364873.11417430
bas1lp 8.1100 1.8000 4.506 363.00000000 363.00000000
cre-b 1.6800 2.8700 0.585 23129639.88683240 23129639.88683240
cre-d 0.9400 1.8100 0.519 24454969.76454920 24454969.76454920
fome13 0.6300 0.9200 0.685 0.00000000 0.00000000
fome20 2.9600 3.7100 0.798 23821658640.00000000 23821658640.00000000
fome21 7.8200 7.9000 0.990 47346318912.00000000 47346318912.00000000
ken-18 5.0500 7.4400 0.679 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.3000 0.5100 0.588 215.25000000 215.25000000
nemsemm2 0.4900 0.7900 0.620 581079.57090469 581079.57090469
nsct1 0.4900 1.1400 0.430 -38922436.00000000 -38922436.00000000
nsct2 0.8700 1.9300 0.451 -37175082.00000000 -37175082.00000000
osa-14 0.4500 0.7300 0.616 1106462.84473625 1106462.84473625
osa-30 1.0600 1.5200 0.697 2142139.87320976 2142139.87320976
pds-20 2.9800 3.7000 0.805 23821658640.00000000 23821658640.00000000
pds-30 6.5800 8.5900 0.766 21385445736.00000000 21385445736.00000000
pds-40 11.1400 15.5800 0.715 18855198824.00000000 18855198824.00000000
pds-50 18.1700 22.1600 0.820 16603525724.00000000 16603525724.00000000
pds-60 26.6000 33.3700 0.797 14265904407.00000000 14265904407.00000000
rail507 5.3500 9.4500 0.566 172.14556668 172.14556668
rail516 2.4300 3.2100 0.757 182.00000000 182.00000000
rail582 3.3600 6.9000 0.487 209.71223296 209.71223296
rat7a 6.6500 18.4500 0.360 2074371.41572829 2074371.41572828
rlfddd 0.3600 0.3200 1.125 -13.00000000 -13.00000000
rlfdual 5.1500 50.8800 0.101 -1.00000000 -1.00000000
rlfprim 0.7800 2.0700 0.377 1.00000000 1.00000000
route 0.3200 0.3700 0.865 5941.65027667 5941.65027667
scfxm1-2r-256 5.9200 13.3600 0.443 2891.70611371 2891.70611371
scsd8-2r-432 0.5400 0.7500 0.720 25.79996956 25.79996945
sctap1-2r-480 0.8400 1.9000 0.442 248.50000000 248.50000000
t0331-4l 11.7100 16.0400 0.730 29730.03335194 29730.03335194
us04 0.3200 6.3100 0.051 17731.66666667 17731.66666667
watson_1 15.4400 86.4600 0.179 -1609.28079835 -1609.28071548
dbic1 63.0600 266.5700 0.237 -9768973.00000000 -9768973.00000000
dbir1 0.7800 3.4500 0.226 -8106707.00000000 -8106707.00000000
dbir2 1.2800 2.8400 0.451 -6116916.50000000 -6116916.50000000
nemsemm1 1.0200 2.7300 0.374 512959.60078798 512959.60078798
nw14 1.0000 2.6300 0.380 61844.00000000 61844.00000000
osa-60 2.6900 4.9300 0.546 4044072.50315742 4044072.50315751
pds-100 53.8100 75.0000 0.717 10928229968.00000000 10928229968.00000000
pds-70 34.4900 44.7900 0.770 12241162812.00000000 12241162812.00000000
pds-80 44.2700 59.1600 0.748 11469077462.00000000 11469077462.00000000
pds-90 52.9900 63.8900 0.829 11087561635.00000000 11087561635.00000000
rail2586 974.3800 1743.5600 0.559 935.92182057 935.92182057
self 5.4800 5.7900 0.946 0.00000000 0.00000000

Back to top





CPLEX11: optimal -- CLP: fail    Back to top

Modelname Time (CPLEX11) Time (CLP) Ratio (CPLEX11/CLP) Obj (CPLEX11) Status (CLP)
nug15 1338.4500 3600.1700 --- 1040.99404096 mstat(14) sstat( 3)
qap15 1304.2100 3600.4100 --- 1040.99404096 mstat(14) sstat( 3)
rail4284 2431.5700 3602.5400 --- 1054.05449127 mstat(14) sstat( 3)

Back to top





CPLEX11: infeasible -- CLP: infeasible    Back to top

Modelname Time (CPLEX11) Time (CLP) Ratio (CPLEX11/CLP) Status (CPLEX11) Status (CLP)
bgindy 0.1300 0.0500 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)
gosh 1.0000 0.8100 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)
lpl1 35.5700 0.5000 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)
sgpf5y6 24.3500 12.7900 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)

Back to top





CPLEX11: fail -- CLP: fail    Back to top

Modelname Time (CPLEX11) Time (CLP) Ratio (CPLEX11/CLP) Status (CPLEX11) Status (CLP)
nug20 3604.0600 3600.1900 --- mstat( 6) sstat( 3) mstat(14) sstat( 3)
nug30 3678.4000 3600.7100 --- mstat( 6) sstat( 3) mstat(14) sstat( 3)

Back to top





CPLEX11: optimal:     Back to top

Modelname Time (CPLEX11) Obj (CPLEX11)
aa01 1.5800 55535.43638822
aa03 0.8400 49616.36363636
air02 0.0600 7640.00000000
air06 0.8400 49616.36363636
baxter 0.8400 56007255.67225311
car4 0.4200 35.46037017
cari 0.1000 581.89305779
co5 1.5300 714469.55375105
co9 6.4400 946920.43028456
cq5 1.1800 400133.80747262
cq9 3.5500 505541.70980727
crew1 0.2100 20.55555556
ex3sta1 19.1400 -63.07540325
fit2d 0.4100 -68464.29329383
fit2p 2.1300 68464.29329383
fome11 0.1800 0.00000000
fome12 0.3400 0.00000000
gen1 0.1200 0.00000000
gen2 9.6300 3.29279078
gen4 0.8600 0.00000000
jendrec1 0.9600 7028.46051135
ken-11 0.2700 -6972382262.51996900
ken-13 0.7800 -1.0257394789482E+10
l30 12.7500 0.95266138
lp22 17.3600 458.94459411
lpl3 1.0100 27318.00000000
maros-r7 1.3800 1497185.16647964
mod2 3.1200 27737371.36444540
model10 7.2500 -154599.62127674
model11 0.4600 0.00000000
model5 2.2600 -858440.72907282
model7 1.8900 49380.08549287
model9 0.7200 -141123.09361307
nemspmm1 2.3200 -327415.83567076
nemspmm2 2.2400 -291794.83608908
nemswrld 23.5500 260.30896600
nsir1 0.1000 -28909033.00000000
nsir2 0.2600 -27175593.50000000
nug15 1338.4500 1040.99404096
osa-07 0.2000 535722.51729935
p010 0.5000 1115047.91511082
p05 0.2400 556000.27662588
pcb3000 0.4900 137416.41961282
pds-06 0.3000 27761037600.00000000
pds-10 0.6200 26727094976.00000000
pilot87 8.0600 301.71061586
qap15 1304.2100 1040.99404096
r05 0.2600 557831.85904066
rat1 0.3200 1999531.66287928
rat5 0.9000 3083707.01043842
rosen10 0.2800 -174215.45613870
scfxm1-2b-64 1.4000 2877.56386371
scfxm1-2r-64 0.9500 2877.56386371
scfxm1-2r-96 1.1200 2891.70611371
scrs8-2r-512 0.1600 1074.09934157
scsd8-2b-64 0.2600 15.99866803
scsd8-2c-64 0.2800 14.99923200
scsd8-2r-108 0.1100 23.69999446
scsd8-2r-216 0.2300 23.39998388
sctap1-2b-64 0.2800 484.56000000
slptsk 0.8000 29.89536602
south31 36.1200 1818940197.10106000
stocfor3 0.7200 -39976.78394365
testbig 0.2400 -60.42296073
ulevimin 11.4800 -5191101861.43196900
wood1p 0.0600 1.44290241
world 2.6200 40364873.11413520
bas1lp 8.1100 363.00000000
cre-b 1.6800 23129639.88683240
cre-d 0.9400 24454969.76454920
fome13 0.6300 0.00000000
fome20 2.9600 23821658640.00000000
fome21 7.8200 47346318912.00000000
ken-18 5.0500 -5.2217025287397E+10
kl02 0.3000 215.25000000
nemsemm2 0.4900 581079.57090469
nsct1 0.4900 -38922436.00000000
nsct2 0.8700 -37175082.00000000
osa-14 0.4500 1106462.84473625
osa-30 1.0600 2142139.87320976
pds-20 2.9800 23821658640.00000000
pds-30 6.5800 21385445736.00000000
pds-40 11.1400 18855198824.00000000
pds-50 18.1700 16603525724.00000000
pds-60 26.6000 14265904407.00000000
rail507 5.3500 172.14556668
rail516 2.4300 182.00000000
rail582 3.3600 209.71223296
rat7a 6.6500 2074371.41572829
rlfddd 0.3600 -13.00000000
rlfdual 5.1500 -1.00000000
rlfprim 0.7800 1.00000000
route 0.3200 5941.65027667
scfxm1-2r-256 5.9200 2891.70611371
scsd8-2r-432 0.5400 25.79996956
sctap1-2r-480 0.8400 248.50000000
t0331-4l 11.7100 29730.03335194
us04 0.3200 17731.66666667
watson_1 15.4400 -1609.28079835
dbic1 63.0600 -9768973.00000000
dbir1 0.7800 -8106707.00000000
dbir2 1.2800 -6116916.50000000
nemsemm1 1.0200 512959.60078798
nw14 1.0000 61844.00000000
osa-60 2.6900 4044072.50315742
pds-100 53.8100 10928229968.00000000
pds-70 34.4900 12241162812.00000000
pds-80 44.2700 11469077462.00000000
pds-90 52.9900 11087561635.00000000
rail2586 974.3800 935.92182057
rail4284 2431.5700 1054.05449127
self 5.4800 0.00000000

Back to top





CPLEX11: infeasible:     Back to top

Modelname Time (CPLEX11) Status (CPLEX11)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)
lpl1 -- mstat( 4) sstat( 1)
sgpf5y6 -- mstat( 4) sstat( 1)

Back to top





CPLEX11: fail:     Back to top

Modelname Time (CPLEX11) Status (CPLEX11)
nug20 -- mstat( 6) sstat( 3)
nug30 -- mstat( 6) sstat( 3)

Back to top





CLP: optimal:     Back to top

Modelname Time (CLP) Obj (CLP)
aa01 1.8300 55535.43638822
aa03 1.0400 49616.36363636
air02 0.0700 7640.00000000
air06 1.0500 49616.36363636
baxter 0.9400 56007255.67225311
car4 1.4000 35.46037017
cari 0.3300 581.89305779
co5 2.6600 714469.55375105
co9 11.5400 946920.43028456
cq5 1.2300 400133.80747262
cq9 5.6000 505541.70980727
crew1 0.1600 20.55555556
ex3sta1 104.6300 -63.07540325
fit2d 3.4700 -68464.29329383
fit2p 3.7700 68464.29329383
fome11 0.1900 0.00000000
fome12 0.4100 0.00000000
gen1 1.1400 0.00000122
gen2 41.9100 3.29279078
gen4 54.4500 0.00000285
jendrec1 2.6200 7028.46051135
ken-11 0.4200 -6972382262.51996900
ken-13 1.1600 -1.0257394789482E+10
l30 14.9300 0.95266142
lp22 29.7100 458.94459411
lpl3 0.7400 27318.00000000
maros-r7 2.5500 1497185.16647964
mod2 4.7800 27737371.36444000
model10 24.0000 -154599.62130064
model11 2.3300 0.00000000
model5 3.6300 -858440.72907343
model7 2.5600 49380.08549287
model9 1.5300 -141123.09361336
nemspmm1 3.1300 -327415.83567076
nemspmm2 3.1200 -291794.83608908
nemswrld 43.4300 260.30896600
nsir1 0.3200 -28909033.00000000
nsir2 0.4900 -27175593.50000000
osa-07 0.2500 535722.51729935
p010 0.8600 1115047.91511082
p05 0.3400 556000.27662588
pcb3000 0.6900 137416.41961282
pds-06 0.4100 27761037600.00000000
pds-10 0.8900 26727094976.00000000
pilot87 10.9100 301.71036566
r05 0.3400 557831.85904066
rat1 0.3900 1999531.66287928
rat5 1.3900 3083707.01043841
rosen10 0.1400 -174215.45613870
scfxm1-2b-64 3.2800 2877.56386371
scfxm1-2r-64 1.0300 2877.56386371
scfxm1-2r-96 2.0400 2891.70611371
scrs8-2r-512 0.1900 1074.09934157
scsd8-2b-64 0.3700 15.99866803
scsd8-2c-64 0.3700 14.99923200
scsd8-2r-108 0.1000 23.69999434
scsd8-2r-216 0.2600 23.39998388
sctap1-2b-64 0.8200 484.56000000
slptsk 1.9700 29.89536602
south31 25.5100 1818940197.10106000
stocfor3 1.0100 -39976.78394365
testbig 0.9400 -60.42296073
ulevimin 29.5800 -5191101861.43196900
wood1p 0.1200 1.44290241
world 5.4000 40364873.11417430
bas1lp 1.8000 363.00000000
cre-b 2.8700 23129639.88683240
cre-d 1.8100 24454969.76454920
fome13 0.9200 0.00000000
fome20 3.7100 23821658640.00000000
fome21 7.9000 47346318912.00000000
ken-18 7.4400 -5.2217025287397E+10
kl02 0.5100 215.25000000
nemsemm2 0.7900 581079.57090469
nsct1 1.1400 -38922436.00000000
nsct2 1.9300 -37175082.00000000
osa-14 0.7300 1106462.84473625
osa-30 1.5200 2142139.87320976
pds-20 3.7000 23821658640.00000000
pds-30 8.5900 21385445736.00000000
pds-40 15.5800 18855198824.00000000
pds-50 22.1600 16603525724.00000000
pds-60 33.3700 14265904407.00000000
rail507 9.4500 172.14556668
rail516 3.2100 182.00000000
rail582 6.9000 209.71223296
rat7a 18.4500 2074371.41572828
rlfddd 0.3200 -13.00000000
rlfdual 50.8800 -1.00000000
rlfprim 2.0700 1.00000000
route 0.3700 5941.65027667
scfxm1-2r-256 13.3600 2891.70611371
scsd8-2r-432 0.7500 25.79996945
sctap1-2r-480 1.9000 248.50000000
t0331-4l 16.0400 29730.03335194
us04 6.3100 17731.66666667
watson_1 86.4600 -1609.28071548
dbic1 266.5700 -9768973.00000000
dbir1 3.4500 -8106707.00000000
dbir2 2.8400 -6116916.50000000
nemsemm1 2.7300 512959.60078798
nw14 2.6300 61844.00000000
osa-60 4.9300 4044072.50315751
pds-100 75.0000 10928229968.00000000
pds-70 44.7900 12241162812.00000000
pds-80 59.1600 11469077462.00000000
pds-90 63.8900 11087561635.00000000
rail2586 1743.5600 935.92182057
self 5.7900 0.00000000

Back to top





CLP: infeasible:     Back to top

Modelname Time (CLP) Status (CLP)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
lpl1 -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





CLP: fail:     Back to top

Modelname Time (CLP) Status (CLP)
nug15 -- mstat(14) sstat( 3)
qap15 -- mstat(14) sstat( 3)
nug20 -- mstat(14) sstat( 3)
nug30 -- mstat(14) sstat( 3)
rail4284 -- mstat(14) sstat( 3)

Back to top