Solver Square Comparison: Considers all models.

Date / Time: 09/02/07 12:03:57


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX is represented on the left (rows) and solver CLP on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :1-CPLEX-0.trc
Tracefile 2 :2-CBC-0.trc
Solvers used : CPLEX
CLP
Modeltype(s)   LP



CLP:
optimal
CLP:
locally optimal
CLP:
feasible
CLP:
infeasible
CLP:
unbounded
CLP:
fail
CLP:
no data
total CPLEX
CPLEX:
optimal
109 - - - - 3 - 112
CPLEX:
locally optimal
- - - - - - - -
CPLEX:
feasible
- - - - - - - -
CPLEX:
infeasible
- - - 4 - - - 4
CPLEX:
unbounded
- - - - - - - -
CPLEX:
fail
- - - - - 2 - 2
CPLEX:
no data
- - - - - - - -
total CLP 109 - - 4 - 5 - 118




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5
infeasible4 or 5 or 19 1
unbounded3 or 18 1
fail all other all other




Solver Resource Times


CPLEX: optimal -- CLP: optimal    Back to top

Modelname Time (CPLEX) Time (CLP) Ratio (CPLEX/CLP) Obj (CPLEX) Obj (CLP)
aa01 1.5400 1.9600 0.786 55535.43638822 55535.43638822
aa03 1.0000 1.1000 0.909 49616.36363636 49616.36363636
air02 0.0600 0.0600 1.000 7640.00000000 7640.00000000
air06 1.0200 1.1100 0.919 49616.36363636 49616.36363636
baxter 0.8500 1.0300 0.825 56007255.67225311 56007255.67225311
car4 0.4100 1.5900 0.258 35.46037017 35.46037017
cari 0.0600 0.3400 0.176 581.89305779 581.89305779
co5 1.3700 2.9400 0.466 714469.55375105 714469.55375105
co9 6.6700 13.9500 0.478 946920.43028456 946920.43028456
cq5 1.2000 1.3300 0.902 400133.80747262 400133.80747262
cq9 4.3800 6.5100 0.673 505541.70980727 505541.70980727
crew1 0.2000 0.1600 1.250 20.55555556 20.55555556
ex3sta1 21.2200 123.2200 0.172 -63.07540325 -63.07540325
fit2d 0.4200 3.5100 0.120 -68464.29329383 -68464.29329383
fit2p 2.2000 4.0700 0.541 68464.29329383 68464.29329383
fome11 0.1500 0.2400 0.625 0.00000000 0.00000000
fome12 0.3200 0.4800 0.667 0.00000000 0.00000000
gen1 0.1300 1.2100 0.107 0.00000000 0.00000122
gen2 8.9200 46.6100 0.191 3.29279078 3.29279078
gen4 0.8100 62.6100 0.013 0.00000000 0.00000285
jendrec1 0.9500 2.6900 0.353 7028.46051135 7028.46051135
ken-11 0.2700 0.4700 0.574 -6972382262.51996900 -6972382262.51996900
ken-13 0.7800 1.3000 0.600 -1.0257394789482E+10 -1.0257394789482E+10
l30 11.9900 17.8900 0.670 0.95266133 0.95266142
lp22 17.4800 34.1800 0.511 458.94459411 458.94459411
lpl3 0.9800 0.8100 1.210 27318.00000000 27318.00000000
maros-r7 1.3900 2.9100 0.478 1497185.16647964 1497185.16647964
mod2 2.7600 5.6000 0.493 27737371.36444530 27737371.36444000
model10 7.0000 27.4100 0.255 -154599.62130064 -154599.62130064
model11 0.4600 2.6500 0.174 0.00000000 0.00000000
model5 1.8600 3.9200 0.474 -858440.72907343 -858440.72907343
model7 2.8100 2.7100 1.037 49380.08549287 49380.08549287
model9 0.7200 1.6300 0.442 -141123.09361215 -141123.09361336
nemspmm1 2.4400 3.3600 0.726 -327415.83567077 -327415.83567076
nemspmm2 2.3200 3.4000 0.682 -291794.83608908 -291794.83608908
nemswrld 23.3900 50.8000 0.460 260.30896600 260.30896600
nsir1 0.0900 0.3200 0.281 -28909033.00000000 -28909033.00000000
nsir2 0.2500 0.5000 0.500 -27175593.50000000 -27175593.50000000
osa-07 0.1800 0.2600 0.692 535722.51729935 535722.51729935
p010 0.5200 0.9200 0.565 1115047.91511082 1115047.91511082
p05 0.2400 0.3400 0.706 556000.27662588 556000.27662588
pcb3000 0.4800 0.7500 0.640 137416.41961282 137416.41961282
pds-06 0.2700 0.4400 0.614 27761037600.00000000 27761037600.00000000
pds-10 0.6100 1.0000 0.610 26727094976.00000000 26727094976.00000000
pilot87 8.0700 12.5300 0.644 301.71035949 301.71036566
r05 0.2100 0.3800 0.553 557831.85904066 557831.85904066
rat1 0.3000 0.4100 0.732 1999531.66287928 1999531.66287928
rat5 0.9000 1.5200 0.592 3083707.01043842 3083707.01043841
rosen10 0.4000 0.1300 3.077 -174215.45613870 -174215.45613870
scfxm1-2b-64 1.6300 3.7000 0.441 2877.56386371 2877.56386371
scfxm1-2r-64 0.8200 1.1200 0.732 2877.56386371 2877.56386371
scfxm1-2r-96 1.1600 2.2800 0.509 2891.70611371 2891.70611371
scrs8-2r-512 0.1400 0.2100 0.667 1074.09934157 1074.09934157
scsd8-2b-64 0.2600 0.3700 0.703 15.99866803 15.99866803
scsd8-2c-64 0.2400 0.4000 0.600 14.99923200 14.99923200
scsd8-2r-108 0.1100 0.1200 0.917 23.69999446 23.69999434
scsd8-2r-216 0.2200 0.3000 0.733 23.39998388 23.39998388
sctap1-2b-64 0.3000 0.8800 0.341 484.56000000 484.56000000
slptsk 0.8100 2.0800 0.389 29.89536602 29.89536602
south31 39.1100 30.4900 1.283 1818940197.10106000 1818940197.10106000
stocfor3 0.6800 1.1100 0.613 -39976.78394365 -39976.78394365
testbig 0.2400 1.0100 0.238 -60.42296073 -60.42296073
ulevimin 11.8700 33.3700 0.356 -5191101861.43196900 -5191101861.43196900
wood1p 0.0500 0.1200 0.417 1.44290241 1.44290241
world 2.7900 6.3600 0.439 40364873.11413520 40364873.11417430
bas1lp 3.2000 2.0700 1.546 363.00000000 363.00000000
cre-b 1.8000 3.1700 0.568 23129639.88683240 23129639.88683240
cre-d 1.0800 1.9600 0.551 24454969.76454920 24454969.76454920
fome13 0.6600 1.0100 0.653 0.00000000 0.00000000
fome20 3.0800 4.3100 0.715 23821658640.00000000 23821658640.00000000
fome21 7.9700 9.1500 0.871 47346318912.00000000 47346318912.00000000
ken-18 5.1400 8.4400 0.609 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.2700 0.5500 0.491 215.25000000 215.25000000
nemsemm2 0.4600 0.8700 0.529 581079.57090468 581079.57090469
nsct1 0.4400 1.2100 0.364 -38922436.00000000 -38922436.00000000
nsct2 0.8300 2.0400 0.407 -37175082.00000000 -37175082.00000000
osa-14 0.5000 0.8200 0.610 1106462.84473625 1106462.84473625
osa-30 1.0500 1.6500 0.636 2142139.87320976 2142139.87320976
pds-20 3.0800 4.2100 0.732 23821658640.00000000 23821658640.00000000
pds-30 7.4100 10.0100 0.740 21385445736.00000000 21385445736.00000000
pds-40 11.7000 18.3800 0.637 18855198824.00000000 18855198824.00000000
pds-50 18.2200 26.3100 0.693 16603525724.00000000 16603525724.00000000
pds-60 25.6600 39.7900 0.645 14265904407.00000000 14265904407.00000000
rail507 5.9600 11.0000 0.542 172.14556668 172.14556668
rail516 2.5200 3.6300 0.694 182.00000000 182.00000000
rail582 3.4200 7.8600 0.435 209.71223296 209.71223296
rat7a 6.5400 20.9300 0.312 2074371.41572829 2074371.41572828
rlfddd 0.3200 0.3200 1.000 -13.00000000 -13.00000000
rlfdual 5.3400 60.2200 0.089 -1.00000000 -1.00000000
rlfprim 0.7400 1.1900 0.622 1.00000000 1.00000000
route 0.3200 0.4000 0.800 5941.65027667 5941.65027667
scfxm1-2r-256 6.6600 16.2800 0.409 2891.70611371 2891.70611371
scsd8-2r-432 0.4700 0.8500 0.553 25.79996956 25.79996945
sctap1-2r-480 0.8800 2.0500 0.429 248.50000000 248.50000000
t0331-4l 13.8400 18.0500 0.767 29730.03335194 29730.03335194
us04 0.3100 6.4800 0.048 17731.66666667 17731.66666667
watson_1 14.3400 104.6500 0.137 -1609.28079534 -1609.28071548
dbic1 66.5000 306.5800 0.217 -9768973.00000000 -9768973.00000000
dbir1 0.8100 3.9100 0.207 -8106707.00000000 -8106707.00000000
dbir2 1.2800 3.0800 0.416 -6116916.50000000 -6116916.50000000
nemsemm1 1.0400 2.8700 0.362 512959.60078798 512959.60078798
nw14 1.0100 2.7800 0.363 61844.00000000 61844.00000000
osa-60 2.4000 5.9400 0.404 4044072.50315742 4044072.50315751
pds-100 56.0300 90.0600 0.622 10928229968.00000000 10928229968.00000000
pds-70 34.4800 53.7600 0.641 12241162812.00000000 12241162812.00000000
pds-80 44.8600 71.0200 0.632 11469077462.00000000 11469077462.00000000
pds-90 54.9600 76.1900 0.721 11087561635.00000000 11087561635.00000000
rail2586 929.8800 2059.1800 0.452 935.92182057 935.92182057
self 3.8700 6.5600 0.590 0.00000000 0.00000000

Back to top





CPLEX: optimal -- CLP: fail    Back to top

Modelname Time (CPLEX) Time (CLP) Ratio (CPLEX/CLP) Obj (CPLEX) Status (CLP)
nug15 1349.7700 3600.3300 --- 1040.99404096 mstat(14) sstat( 3)
qap15 1318.5300 3600.4300 --- 1040.99404096 mstat(14) sstat( 3)
rail4284 2681.7200 3602.7800 --- 1054.05449127 mstat(14) sstat( 3)

Back to top





CPLEX: infeasible -- CLP: infeasible    Back to top

Modelname Time (CPLEX) Time (CLP) Ratio (CPLEX/CLP) Status (CPLEX) Status (CLP)
bgindy 0.1200 0.0500 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)
gosh 1.4300 0.8800 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)
lpl1 38.2100 0.5200 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)
sgpf5y6 22.9000 14.7300 --- mstat( 4) sstat( 1) mstat(19) sstat( 1)

Back to top





CPLEX: fail -- CLP: fail    Back to top

Modelname Time (CPLEX) Time (CLP) Ratio (CPLEX/CLP) Status (CPLEX) Status (CLP)
nug20 3616.8200 3600.1600 --- mstat( 6) sstat( 3) mstat(14) sstat( 3)
nug30 3674.2200 3606.7000 --- mstat( 6) sstat( 3) mstat(14) sstat( 3)

Back to top





CPLEX: optimal:     Back to top

Modelname Time (CPLEX) Obj (CPLEX)
aa01 1.5400 55535.43638822
aa03 1.0000 49616.36363636
air02 0.0600 7640.00000000
air06 1.0200 49616.36363636
baxter 0.8500 56007255.67225311
car4 0.4100 35.46037017
cari 0.0600 581.89305779
co5 1.3700 714469.55375105
co9 6.6700 946920.43028456
cq5 1.2000 400133.80747262
cq9 4.3800 505541.70980727
crew1 0.2000 20.55555556
ex3sta1 21.2200 -63.07540325
fit2d 0.4200 -68464.29329383
fit2p 2.2000 68464.29329383
fome11 0.1500 0.00000000
fome12 0.3200 0.00000000
gen1 0.1300 0.00000000
gen2 8.9200 3.29279078
gen4 0.8100 0.00000000
jendrec1 0.9500 7028.46051135
ken-11 0.2700 -6972382262.51996900
ken-13 0.7800 -1.0257394789482E+10
l30 11.9900 0.95266133
lp22 17.4800 458.94459411
lpl3 0.9800 27318.00000000
maros-r7 1.3900 1497185.16647964
mod2 2.7600 27737371.36444530
model10 7.0000 -154599.62130064
model11 0.4600 0.00000000
model5 1.8600 -858440.72907343
model7 2.8100 49380.08549287
model9 0.7200 -141123.09361215
nemspmm1 2.4400 -327415.83567077
nemspmm2 2.3200 -291794.83608908
nemswrld 23.3900 260.30896600
nsir1 0.0900 -28909033.00000000
nsir2 0.2500 -27175593.50000000
nug15 1349.7700 1040.99404096
osa-07 0.1800 535722.51729935
p010 0.5200 1115047.91511082
p05 0.2400 556000.27662588
pcb3000 0.4800 137416.41961282
pds-06 0.2700 27761037600.00000000
pds-10 0.6100 26727094976.00000000
pilot87 8.0700 301.71035949
qap15 1318.5300 1040.99404096
r05 0.2100 557831.85904066
rat1 0.3000 1999531.66287928
rat5 0.9000 3083707.01043842
rosen10 0.4000 -174215.45613870
scfxm1-2b-64 1.6300 2877.56386371
scfxm1-2r-64 0.8200 2877.56386371
scfxm1-2r-96 1.1600 2891.70611371
scrs8-2r-512 0.1400 1074.09934157
scsd8-2b-64 0.2600 15.99866803
scsd8-2c-64 0.2400 14.99923200
scsd8-2r-108 0.1100 23.69999446
scsd8-2r-216 0.2200 23.39998388
sctap1-2b-64 0.3000 484.56000000
slptsk 0.8100 29.89536602
south31 39.1100 1818940197.10106000
stocfor3 0.6800 -39976.78394365
testbig 0.2400 -60.42296073
ulevimin 11.8700 -5191101861.43196900
wood1p 0.0500 1.44290241
world 2.7900 40364873.11413520
bas1lp 3.2000 363.00000000
cre-b 1.8000 23129639.88683240
cre-d 1.0800 24454969.76454920
fome13 0.6600 0.00000000
fome20 3.0800 23821658640.00000000
fome21 7.9700 47346318912.00000000
ken-18 5.1400 -5.2217025287397E+10
kl02 0.2700 215.25000000
nemsemm2 0.4600 581079.57090468
nsct1 0.4400 -38922436.00000000
nsct2 0.8300 -37175082.00000000
osa-14 0.5000 1106462.84473625
osa-30 1.0500 2142139.87320976
pds-20 3.0800 23821658640.00000000
pds-30 7.4100 21385445736.00000000
pds-40 11.7000 18855198824.00000000
pds-50 18.2200 16603525724.00000000
pds-60 25.6600 14265904407.00000000
rail507 5.9600 172.14556668
rail516 2.5200 182.00000000
rail582 3.4200 209.71223296
rat7a 6.5400 2074371.41572829
rlfddd 0.3200 -13.00000000
rlfdual 5.3400 -1.00000000
rlfprim 0.7400 1.00000000
route 0.3200 5941.65027667
scfxm1-2r-256 6.6600 2891.70611371
scsd8-2r-432 0.4700 25.79996956
sctap1-2r-480 0.8800 248.50000000
t0331-4l 13.8400 29730.03335194
us04 0.3100 17731.66666667
watson_1 14.3400 -1609.28079534
dbic1 66.5000 -9768973.00000000
dbir1 0.8100 -8106707.00000000
dbir2 1.2800 -6116916.50000000
nemsemm1 1.0400 512959.60078798
nw14 1.0100 61844.00000000
osa-60 2.4000 4044072.50315742
pds-100 56.0300 10928229968.00000000
pds-70 34.4800 12241162812.00000000
pds-80 44.8600 11469077462.00000000
pds-90 54.9600 11087561635.00000000
rail2586 929.8800 935.92182057
rail4284 2681.7200 1054.05449127
self 3.8700 0.00000000

Back to top





CPLEX: infeasible:     Back to top

Modelname Time (CPLEX) Status (CPLEX)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)
lpl1 -- mstat( 4) sstat( 1)
sgpf5y6 -- mstat( 4) sstat( 1)

Back to top





CPLEX: fail:     Back to top

Modelname Time (CPLEX) Status (CPLEX)
nug20 -- mstat( 6) sstat( 3)
nug30 -- mstat( 6) sstat( 3)

Back to top





CLP: optimal:     Back to top

Modelname Time (CLP) Obj (CLP)
aa01 1.9600 55535.43638822
aa03 1.1000 49616.36363636
air02 0.0600 7640.00000000
air06 1.1100 49616.36363636
baxter 1.0300 56007255.67225311
car4 1.5900 35.46037017
cari 0.3400 581.89305779
co5 2.9400 714469.55375105
co9 13.9500 946920.43028456
cq5 1.3300 400133.80747262
cq9 6.5100 505541.70980727
crew1 0.1600 20.55555556
ex3sta1 123.2200 -63.07540325
fit2d 3.5100 -68464.29329383
fit2p 4.0700 68464.29329383
fome11 0.2400 0.00000000
fome12 0.4800 0.00000000
gen1 1.2100 0.00000122
gen2 46.6100 3.29279078
gen4 62.6100 0.00000285
jendrec1 2.6900 7028.46051135
ken-11 0.4700 -6972382262.51996900
ken-13 1.3000 -1.0257394789482E+10
l30 17.8900 0.95266142
lp22 34.1800 458.94459411
lpl3 0.8100 27318.00000000
maros-r7 2.9100 1497185.16647964
mod2 5.6000 27737371.36444000
model10 27.4100 -154599.62130064
model11 2.6500 0.00000000
model5 3.9200 -858440.72907343
model7 2.7100 49380.08549287
model9 1.6300 -141123.09361336
nemspmm1 3.3600 -327415.83567076
nemspmm2 3.4000 -291794.83608908
nemswrld 50.8000 260.30896600
nsir1 0.3200 -28909033.00000000
nsir2 0.5000 -27175593.50000000
osa-07 0.2600 535722.51729935
p010 0.9200 1115047.91511082
p05 0.3400 556000.27662588
pcb3000 0.7500 137416.41961282
pds-06 0.4400 27761037600.00000000
pds-10 1.0000 26727094976.00000000
pilot87 12.5300 301.71036566
r05 0.3800 557831.85904066
rat1 0.4100 1999531.66287928
rat5 1.5200 3083707.01043841
rosen10 0.1300 -174215.45613870
scfxm1-2b-64 3.7000 2877.56386371
scfxm1-2r-64 1.1200 2877.56386371
scfxm1-2r-96 2.2800 2891.70611371
scrs8-2r-512 0.2100 1074.09934157
scsd8-2b-64 0.3700 15.99866803
scsd8-2c-64 0.4000 14.99923200
scsd8-2r-108 0.1200 23.69999434
scsd8-2r-216 0.3000 23.39998388
sctap1-2b-64 0.8800 484.56000000
slptsk 2.0800 29.89536602
south31 30.4900 1818940197.10106000
stocfor3 1.1100 -39976.78394365
testbig 1.0100 -60.42296073
ulevimin 33.3700 -5191101861.43196900
wood1p 0.1200 1.44290241
world 6.3600 40364873.11417430
bas1lp 2.0700 363.00000000
cre-b 3.1700 23129639.88683240
cre-d 1.9600 24454969.76454920
fome13 1.0100 0.00000000
fome20 4.3100 23821658640.00000000
fome21 9.1500 47346318912.00000000
ken-18 8.4400 -5.2217025287397E+10
kl02 0.5500 215.25000000
nemsemm2 0.8700 581079.57090469
nsct1 1.2100 -38922436.00000000
nsct2 2.0400 -37175082.00000000
osa-14 0.8200 1106462.84473625
osa-30 1.6500 2142139.87320976
pds-20 4.2100 23821658640.00000000
pds-30 10.0100 21385445736.00000000
pds-40 18.3800 18855198824.00000000
pds-50 26.3100 16603525724.00000000
pds-60 39.7900 14265904407.00000000
rail507 11.0000 172.14556668
rail516 3.6300 182.00000000
rail582 7.8600 209.71223296
rat7a 20.9300 2074371.41572828
rlfddd 0.3200 -13.00000000
rlfdual 60.2200 -1.00000000
rlfprim 1.1900 1.00000000
route 0.4000 5941.65027667
scfxm1-2r-256 16.2800 2891.70611371
scsd8-2r-432 0.8500 25.79996945
sctap1-2r-480 2.0500 248.50000000
t0331-4l 18.0500 29730.03335194
us04 6.4800 17731.66666667
watson_1 104.6500 -1609.28071548
dbic1 306.5800 -9768973.00000000
dbir1 3.9100 -8106707.00000000
dbir2 3.0800 -6116916.50000000
nemsemm1 2.8700 512959.60078798
nw14 2.7800 61844.00000000
osa-60 5.9400 4044072.50315751
pds-100 90.0600 10928229968.00000000
pds-70 53.7600 12241162812.00000000
pds-80 71.0200 11469077462.00000000
pds-90 76.1900 11087561635.00000000
rail2586 2059.1800 935.92182057
self 6.5600 0.00000000

Back to top





CLP: infeasible:     Back to top

Modelname Time (CLP) Status (CLP)
bgindy -- mstat(19) sstat( 1)
gosh -- mstat(19) sstat( 1)
lpl1 -- mstat(19) sstat( 1)
sgpf5y6 -- mstat(19) sstat( 1)

Back to top





CLP: fail:     Back to top

Modelname Time (CLP) Status (CLP)
nug15 -- mstat(14) sstat( 3)
qap15 -- mstat(14) sstat( 3)
nug20 -- mstat(14) sstat( 3)
nug30 -- mstat(14) sstat( 3)
rail4284 -- mstat(14) sstat( 3)

Back to top