Solver Square Comparison: Considers all models.

Date / Time: 01/07/08 19:50:07


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX11 is represented on the left (rows) and solver CBC2 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :1-CPLEX-1.trc
Tracefile 2 :3-CBC-1.trc
Solvers used : CPLEX11
CBC2
Modeltype(s)   MIP



CBC2:
optimal
CBC2:
feasible
CBC2:
infeasible
CBC2:
unbounded
CBC2:
fail
CBC2:
no data
total CPLEX11
CPLEX11:
optimal
- 59 - - 3 - 62
CPLEX11:
feasible
- 62 - - - - 62
CPLEX11:
infeasible
- - - - - - -
CPLEX11:
unbounded
- - - - - - -
CPLEX11:
fail
- 1 - - - - 1
CPLEX11:
no data
- - - - - - -
total CBC2 - 122 - - 3 - 125




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


CPLEX11: optimal -- CBC2: feasible    Back to top

Modelname Time (CPLEX11) Time (CBC2) Ratio (CPLEX11/CBC2) Obj (CPLEX11) Obj (CBC2)
10teams 4.0000 32.3000 0.124 924.00000000 924.00000000
acc-tight-0 0.4700 3.9700 0.118 0.00000000 0.00000000
acc-tight-1 1.9500 4.8800 0.400 0.00000000 0.00000000
acc-tight-4 1.3300 14.7800 0.090 0.00000000 0.00000000
acc-tight-5 38.7800 869.9400 0.045 0.00000000 0.00000000
air03 0.4100 5.3700 0.076 340160.00000000 340160.00000000
air05 9.5300 136.2100 0.070 26374.00000000 26374.00000000
bienst1 34.8900 93.3500 0.374 46.75000000 46.75000000
bienst2 183.0800 1085.4200 0.169 54.60000000 54.60000000
bk4x3 0.0100 0.0100 --- 350.00000000 350.00000000
blend2 1.2700 8.6200 0.147 7.59898500 7.59898500
dsbmip 0.5400 0.9600 0.563 -306.76901203 -306.76901203
egout 0.0100 0.0300 --- 568.10070000 568.10070000
enigma 0.0200 5.5600 0.004 0.00000000 0.00000000
fast0507 1803.1800 3603.3900 0.500 174.00000000 174.00000000
fiber 0.2600 2.0500 0.127 405935.18000000 405935.18000000
fixnet6 0.9000 3.1200 0.288 3983.00000000 3983.00000000
gen 0.0400 0.2400 0.167 112313.36271800 112313.36271800
gr4x6 0.0100 0.0300 --- 202.35000000 202.35000000
gt2 0.0300 0.0600 0.500 21166.00000000 21166.00000000
irp 5.0000 75.7100 0.066 12159.49283600 12159.49283600
khb05250 0.1400 0.4700 0.298 106940226.00000000 106940226.00000000
l152lav 0.8800 26.5500 0.033 4722.00000000 4722.00000000
lseu 0.1000 1.6600 0.060 1120.00000000 1120.00000000
misc03 1.1000 3.3400 0.329 3360.00000000 3360.00000000
misc07 32.4700 129.6800 0.250 2810.00000000 2810.00000000
mitre 0.5000 7.4300 0.067 115155.00000000 115155.00000000
mod008 0.1000 2.4400 0.041 307.00000000 307.00000000
mod010 0.3400 0.7800 0.436 6548.00000000 6548.00000000
modglob 0.1900 39.1800 0.005 20740508.08630820 20740508.08630820
neos1 0.7200 565.5700 0.001 19.00000000 19.00000000
neos3 34.3600 3622.2700 0.009 368.84275100 443.21208870
neos4 3.0400 323.7000 0.009 -4.8603440750589E+10 -4.8603440750589E+10
neos5 3.0200 21.9800 0.137 -4.8603440750589E+10 -4.8603440750589E+10
neos6 64.1400 737.2300 0.087 83.00000000 83.00000000
nw04 31.5400 16.9900 1.856 16862.00000000 16862.00000000
p0033 0.0200 0.1500 0.133 3089.00000000 3089.00000000
p0201 0.2900 6.5000 0.045 7615.00000000 7615.00000000
p0282 0.1100 2.2000 0.050 258411.00000000 258411.00000000
p0548 0.0600 3.6700 0.016 8691.00000000 8691.00000000
p2756 0.3300 3.3100 0.100 3124.00000000 3124.00000000
pp08acuts 1.4200 31.0400 0.046 7350.00000000 7350.00000000
prod1 14.3000 106.7000 0.134 -56.00000000 -56.00000000
qiu 48.0700 739.5800 0.065 -132.87313695 -132.87313695
qnet1 1.5400 4.3300 0.356 16029.69268100 16029.69268100
qnet1_o 1.0000 5.4000 0.185 16029.69268100 16029.69268100
ran10x10a 0.1800 3.5600 0.051 1499.00000000 1499.00000000
ran10x10b 0.1600 1.4800 0.108 3073.00000000 3073.00000000
ran10x12 0.3400 2.8000 0.121 2714.00000000 2714.00000000
rentacar 0.4600 5.7800 0.080 28882470.94755350 28882470.94755350
rgn 0.1800 3.2400 0.056 82.19999924 82.19999924
rlp2 0.0400 3.2600 0.012 19.00000000 19.00000000
set1ch 0.3400 3715.6600 0.000 54537.75000000 54537.75000000
stein27 0.2500 3.0000 0.083 18.00000000 18.00000000
stein45 12.0400 65.2600 0.184 30.00000000 30.00000000
swath1 12.5300 1269.9300 0.010 379.07129575 379.07129575
swath2 11.1100 2182.7000 0.005 385.19969295 385.19969295
vpm1 0.0300 0.7600 0.039 20.00000000 20.00000000
vpm2 0.5000 8.3400 0.060 13.75000000 13.75000000

Back to top





CPLEX11: optimal -- CBC2: fail    Back to top

Modelname Time (CPLEX11) Time (CBC2) Ratio (CPLEX11/CBC2) Obj (CPLEX11) Status (CBC2)
acc-tight-2 55.5900 3601.2900 --- 0.00000000 mstat(14) sstat( 3)
acc-tight-3 1671.8500 3601.3200 --- 0.00000000 mstat(14) sstat( 3)
acc-tight-6 48.1800 3601.4200 --- 0.00000000 mstat(14) sstat( 3)

Back to top





CPLEX11: feasible -- CBC2: feasible    Back to top

Modelname Time (CPLEX11) Time (CBC2) Ratio (CPLEX11/CBC2) Obj (CPLEX11) Obj (CBC2)
air04 15.6600 211.1400 0.074 56137.00000000 56137.00000000
arki001 35.3600 3602.2600 0.010 7581054.43421778 7581001.27499148
bal8x12 0.0900 1.6100 0.056 471.55000000 471.55000000
bc1 124.6900 2552.4200 0.049 3.33836255 3.33836255
bc 3600.2000 3602.1000 0.999 7.00000000 7.00000000
bell3a 1.8000 3.2100 0.561 878430.31600000 878430.31600000
bell5 0.1800 24.5800 0.007 8966406.49152000 8966406.49152000
binkar10_1 18.3600 3606.3600 0.005 6742.20002400 6742.20002400
cap6000 0.4400 1.6600 0.265 -2451294.00000000 -2451346.00000000
dano3_3 70.3000 200.6600 0.350 576.34463451 576.34463303
dano3_4 90.6900 174.7000 0.519 576.43522471 576.43522471
dano3_5 309.1500 693.0900 0.446 576.92491596 576.92491596
dano3mip 3600.3000 3643.7400 0.988 703.35714286 731.00000000
danoint 3600.0200 3602.3000 0.999 65.66666667 65.66666667
dcmulti 0.3500 7.1100 0.049 188183.50000000 188182.00000000
gesa2 0.3200 9.8100 0.033 25779856.37169790 25779856.37169790
gesa2_o 0.3000 26.6900 0.011 25779856.37169790 25809150.17799340
gesa3 0.5500 14.4900 0.038 27991042.64838270 27991042.64838270
gesa3_o 0.2900 13.9900 0.021 27991042.64838380 27991042.64838270
harp2 94.6500 1285.2000 0.074 -73899111.00000000 -73899797.00000000
markshare1 386.0700 279.0500 1.384 9.00000000 16.00000000
markshare2 457.7400 343.7300 1.332 24.00000000 40.00000000
mas284 4.1200 31.3500 0.131 91405.72368220 91405.72368220
mas74 131.6500 501.5600 0.262 11801.18572900 11801.18572900
mas76 58.7500 263.2800 0.223 40005.05414200 40005.05414200
misc06 0.1000 1.3300 0.075 12850.86073738 12850.86073738
mkc1 6.4800 3600.8300 0.002 -607.15000000 -607.09800000
mkc 3600.1000 3601.4700 1.000 -563.84600000 -550.70600000
mod011 105.0200 224.1800 0.468 -54558535.01422730 -54558535.01422730
n3700 3600.1000 3602.5200 0.999 1305784.00000000 1341199.00000000
n3701 3600.0900 3602.1100 0.999 1291970.00000000 1317126.00000000
n3702 3600.1100 3601.9600 0.999 1287849.00000000 1326806.00000000
n3703 3600.0700 3602.3600 0.999 1268328.00000000 1325309.00000000
n3704 3600.1200 3602.3100 0.999 1305710.00000000 1331120.00000000
n3705 3600.1200 3602.0100 0.999 1291866.00000000 1362932.00000000
n3706 3600.1500 3602.0900 0.999 1290557.00000000 1319181.00000000
n3707 3600.1300 3602.5200 0.999 1285797.00000000 1300918.00000000
n3708 3600.1100 3602.0700 0.999 1276996.00000000 1333483.00000000
n3709 3600.1000 3602.2800 0.999 1301093.00000000 1327536.00000000
n370a 3600.1600 3602.1000 0.999 1318397.00000000 1357665.00000000
n370b 3600.1100 3602.2400 0.999 1288274.00000000 1385587.00000000
n370c 3600.1300 3602.2700 0.999 1298066.00000000 1348372.00000000
n370d 3600.1100 3602.0700 0.999 1298066.00000000 1348372.00000000
n370e 3600.1100 3602.2300 0.999 1272104.00000000 1313313.00000000
neos2 3.3800 1717.3300 0.002 454.86469704 454.86469703
noswot 924.2700 1707.5200 0.541 -41.00000000 -41.00000000
pk1 127.7700 129.9400 0.983 11.00000000 11.00000000
pp08a 1.0600 44.2700 0.024 7350.00000000 7350.00000000
ran10x10c 1.4200 13.3400 0.106 13007.00000000 13007.00000000
ran10x26 12.0500 88.7200 0.136 4270.00000000 4270.00000000
ran12x12 9.4200 69.1300 0.136 2291.00000000 2291.00000000
ran12x21 61.8900 385.7300 0.160 3664.00000000 3664.00000000
ran13x13 19.0200 90.7700 0.210 3252.00000000 3252.00000000
ran14x18 2543.8900 2944.9900 0.864 3712.00000000 3735.00000000
ran16x16 158.2400 2546.0400 0.062 3823.00000000 3823.00000000
ran17x17 5.2500 45.9700 0.114 1373.00000000 1373.00000000
ran4x64 0.1900 3.2800 0.058 9711.00000000 9711.00000000
ran6x43 0.3300 3.8000 0.087 6330.00000000 6330.00000000
ran8x32 3.2300 55.4400 0.058 5247.00000000 5247.00000000
rout 14.7200 1100.5300 0.013 1077.56000000 1077.56000000
seymour1 208.9800 3626.3500 0.058 410.76370139 411.02855163
seymour 3600.0700 3602.4600 0.999 424.00000000 435.00000000

Back to top





CPLEX11: fail -- CBC2: feasible    Back to top

Modelname Time (CPLEX11) Time (CBC2) Ratio (CPLEX11/CBC2) Status (CPLEX11) Obj (CBC2)
swath 1174.1900 3602.5600 --- mstat(14) sstat( 4) 515.95663600

Back to top





CPLEX11: optimal:     Back to top

Modelname Time (CPLEX11) Obj (CPLEX11)
10teams 4.0000 924.00000000
acc-tight-0 0.4700 0.00000000
acc-tight-1 1.9500 0.00000000
acc-tight-2 55.5900 0.00000000
acc-tight-3 1671.8500 0.00000000
acc-tight-4 1.3300 0.00000000
acc-tight-5 38.7800 0.00000000
acc-tight-6 48.1800 0.00000000
air03 0.4100 340160.00000000
air05 9.5300 26374.00000000
bienst1 34.8900 46.75000000
bienst2 183.0800 54.60000000
bk4x3 0.0100 350.00000000
blend2 1.2700 7.59898500
dsbmip 0.5400 -306.76901203
egout 0.0100 568.10070000
enigma 0.0200 0.00000000
fast0507 1803.1800 174.00000000
fiber 0.2600 405935.18000000
fixnet6 0.9000 3983.00000000
gen 0.0400 112313.36271800
gr4x6 0.0100 202.35000000
gt2 0.0300 21166.00000000
irp 5.0000 12159.49283600
khb05250 0.1400 106940226.00000000
l152lav 0.8800 4722.00000000
lseu 0.1000 1120.00000000
misc03 1.1000 3360.00000000
misc07 32.4700 2810.00000000
mitre 0.5000 115155.00000000
mod008 0.1000 307.00000000
mod010 0.3400 6548.00000000
modglob 0.1900 20740508.08630820
neos1 0.7200 19.00000000
neos3 34.3600 368.84275100
neos4 3.0400 -4.8603440750589E+10
neos5 3.0200 -4.8603440750589E+10
neos6 64.1400 83.00000000
nw04 31.5400 16862.00000000
p0033 0.0200 3089.00000000
p0201 0.2900 7615.00000000
p0282 0.1100 258411.00000000
p0548 0.0600 8691.00000000
p2756 0.3300 3124.00000000
pp08acuts 1.4200 7350.00000000
prod1 14.3000 -56.00000000
qiu 48.0700 -132.87313695
qnet1 1.5400 16029.69268100
qnet1_o 1.0000 16029.69268100
ran10x10a 0.1800 1499.00000000
ran10x10b 0.1600 3073.00000000
ran10x12 0.3400 2714.00000000
rentacar 0.4600 28882470.94755350
rgn 0.1800 82.19999924
rlp2 0.0400 19.00000000
set1ch 0.3400 54537.75000000
stein27 0.2500 18.00000000
stein45 12.0400 30.00000000
swath1 12.5300 379.07129575
swath2 11.1100 385.19969295
vpm1 0.0300 20.00000000
vpm2 0.5000 13.75000000

Back to top





CPLEX11: feasible:     Back to top

Modelname Time (CPLEX11) Obj (CPLEX11)
air04 15.6600 56137.00000000
arki001 35.3600 7581054.43421778
bal8x12 0.0900 471.55000000
bc1 124.6900 3.33836255
bc 3600.2000 7.00000000
bell3a 1.8000 878430.31600000
bell5 0.1800 8966406.49152000
binkar10_1 18.3600 6742.20002400
cap6000 0.4400 -2451294.00000000
dano3_3 70.3000 576.34463451
dano3_4 90.6900 576.43522471
dano3_5 309.1500 576.92491596
dano3mip 3600.3000 703.35714286
danoint 3600.0200 65.66666667
dcmulti 0.3500 188183.50000000
gesa2 0.3200 25779856.37169790
gesa2_o 0.3000 25779856.37169790
gesa3 0.5500 27991042.64838270
gesa3_o 0.2900 27991042.64838380
harp2 94.6500 -73899111.00000000
markshare1 386.0700 9.00000000
markshare2 457.7400 24.00000000
mas284 4.1200 91405.72368220
mas74 131.6500 11801.18572900
mas76 58.7500 40005.05414200
misc06 0.1000 12850.86073738
mkc1 6.4800 -607.15000000
mkc 3600.1000 -563.84600000
mod011 105.0200 -54558535.01422730
n3700 3600.1000 1305784.00000000
n3701 3600.0900 1291970.00000000
n3702 3600.1100 1287849.00000000
n3703 3600.0700 1268328.00000000
n3704 3600.1200 1305710.00000000
n3705 3600.1200 1291866.00000000
n3706 3600.1500 1290557.00000000
n3707 3600.1300 1285797.00000000
n3708 3600.1100 1276996.00000000
n3709 3600.1000 1301093.00000000
n370a 3600.1600 1318397.00000000
n370b 3600.1100 1288274.00000000
n370c 3600.1300 1298066.00000000
n370d 3600.1100 1298066.00000000
n370e 3600.1100 1272104.00000000
neos2 3.3800 454.86469704
noswot 924.2700 -41.00000000
pk1 127.7700 11.00000000
pp08a 1.0600 7350.00000000
ran10x10c 1.4200 13007.00000000
ran10x26 12.0500 4270.00000000
ran12x12 9.4200 2291.00000000
ran12x21 61.8900 3664.00000000
ran13x13 19.0200 3252.00000000
ran14x18 2543.8900 3712.00000000
ran16x16 158.2400 3823.00000000
ran17x17 5.2500 1373.00000000
ran4x64 0.1900 9711.00000000
ran6x43 0.3300 6330.00000000
ran8x32 3.2300 5247.00000000
rout 14.7200 1077.56000000
seymour1 208.9800 410.76370139
seymour 3600.0700 424.00000000

Back to top





CPLEX11: fail:     Back to top

Modelname Time (CPLEX11) Status (CPLEX11)
swath -- mstat(14) sstat( 4)

Back to top





CBC2: feasible:     Back to top

Modelname Time (CBC2) Obj (CBC2)
10teams 32.3000 924.00000000
acc-tight-0 3.9700 0.00000000
acc-tight-1 4.8800 0.00000000
acc-tight-4 14.7800 0.00000000
acc-tight-5 869.9400 0.00000000
air03 5.3700 340160.00000000
air04 211.1400 56137.00000000
air05 136.2100 26374.00000000
arki001 3602.2600 7581001.27499148
bal8x12 1.6100 471.55000000
bc1 2552.4200 3.33836255
bc 3602.1000 7.00000000
bell3a 3.2100 878430.31600000
bell5 24.5800 8966406.49152000
bienst1 93.3500 46.75000000
bienst2 1085.4200 54.60000000
binkar10_1 3606.3600 6742.20002400
bk4x3 0.0100 350.00000000
blend2 8.6200 7.59898500
cap6000 1.6600 -2451346.00000000
dano3_3 200.6600 576.34463303
dano3_4 174.7000 576.43522471
dano3_5 693.0900 576.92491596
dano3mip 3643.7400 731.00000000
danoint 3602.3000 65.66666667
dcmulti 7.1100 188182.00000000
dsbmip 0.9600 -306.76901203
egout 0.0300 568.10070000
enigma 5.5600 0.00000000
fast0507 3603.3900 174.00000000
fiber 2.0500 405935.18000000
fixnet6 3.1200 3983.00000000
gen 0.2400 112313.36271800
gesa2 9.8100 25779856.37169790
gesa2_o 26.6900 25809150.17799340
gesa3 14.4900 27991042.64838270
gesa3_o 13.9900 27991042.64838270
gr4x6 0.0300 202.35000000
gt2 0.0600 21166.00000000
harp2 1285.2000 -73899797.00000000
irp 75.7100 12159.49283600
khb05250 0.4700 106940226.00000000
l152lav 26.5500 4722.00000000
lseu 1.6600 1120.00000000
markshare1 279.0500 16.00000000
markshare2 343.7300 40.00000000
mas284 31.3500 91405.72368220
mas74 501.5600 11801.18572900
mas76 263.2800 40005.05414200
misc03 3.3400 3360.00000000
misc06 1.3300 12850.86073738
misc07 129.6800 2810.00000000
mitre 7.4300 115155.00000000
mkc1 3600.8300 -607.09800000
mkc 3601.4700 -550.70600000
mod008 2.4400 307.00000000
mod010 0.7800 6548.00000000
mod011 224.1800 -54558535.01422730
modglob 39.1800 20740508.08630820
n3700 3602.5200 1341199.00000000
n3701 3602.1100 1317126.00000000
n3702 3601.9600 1326806.00000000
n3703 3602.3600 1325309.00000000
n3704 3602.3100 1331120.00000000
n3705 3602.0100 1362932.00000000
n3706 3602.0900 1319181.00000000
n3707 3602.5200 1300918.00000000
n3708 3602.0700 1333483.00000000
n3709 3602.2800 1327536.00000000
n370a 3602.1000 1357665.00000000
n370b 3602.2400 1385587.00000000
n370c 3602.2700 1348372.00000000
n370d 3602.0700 1348372.00000000
n370e 3602.2300 1313313.00000000
neos1 565.5700 19.00000000
neos2 1717.3300 454.86469703
neos3 3622.2700 443.21208870
neos4 323.7000 -4.8603440750589E+10
neos5 21.9800 -4.8603440750589E+10
neos6 737.2300 83.00000000
noswot 1707.5200 -41.00000000
nw04 16.9900 16862.00000000
p0033 0.1500 3089.00000000
p0201 6.5000 7615.00000000
p0282 2.2000 258411.00000000
p0548 3.6700 8691.00000000
p2756 3.3100 3124.00000000
pk1 129.9400 11.00000000
pp08acuts 31.0400 7350.00000000
pp08a 44.2700 7350.00000000
prod1 106.7000 -56.00000000
qiu 739.5800 -132.87313695
qnet1 4.3300 16029.69268100
qnet1_o 5.4000 16029.69268100
ran10x10a 3.5600 1499.00000000
ran10x10b 1.4800 3073.00000000
ran10x10c 13.3400 13007.00000000
ran10x12 2.8000 2714.00000000
ran10x26 88.7200 4270.00000000
ran12x12 69.1300 2291.00000000
ran12x21 385.7300 3664.00000000
ran13x13 90.7700 3252.00000000
ran14x18 2944.9900 3735.00000000
ran16x16 2546.0400 3823.00000000
ran17x17 45.9700 1373.00000000
ran4x64 3.2800 9711.00000000
ran6x43 3.8000 6330.00000000
ran8x32 55.4400 5247.00000000
rentacar 5.7800 28882470.94755350
rgn 3.2400 82.19999924
rlp2 3.2600 19.00000000
rout 1100.5300 1077.56000000
set1ch 3715.6600 54537.75000000
seymour1 3626.3500 411.02855163
seymour 3602.4600 435.00000000
stein27 3.0000 18.00000000
stein45 65.2600 30.00000000
swath1 1269.9300 379.07129575
swath2 2182.7000 385.19969295
swath 3602.5600 515.95663600
vpm1 0.7600 20.00000000
vpm2 8.3400 13.75000000

Back to top





CBC2: fail:     Back to top

Modelname Time (CBC2) Status (CBC2)
acc-tight-2 -- mstat(14) sstat( 3)
acc-tight-3 -- mstat(14) sstat( 3)
acc-tight-6 -- mstat(14) sstat( 3)

Back to top