Solver Square Comparison: Considers all models.

Date / Time: 01/07/08 19:50:07


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX10 is represented on the left (rows) and solver CBC2 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :2-CPLEX-1.trc
Tracefile 2 :3-CBC-1.trc
Solvers used : CPLEX10
CBC2
Modeltype(s)   MIP



CBC2:
optimal
CBC2:
feasible
CBC2:
infeasible
CBC2:
unbounded
CBC2:
fail
CBC2:
no data
total CPLEX10
CPLEX10:
optimal
- 57 - - 3 - 60
CPLEX10:
feasible
- 64 - - - - 64
CPLEX10:
infeasible
- - - - - - -
CPLEX10:
unbounded
- - - - - - -
CPLEX10:
fail
- 1 - - - - 1
CPLEX10:
no data
- - - - - - -
total CBC2 - 122 - - 3 - 125




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


CPLEX10: optimal -- CBC2: feasible    Back to top

Modelname Time (CPLEX10) Time (CBC2) Ratio (CPLEX10/CBC2) Obj (CPLEX10) Obj (CBC2)
10teams 3.3600 32.3000 0.104 924.00000000 924.00000000
acc-tight-0 0.4800 3.9700 0.121 0.00000000 0.00000000
acc-tight-1 14.2400 4.8800 2.918 0.00000000 0.00000000
acc-tight-4 4.2400 14.7800 0.287 0.00000000 0.00000000
acc-tight-5 34.4000 869.9400 0.040 0.00000000 0.00000000
air03 0.4200 5.3700 0.078 340160.00000000 340160.00000000
air04 9.3200 211.1400 0.044 56137.00000000 56137.00000000
air05 8.0300 136.2100 0.059 26374.00000000 26374.00000000
bal8x12 0.0400 1.6100 0.025 471.55000000 471.55000000
bienst1 266.7100 93.3500 2.857 46.75000000 46.75000000
bienst2 1650.0600 1085.4200 1.520 54.60000000 54.60000000
bk4x3 0.0000 0.0100 --- 350.00000000 350.00000000
dsbmip 0.3400 0.9600 0.354 -306.76901203 -306.76901203
egout 0.0000 0.0300 --- 568.10070000 568.10070000
enigma 0.2400 5.5600 0.043 0.00000000 0.00000000
fast0507 796.5800 3603.3900 0.221 174.00000000 174.00000000
fixnet6 0.9300 3.1200 0.298 3983.00000000 3983.00000000
gen 0.0200 0.2400 0.083 112313.36271800 112313.36271800
gr4x6 0.0100 0.0300 --- 202.35000000 202.35000000
gt2 0.0100 0.0600 0.167 21166.00000000 21166.00000000
l152lav 0.7000 26.5500 0.026 4722.00000000 4722.00000000
lseu 0.0900 1.6600 0.054 1120.00000000 1120.00000000
misc03 0.1700 3.3400 0.051 3360.00000000 3360.00000000
misc06 0.0900 1.3300 0.068 12850.86073738 12850.86073738
misc07 6.1300 129.6800 0.047 2810.00000000 2810.00000000
mitre 0.5500 7.4300 0.074 115155.00000000 115155.00000000
mod008 0.1400 2.4400 0.057 307.00000000 307.00000000
mod010 0.2500 0.7800 0.321 6548.00000000 6548.00000000
mod011 134.2900 224.1800 0.599 -54558535.01422740 -54558535.01422730
modglob 0.1200 39.1800 0.003 20740508.08630820 20740508.08630820
neos1 1.6400 565.5700 0.003 19.00000000 19.00000000
neos3 16.8600 3622.2700 0.005 368.84275100 443.21208870
neos4 3.3200 323.7000 0.010 -4.8603440750589E+10 -4.8603440750589E+10
neos5 3.3000 21.9800 0.150 -4.8603440750589E+10 -4.8603440750589E+10
neos6 126.4100 737.2300 0.171 83.00000000 83.00000000
nw04 14.9700 16.9900 0.881 16862.00000000 16862.00000000
p0033 0.0100 0.1500 0.067 3089.00000000 3089.00000000
p0201 0.3500 6.5000 0.054 7615.00000000 7615.00000000
p0282 0.0800 2.2000 0.036 258411.00000000 258411.00000000
p0548 0.0200 3.6700 0.005 8691.00000000 8691.00000000
p2756 0.3100 3.3100 0.094 3124.00000000 3124.00000000
pp08acuts 0.8000 31.0400 0.026 7350.00000000 7350.00000000
prod1 19.5000 106.7000 0.183 -56.00000000 -56.00000000
qiu 70.1500 739.5800 0.095 -132.87313695 -132.87313695
qnet1 1.5200 4.3300 0.351 16029.69268100 16029.69268100
qnet1_o 1.2700 5.4000 0.235 16029.69268100 16029.69268100
ran10x10a 0.1600 3.5600 0.045 1499.00000000 1499.00000000
ran10x10b 0.1500 1.4800 0.101 3073.00000000 3073.00000000
ran10x12 0.3200 2.8000 0.114 2714.00000000 2714.00000000
ran4x64 0.2100 3.2800 0.064 9711.00000000 9711.00000000
rentacar 0.4100 5.7800 0.071 28882470.94755350 28882470.94755350
rgn 0.3100 3.2400 0.096 82.19999924 82.19999924
rlp2 0.0300 3.2600 0.009 19.00000000 19.00000000
stein27 0.1900 3.0000 0.063 18.00000000 18.00000000
stein45 9.6800 65.2600 0.148 30.00000000 30.00000000
vpm1 0.0000 0.7600 0.000 20.00000000 20.00000000
vpm2 0.5900 8.3400 0.071 13.75000000 13.75000000

Back to top





CPLEX10: optimal -- CBC2: fail    Back to top

Modelname Time (CPLEX10) Time (CBC2) Ratio (CPLEX10/CBC2) Obj (CPLEX10) Status (CBC2)
acc-tight-2 144.1000 3601.2900 --- 0.00000000 mstat(14) sstat( 3)
acc-tight-3 479.4400 3601.3200 --- 0.00000000 mstat(14) sstat( 3)
acc-tight-6 46.1100 3601.4200 --- 0.00000000 mstat(14) sstat( 3)

Back to top





CPLEX10: feasible -- CBC2: feasible    Back to top

Modelname Time (CPLEX10) Time (CBC2) Ratio (CPLEX10/CBC2) Obj (CPLEX10) Obj (CBC2)
arki001 256.2900 3602.2600 0.071 7581239.38201819 7581001.27499148
bc1 146.7600 2552.4200 0.057 3.33836255 3.33836255
bc 3620.3200 3602.1000 1.005 7.00000000 7.00000000
bell3a 3.0100 3.2100 0.938 878430.31600000 878430.31600000
bell5 4.0600 24.5800 0.165 8966406.49152000 8966406.49152000
binkar10_1 25.4200 3606.3600 0.007 6742.20002400 6742.20002400
blend2 1.9400 8.6200 0.225 7.59898500 7.59898500
cap6000 0.4700 1.6600 0.283 -2451325.00000000 -2451346.00000000
dano3_3 78.6400 200.6600 0.392 576.34463451 576.34463303
dano3_4 81.8200 174.7000 0.468 576.43522471 576.43522471
dano3_5 270.2600 693.0900 0.390 576.92491596 576.92491596
dano3mip 3624.2400 3643.7400 0.995 703.77118644 731.00000000
danoint 3600.0200 3602.3000 0.999 65.66666667 65.66666667
dcmulti 0.3600 7.1100 0.051 188182.00000000 188182.00000000
fiber 0.2600 2.0500 0.127 405935.18000000 405935.18000000
gesa2 0.2500 9.8100 0.025 25779856.37169790 25779856.37169790
gesa2_o 0.3300 26.6900 0.012 25779856.37169790 25809150.17799340
gesa3 0.2800 14.4900 0.019 27991042.64838270 27991042.64838270
gesa3_o 0.2200 13.9900 0.016 27991042.64838270 27991042.64838270
harp2 966.0900 1285.2000 0.752 -73899345.00000000 -73899797.00000000
irp 2.9000 75.7100 0.038 12160.47784500 12159.49283600
khb05250 0.0800 0.4700 0.170 106940226.00000000 106940226.00000000
markshare1 71.1800 279.0500 0.255 18.00000000 16.00000000
markshare2 73.5800 343.7300 0.214 43.00000000 40.00000000
mas284 6.0000 31.3500 0.191 91405.72368220 91405.72368220
mas74 184.8000 501.5600 0.368 11801.18572900 11801.18572900
mas76 86.8800 263.2800 0.330 40005.05414200 40005.05414200
mkc1 4.6400 3600.8300 0.001 -607.15000000 -607.09800000
mkc 3600.0500 3601.4700 1.000 -563.76600000 -550.70600000
n3700 3605.9900 3602.5200 1.001 1301041.00000000 1341199.00000000
n3701 3600.1000 3602.1100 0.999 1289979.00000000 1317126.00000000
n3702 3600.0800 3601.9600 0.999 1287946.00000000 1326806.00000000
n3703 3600.1000 3602.3600 0.999 1276760.00000000 1325309.00000000
n3704 3600.1300 3602.3100 0.999 1305056.00000000 1331120.00000000
n3705 3600.0700 3602.0100 0.999 1285410.00000000 1362932.00000000
n3706 3600.0700 3602.0900 0.999 1289222.00000000 1319181.00000000
n3707 3600.1200 3602.5200 0.999 1277924.00000000 1300918.00000000
n3708 3600.0900 3602.0700 0.999 1298168.00000000 1333483.00000000
n3709 3600.1000 3602.2800 0.999 1292439.00000000 1327536.00000000
n370a 3600.1100 3602.1000 0.999 1326295.00000000 1357665.00000000
n370b 3600.4200 3602.2400 0.999 1308121.99999987 1385587.00000000
n370c 3600.1400 3602.2700 0.999 1311006.00000000 1348372.00000000
n370d 3600.1000 3602.0700 0.999 1308791.00000000 1348372.00000000
n370e 3600.0700 3602.2300 0.999 1293119.00000000 1313313.00000000
neos2 4.0000 1717.3300 0.002 454.86469704 454.86469703
noswot 257.9600 1707.5200 0.151 -41.00000000 -41.00000000
pk1 63.8300 129.9400 0.491 11.00000000 11.00000000
pp08a 0.5200 44.2700 0.012 7350.00000000 7350.00000000
ran10x10c 0.7700 13.3400 0.058 13007.00000000 13007.00000000
ran10x26 14.5600 88.7200 0.164 4270.00000000 4270.00000000
ran12x12 6.7900 69.1300 0.098 2291.00000000 2291.00000000
ran12x21 59.3400 385.7300 0.154 3664.00000000 3664.00000000
ran13x13 14.9400 90.7700 0.165 3252.00000000 3252.00000000
ran14x18 1125.4300 2944.9900 0.382 3712.00000000 3735.00000000
ran16x16 151.4200 2546.0400 0.059 3823.00000000 3823.00000000
ran17x17 2.1800 45.9700 0.047 1373.00000000 1373.00000000
ran6x43 0.3300 3.8000 0.087 6330.00000000 6330.00000000
ran8x32 9.2800 55.4400 0.167 5247.00000000 5247.00000000
rout 62.7400 1100.5300 0.057 1077.56000000 1077.56000000
set1ch 0.3700 3715.6600 0.000 54540.25000000 54537.75000000
seymour1 489.5100 3626.3500 0.135 410.76370139 411.02855163
seymour 3600.0500 3602.4600 0.999 425.00000000 435.00000000
swath1 8.8200 1269.9300 0.007 379.07129575 379.07129575
swath2 16.4700 2182.7000 0.008 385.19969295 385.19969295

Back to top





CPLEX10: fail -- CBC2: feasible    Back to top

Modelname Time (CPLEX10) Time (CBC2) Ratio (CPLEX10/CBC2) Status (CPLEX10) Obj (CBC2)
swath 1842.0100 3602.5600 --- mstat(14) sstat( 4) 515.95663600

Back to top





CPLEX10: optimal:     Back to top

Modelname Time (CPLEX10) Obj (CPLEX10)
10teams 3.3600 924.00000000
acc-tight-0 0.4800 0.00000000
acc-tight-1 14.2400 0.00000000
acc-tight-2 144.1000 0.00000000
acc-tight-3 479.4400 0.00000000
acc-tight-4 4.2400 0.00000000
acc-tight-5 34.4000 0.00000000
acc-tight-6 46.1100 0.00000000
air03 0.4200 340160.00000000
air04 9.3200 56137.00000000
air05 8.0300 26374.00000000
bal8x12 0.0400 471.55000000
bienst1 266.7100 46.75000000
bienst2 1650.0600 54.60000000
bk4x3 0.0000 350.00000000
dsbmip 0.3400 -306.76901203
egout 0.0000 568.10070000
enigma 0.2400 0.00000000
fast0507 796.5800 174.00000000
fixnet6 0.9300 3983.00000000
gen 0.0200 112313.36271800
gr4x6 0.0100 202.35000000
gt2 0.0100 21166.00000000
l152lav 0.7000 4722.00000000
lseu 0.0900 1120.00000000
misc03 0.1700 3360.00000000
misc06 0.0900 12850.86073738
misc07 6.1300 2810.00000000
mitre 0.5500 115155.00000000
mod008 0.1400 307.00000000
mod010 0.2500 6548.00000000
mod011 134.2900 -54558535.01422740
modglob 0.1200 20740508.08630820
neos1 1.6400 19.00000000
neos3 16.8600 368.84275100
neos4 3.3200 -4.8603440750589E+10
neos5 3.3000 -4.8603440750589E+10
neos6 126.4100 83.00000000
nw04 14.9700 16862.00000000
p0033 0.0100 3089.00000000
p0201 0.3500 7615.00000000
p0282 0.0800 258411.00000000
p0548 0.0200 8691.00000000
p2756 0.3100 3124.00000000
pp08acuts 0.8000 7350.00000000
prod1 19.5000 -56.00000000
qiu 70.1500 -132.87313695
qnet1 1.5200 16029.69268100
qnet1_o 1.2700 16029.69268100
ran10x10a 0.1600 1499.00000000
ran10x10b 0.1500 3073.00000000
ran10x12 0.3200 2714.00000000
ran4x64 0.2100 9711.00000000
rentacar 0.4100 28882470.94755350
rgn 0.3100 82.19999924
rlp2 0.0300 19.00000000
stein27 0.1900 18.00000000
stein45 9.6800 30.00000000
vpm1 0.0000 20.00000000
vpm2 0.5900 13.75000000

Back to top





CPLEX10: feasible:     Back to top

Modelname Time (CPLEX10) Obj (CPLEX10)
arki001 256.2900 7581239.38201819
bc1 146.7600 3.33836255
bc 3620.3200 7.00000000
bell3a 3.0100 878430.31600000
bell5 4.0600 8966406.49152000
binkar10_1 25.4200 6742.20002400
blend2 1.9400 7.59898500
cap6000 0.4700 -2451325.00000000
dano3_3 78.6400 576.34463451
dano3_4 81.8200 576.43522471
dano3_5 270.2600 576.92491596
dano3mip 3624.2400 703.77118644
danoint 3600.0200 65.66666667
dcmulti 0.3600 188182.00000000
fiber 0.2600 405935.18000000
gesa2 0.2500 25779856.37169790
gesa2_o 0.3300 25779856.37169790
gesa3 0.2800 27991042.64838270
gesa3_o 0.2200 27991042.64838270
harp2 966.0900 -73899345.00000000
irp 2.9000 12160.47784500
khb05250 0.0800 106940226.00000000
markshare1 71.1800 18.00000000
markshare2 73.5800 43.00000000
mas284 6.0000 91405.72368220
mas74 184.8000 11801.18572900
mas76 86.8800 40005.05414200
mkc1 4.6400 -607.15000000
mkc 3600.0500 -563.76600000
n3700 3605.9900 1301041.00000000
n3701 3600.1000 1289979.00000000
n3702 3600.0800 1287946.00000000
n3703 3600.1000 1276760.00000000
n3704 3600.1300 1305056.00000000
n3705 3600.0700 1285410.00000000
n3706 3600.0700 1289222.00000000
n3707 3600.1200 1277924.00000000
n3708 3600.0900 1298168.00000000
n3709 3600.1000 1292439.00000000
n370a 3600.1100 1326295.00000000
n370b 3600.4200 1308121.99999987
n370c 3600.1400 1311006.00000000
n370d 3600.1000 1308791.00000000
n370e 3600.0700 1293119.00000000
neos2 4.0000 454.86469704
noswot 257.9600 -41.00000000
pk1 63.8300 11.00000000
pp08a 0.5200 7350.00000000
ran10x10c 0.7700 13007.00000000
ran10x26 14.5600 4270.00000000
ran12x12 6.7900 2291.00000000
ran12x21 59.3400 3664.00000000
ran13x13 14.9400 3252.00000000
ran14x18 1125.4300 3712.00000000
ran16x16 151.4200 3823.00000000
ran17x17 2.1800 1373.00000000
ran6x43 0.3300 6330.00000000
ran8x32 9.2800 5247.00000000
rout 62.7400 1077.56000000
set1ch 0.3700 54540.25000000
seymour1 489.5100 410.76370139
seymour 3600.0500 425.00000000
swath1 8.8200 379.07129575
swath2 16.4700 385.19969295

Back to top





CPLEX10: fail:     Back to top

Modelname Time (CPLEX10) Status (CPLEX10)
swath -- mstat(14) sstat( 4)

Back to top





CBC2: feasible:     Back to top

Modelname Time (CBC2) Obj (CBC2)
10teams 32.3000 924.00000000
acc-tight-0 3.9700 0.00000000
acc-tight-1 4.8800 0.00000000
acc-tight-4 14.7800 0.00000000
acc-tight-5 869.9400 0.00000000
air03 5.3700 340160.00000000
air04 211.1400 56137.00000000
air05 136.2100 26374.00000000
arki001 3602.2600 7581001.27499148
bal8x12 1.6100 471.55000000
bc1 2552.4200 3.33836255
bc 3602.1000 7.00000000
bell3a 3.2100 878430.31600000
bell5 24.5800 8966406.49152000
bienst1 93.3500 46.75000000
bienst2 1085.4200 54.60000000
binkar10_1 3606.3600 6742.20002400
bk4x3 0.0100 350.00000000
blend2 8.6200 7.59898500
cap6000 1.6600 -2451346.00000000
dano3_3 200.6600 576.34463303
dano3_4 174.7000 576.43522471
dano3_5 693.0900 576.92491596
dano3mip 3643.7400 731.00000000
danoint 3602.3000 65.66666667
dcmulti 7.1100 188182.00000000
dsbmip 0.9600 -306.76901203
egout 0.0300 568.10070000
enigma 5.5600 0.00000000
fast0507 3603.3900 174.00000000
fiber 2.0500 405935.18000000
fixnet6 3.1200 3983.00000000
gen 0.2400 112313.36271800
gesa2 9.8100 25779856.37169790
gesa2_o 26.6900 25809150.17799340
gesa3 14.4900 27991042.64838270
gesa3_o 13.9900 27991042.64838270
gr4x6 0.0300 202.35000000
gt2 0.0600 21166.00000000
harp2 1285.2000 -73899797.00000000
irp 75.7100 12159.49283600
khb05250 0.4700 106940226.00000000
l152lav 26.5500 4722.00000000
lseu 1.6600 1120.00000000
markshare1 279.0500 16.00000000
markshare2 343.7300 40.00000000
mas284 31.3500 91405.72368220
mas74 501.5600 11801.18572900
mas76 263.2800 40005.05414200
misc03 3.3400 3360.00000000
misc06 1.3300 12850.86073738
misc07 129.6800 2810.00000000
mitre 7.4300 115155.00000000
mkc1 3600.8300 -607.09800000
mkc 3601.4700 -550.70600000
mod008 2.4400 307.00000000
mod010 0.7800 6548.00000000
mod011 224.1800 -54558535.01422730
modglob 39.1800 20740508.08630820
n3700 3602.5200 1341199.00000000
n3701 3602.1100 1317126.00000000
n3702 3601.9600 1326806.00000000
n3703 3602.3600 1325309.00000000
n3704 3602.3100 1331120.00000000
n3705 3602.0100 1362932.00000000
n3706 3602.0900 1319181.00000000
n3707 3602.5200 1300918.00000000
n3708 3602.0700 1333483.00000000
n3709 3602.2800 1327536.00000000
n370a 3602.1000 1357665.00000000
n370b 3602.2400 1385587.00000000
n370c 3602.2700 1348372.00000000
n370d 3602.0700 1348372.00000000
n370e 3602.2300 1313313.00000000
neos1 565.5700 19.00000000
neos2 1717.3300 454.86469703
neos3 3622.2700 443.21208870
neos4 323.7000 -4.8603440750589E+10
neos5 21.9800 -4.8603440750589E+10
neos6 737.2300 83.00000000
noswot 1707.5200 -41.00000000
nw04 16.9900 16862.00000000
p0033 0.1500 3089.00000000
p0201 6.5000 7615.00000000
p0282 2.2000 258411.00000000
p0548 3.6700 8691.00000000
p2756 3.3100 3124.00000000
pk1 129.9400 11.00000000
pp08acuts 31.0400 7350.00000000
pp08a 44.2700 7350.00000000
prod1 106.7000 -56.00000000
qiu 739.5800 -132.87313695
qnet1 4.3300 16029.69268100
qnet1_o 5.4000 16029.69268100
ran10x10a 3.5600 1499.00000000
ran10x10b 1.4800 3073.00000000
ran10x10c 13.3400 13007.00000000
ran10x12 2.8000 2714.00000000
ran10x26 88.7200 4270.00000000
ran12x12 69.1300 2291.00000000
ran12x21 385.7300 3664.00000000
ran13x13 90.7700 3252.00000000
ran14x18 2944.9900 3735.00000000
ran16x16 2546.0400 3823.00000000
ran17x17 45.9700 1373.00000000
ran4x64 3.2800 9711.00000000
ran6x43 3.8000 6330.00000000
ran8x32 55.4400 5247.00000000
rentacar 5.7800 28882470.94755350
rgn 3.2400 82.19999924
rlp2 3.2600 19.00000000
rout 1100.5300 1077.56000000
set1ch 3715.6600 54537.75000000
seymour1 3626.3500 411.02855163
seymour 3602.4600 435.00000000
stein27 3.0000 18.00000000
stein45 65.2600 30.00000000
swath1 1269.9300 379.07129575
swath2 2182.7000 385.19969295
swath 3602.5600 515.95663600
vpm1 0.7600 20.00000000
vpm2 8.3400 13.75000000

Back to top





CBC2: fail:     Back to top

Modelname Time (CBC2) Status (CBC2)
acc-tight-2 -- mstat(14) sstat( 3)
acc-tight-3 -- mstat(14) sstat( 3)
acc-tight-6 -- mstat(14) sstat( 3)

Back to top