Solver Square Comparison: Considers all models.

Date / Time: 09/01/07 15:07:01


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX is represented on the left (rows) and solver CBC on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :1-CPLEX-1.trc
Tracefile 2 :2-CBC-1.trc
Solvers used : CPLEX
CBC
Modeltype(s)   MIP



CBC:
optimal
CBC:
feasible
CBC:
infeasible
CBC:
unbounded
CBC:
fail
CBC:
no data
total CPLEX
CPLEX:
optimal
- 56 1 - 3 - 60
CPLEX:
feasible
- 64 - - - - 64
CPLEX:
infeasible
- - - - - - -
CPLEX:
unbounded
- - - - - - -
CPLEX:
fail
- 1 - - - - 1
CPLEX:
no data
- - - - - - -
total CBC - 121 1 - 3 - 125




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


CPLEX: optimal -- CBC: feasible    Back to top

Modelname Time (CPLEX) Time (CBC) Ratio (CPLEX/CBC) Obj (CPLEX) Obj (CBC)
10teams 3.3600 32.9800 0.102 924.00000000 924.00000000
acc-tight-0 0.4800 3.3900 0.142 0.00000000 0.00000000
acc-tight-1 14.2400 5.2700 2.702 0.00000000 0.00000000
acc-tight-4 4.2400 16.3900 0.259 0.00000000 0.00000000
acc-tight-5 34.4000 379.1400 0.091 0.00000000 0.00000000
air03 0.4200 6.4800 0.065 340160.00000000 340160.00000000
air04 9.3200 167.8600 0.056 56137.00000000 56137.00000000
air05 8.0300 410.8000 0.020 26374.00000000 26374.00000000
bal8x12 0.0400 1.6300 0.025 471.55000000 471.55000000
bienst1 266.7100 102.3700 2.605 46.75000000 46.75000000
bienst2 1650.0600 881.3800 1.872 54.60000000 54.60000000
bk4x3 0.0000 0.0200 --- 350.00000000 350.00000000
dsbmip 0.3400 1.3500 0.252 -306.76901203 -306.76901203
egout 0.0000 0.0300 --- 568.10070000 568.10070000
enigma 0.2400 7.1300 0.034 0.00000000 0.00000000
fast0507 796.5800 3619.3200 0.220 174.00000000 179.00000000
fixnet6 0.9300 2.9600 0.314 3983.00000000 3983.00000000
gen 0.0200 0.2200 0.091 112313.36271800 112313.36271800
gr4x6 0.0100 0.0300 --- 202.35000000 202.35000000
gt2 0.0100 0.9300 0.011 21166.00000000 21166.00000000
l152lav 0.7000 19.9500 0.035 4722.00000000 4722.00000000
lseu 0.0900 1.5700 0.057 1120.00000000 1120.00000000
misc03 0.1700 3.2100 0.053 3360.00000000 3360.00000000
misc06 0.0900 1.3300 0.068 12850.86073738 12850.86073738
misc07 6.1300 107.4100 0.057 2810.00000000 2810.00000000
mitre 0.5500 7.5000 0.073 115155.00000000 115155.00000000
mod008 0.1400 2.5100 0.056 307.00000000 307.00000000
mod010 0.2500 1.2600 0.198 6548.00000000 6548.00000000
mod011 134.2900 304.0200 0.442 -54558535.01422740 -54558535.01422730
modglob 0.1200 39.1200 0.003 20740508.08630820 20740508.08630820
neos1 1.6400 36.6700 0.045 19.00000000 19.00000000
neos3 16.8600 3601.7200 0.005 368.84275100 372.28135552
neos5 3.3000 54.3400 0.061 -4.8603440750589E+10 -4.8603440750590E+10
neos6 126.4100 2760.3600 0.046 83.00000000 83.00000000
nw04 14.9700 14.8000 1.011 16862.00000000 16862.00000000
p0033 0.0100 0.1400 0.071 3089.00000000 3089.00000000
p0201 0.3500 6.3000 0.056 7615.00000000 7615.00000000
p0282 0.0800 2.1800 0.037 258411.00000000 258411.00000000
p0548 0.0200 0.4000 0.050 8691.00000000 8691.00000000
p2756 0.3100 1.9600 0.158 3124.00000000 3124.00000000
pp08acuts 0.8000 28.4700 0.028 7350.00000000 7350.00000000
prod1 19.5000 118.8700 0.164 -56.00000000 -56.00000000
qiu 70.1500 736.4700 0.095 -132.87313695 -132.87313695
qnet1 1.5200 5.4200 0.280 16029.69268100 16029.69268100
qnet1_o 1.2700 5.0100 0.253 16029.69268100 16029.69268100
ran10x10a 0.1600 3.8800 0.041 1499.00000000 1499.00000000
ran10x10b 0.1500 1.4400 0.104 3073.00000000 3073.00000000
ran10x12 0.3200 2.1800 0.147 2714.00000000 2714.00000000
ran4x64 0.2100 3.2600 0.064 9711.00000000 9711.00000000
rentacar 0.4100 8.8000 0.047 28882470.94755350 28882470.94755350
rgn 0.3100 3.8400 0.081 82.19999924 82.19999924
rlp2 0.0300 3.4600 0.009 19.00000000 19.00000000
stein27 0.1900 2.9700 0.064 18.00000000 18.00000000
stein45 9.6800 64.7000 0.150 30.00000000 30.00000000
vpm1 0.0000 0.1800 0.000 20.00000000 20.00000000
vpm2 0.5900 5.6600 0.104 13.75000000 13.75000000

Back to top





CPLEX: optimal -- CBC: infeasible    Back to top

Modelname Time (CPLEX) Time (CBC) Ratio (CPLEX/CBC) Obj (CPLEX) Status (CBC)
neos4 3.3200 1.4600 --- -4.8603440750589E+10 mstat(19) sstat( 1)

Back to top





CPLEX: optimal -- CBC: fail    Back to top

Modelname Time (CPLEX) Time (CBC) Ratio (CPLEX/CBC) Obj (CPLEX) Status (CBC)
acc-tight-2 144.1000 3601.3000 --- 0.00000000 mstat(14) sstat( 3)
acc-tight-3 479.4400 3601.6100 --- 0.00000000 mstat(14) sstat( 3)
acc-tight-6 46.1100 3601.1300 --- 0.00000000 mstat(14) sstat( 3)

Back to top





CPLEX: feasible -- CBC: feasible    Back to top

Modelname Time (CPLEX) Time (CBC) Ratio (CPLEX/CBC) Obj (CPLEX) Obj (CBC)
arki001 256.2900 3602.4800 0.071 7581239.38201819 7581532.09193870
bc1 146.7600 3314.9500 0.044 3.33836255 3.33836255
bc 3620.3200 3602.4800 1.005 7.00000000 7.00000000
bell3a 3.0100 2.6400 1.140 878430.31600000 878430.31600000
bell5 4.0600 54.6900 0.074 8966406.49152000 8966406.49152000
binkar10_1 25.4200 3605.0900 0.007 6742.20002400 6742.20002400
blend2 1.9400 6.5600 0.296 7.59898500 7.59898500
cap6000 0.4700 2.2600 0.208 -2451325.00000000 -2451372.00000000
dano3_3 78.6400 185.1500 0.425 576.34463451 576.34463303
dano3_4 81.8200 156.6300 0.522 576.43522471 576.43522471
dano3_5 270.2600 663.8700 0.407 576.92491596 576.92491596
dano3mip 3624.2400 3717.0700 0.975 703.77118644 731.00000000
danoint 3600.0200 3602.3100 0.999 65.66666667 65.66666667
dcmulti 0.3600 7.1200 0.051 188182.00000000 188182.00000000
fiber 0.2600 2.9100 0.089 405935.18000000 405935.18000000
gesa2 0.2500 10.3100 0.024 25779856.37169790 25779856.37169790
gesa2_o 0.3300 86.0300 0.004 25779856.37169790 25781467.82340410
gesa3 0.2800 10.1400 0.028 27991042.64838270 27991042.64838270
gesa3_o 0.2200 20.3700 0.011 27991042.64838270 27991042.64838270
harp2 966.0900 439.1800 2.200 -73899345.00000000 -73895028.00000000
irp 2.9000 15.0900 0.192 12160.47784500 12159.49283600
khb05250 0.0800 0.4600 0.174 106940226.00000000 106940226.00000000
markshare1 71.1800 274.8000 0.259 18.00000000 15.00000000
markshare2 73.5800 350.8700 0.210 43.00000000 37.00000000
mas284 6.0000 31.1000 0.193 91405.72368220 91405.72368220
mas74 184.8000 490.3300 0.377 11801.18572900 11801.18572900
mas76 86.8800 252.1700 0.345 40005.05414200 40005.05414200
mkc1 4.6400 1196.0100 0.004 -607.15000000 -607.16700000
mkc 3600.0500 3602.3100 0.999 -563.76600000 -551.60600000
n3700 3605.9900 3604.1400 1.001 1301041.00000000 1341199.00000000
n3701 3600.1000 3603.3000 0.999 1289979.00000000 1317126.00000000
n3702 3600.0800 3603.5900 0.999 1287946.00000000 1326806.00000000
n3703 3600.1000 3603.4500 0.999 1276760.00000000 1325309.00000000
n3704 3600.1300 3603.5800 0.999 1305056.00000000 1331120.00000000
n3705 3600.0700 3603.0800 0.999 1285410.00000000 1362932.00000000
n3706 3600.0700 3603.5200 0.999 1289222.00000000 1319181.00000000
n3707 3600.1200 3603.5700 0.999 1277924.00000000 1300918.00000000
n3708 3600.0900 3603.0900 0.999 1298168.00000000 1333483.00000000
n3709 3600.1000 3603.2100 0.999 1292439.00000000 1327536.00000000
n370a 3600.1100 3603.4500 0.999 1326295.00000000 1357665.00000000
n370b 3600.4200 3603.0900 0.999 1308121.99999987 1385587.00000000
n370c 3600.1400 3603.2900 0.999 1311006.00000000 1348372.00000000
n370d 3600.1000 3603.3900 0.999 1308791.00000000 1348372.00000000
n370e 3600.0700 3603.3700 0.999 1293119.00000000 1313313.00000000
neos2 4.0000 1504.5400 0.003 454.86469704 454.86469704
noswot 257.9600 1200.0600 0.215 -41.00000000 -41.00000000
pk1 63.8300 129.5600 0.493 11.00000000 11.00000000
pp08a 0.5200 44.6700 0.012 7350.00000000 7350.00000000
ran10x10c 0.7700 16.0900 0.048 13007.00000000 13007.00000000
ran10x26 14.5600 84.0000 0.173 4270.00000000 4270.00000000
ran12x12 6.7900 80.2500 0.085 2291.00000000 2291.00000000
ran12x21 59.3400 318.7100 0.186 3664.00000000 3664.00000000
ran13x13 14.9400 107.5600 0.139 3252.00000000 3252.00000000
ran14x18 1125.4300 2896.9600 0.388 3712.00000000 3740.00000000
ran16x16 151.4200 2296.9600 0.066 3823.00000000 3823.00000000
ran17x17 2.1800 51.1300 0.043 1373.00000000 1373.00000000
ran6x43 0.3300 4.3100 0.077 6330.00000000 6330.00000000
ran8x32 9.2800 67.0100 0.138 5247.00000000 5247.00000000
rout 62.7400 736.9400 0.085 1077.56000000 1077.56000000
set1ch 0.3700 3712.6800 0.000 54540.25000000 54537.75000000
seymour1 489.5100 3609.8200 0.136 410.76370139 410.76370139
seymour 3600.0500 3606.3000 0.998 425.00000000 432.00000000
swath1 8.8200 328.7700 0.027 379.07129575 379.07129575
swath2 16.4700 2590.2900 0.006 385.19969295 385.19969295

Back to top





CPLEX: fail -- CBC: feasible    Back to top

Modelname Time (CPLEX) Time (CBC) Ratio (CPLEX/CBC) Status (CPLEX) Obj (CBC)
swath 1842.0100 3604.2800 --- mstat(14) sstat( 4) 508.91597500

Back to top





CPLEX: optimal:     Back to top

Modelname Time (CPLEX) Obj (CPLEX)
10teams 3.3600 924.00000000
acc-tight-0 0.4800 0.00000000
acc-tight-1 14.2400 0.00000000
acc-tight-2 144.1000 0.00000000
acc-tight-3 479.4400 0.00000000
acc-tight-4 4.2400 0.00000000
acc-tight-5 34.4000 0.00000000
acc-tight-6 46.1100 0.00000000
air03 0.4200 340160.00000000
air04 9.3200 56137.00000000
air05 8.0300 26374.00000000
bal8x12 0.0400 471.55000000
bienst1 266.7100 46.75000000
bienst2 1650.0600 54.60000000
bk4x3 0.0000 350.00000000
dsbmip 0.3400 -306.76901203
egout 0.0000 568.10070000
enigma 0.2400 0.00000000
fast0507 796.5800 174.00000000
fixnet6 0.9300 3983.00000000
gen 0.0200 112313.36271800
gr4x6 0.0100 202.35000000
gt2 0.0100 21166.00000000
l152lav 0.7000 4722.00000000
lseu 0.0900 1120.00000000
misc03 0.1700 3360.00000000
misc06 0.0900 12850.86073738
misc07 6.1300 2810.00000000
mitre 0.5500 115155.00000000
mod008 0.1400 307.00000000
mod010 0.2500 6548.00000000
mod011 134.2900 -54558535.01422740
modglob 0.1200 20740508.08630820
neos1 1.6400 19.00000000
neos3 16.8600 368.84275100
neos4 3.3200 -4.8603440750589E+10
neos5 3.3000 -4.8603440750589E+10
neos6 126.4100 83.00000000
nw04 14.9700 16862.00000000
p0033 0.0100 3089.00000000
p0201 0.3500 7615.00000000
p0282 0.0800 258411.00000000
p0548 0.0200 8691.00000000
p2756 0.3100 3124.00000000
pp08acuts 0.8000 7350.00000000
prod1 19.5000 -56.00000000
qiu 70.1500 -132.87313695
qnet1 1.5200 16029.69268100
qnet1_o 1.2700 16029.69268100
ran10x10a 0.1600 1499.00000000
ran10x10b 0.1500 3073.00000000
ran10x12 0.3200 2714.00000000
ran4x64 0.2100 9711.00000000
rentacar 0.4100 28882470.94755350
rgn 0.3100 82.19999924
rlp2 0.0300 19.00000000
stein27 0.1900 18.00000000
stein45 9.6800 30.00000000
vpm1 0.0000 20.00000000
vpm2 0.5900 13.75000000

Back to top





CPLEX: feasible:     Back to top

Modelname Time (CPLEX) Obj (CPLEX)
arki001 256.2900 7581239.38201819
bc1 146.7600 3.33836255
bc 3620.3200 7.00000000
bell3a 3.0100 878430.31600000
bell5 4.0600 8966406.49152000
binkar10_1 25.4200 6742.20002400
blend2 1.9400 7.59898500
cap6000 0.4700 -2451325.00000000
dano3_3 78.6400 576.34463451
dano3_4 81.8200 576.43522471
dano3_5 270.2600 576.92491596
dano3mip 3624.2400 703.77118644
danoint 3600.0200 65.66666667
dcmulti 0.3600 188182.00000000
fiber 0.2600 405935.18000000
gesa2 0.2500 25779856.37169790
gesa2_o 0.3300 25779856.37169790
gesa3 0.2800 27991042.64838270
gesa3_o 0.2200 27991042.64838270
harp2 966.0900 -73899345.00000000
irp 2.9000 12160.47784500
khb05250 0.0800 106940226.00000000
markshare1 71.1800 18.00000000
markshare2 73.5800 43.00000000
mas284 6.0000 91405.72368220
mas74 184.8000 11801.18572900
mas76 86.8800 40005.05414200
mkc1 4.6400 -607.15000000
mkc 3600.0500 -563.76600000
n3700 3605.9900 1301041.00000000
n3701 3600.1000 1289979.00000000
n3702 3600.0800 1287946.00000000
n3703 3600.1000 1276760.00000000
n3704 3600.1300 1305056.00000000
n3705 3600.0700 1285410.00000000
n3706 3600.0700 1289222.00000000
n3707 3600.1200 1277924.00000000
n3708 3600.0900 1298168.00000000
n3709 3600.1000 1292439.00000000
n370a 3600.1100 1326295.00000000
n370b 3600.4200 1308121.99999987
n370c 3600.1400 1311006.00000000
n370d 3600.1000 1308791.00000000
n370e 3600.0700 1293119.00000000
neos2 4.0000 454.86469704
noswot 257.9600 -41.00000000
pk1 63.8300 11.00000000
pp08a 0.5200 7350.00000000
ran10x10c 0.7700 13007.00000000
ran10x26 14.5600 4270.00000000
ran12x12 6.7900 2291.00000000
ran12x21 59.3400 3664.00000000
ran13x13 14.9400 3252.00000000
ran14x18 1125.4300 3712.00000000
ran16x16 151.4200 3823.00000000
ran17x17 2.1800 1373.00000000
ran6x43 0.3300 6330.00000000
ran8x32 9.2800 5247.00000000
rout 62.7400 1077.56000000
set1ch 0.3700 54540.25000000
seymour1 489.5100 410.76370139
seymour 3600.0500 425.00000000
swath1 8.8200 379.07129575
swath2 16.4700 385.19969295

Back to top





CPLEX: fail:     Back to top

Modelname Time (CPLEX) Status (CPLEX)
swath -- mstat(14) sstat( 4)

Back to top





CBC: feasible:     Back to top

Modelname Time (CBC) Obj (CBC)
10teams 32.9800 924.00000000
acc-tight-0 3.3900 0.00000000
acc-tight-1 5.2700 0.00000000
acc-tight-4 16.3900 0.00000000
acc-tight-5 379.1400 0.00000000
air03 6.4800 340160.00000000
air04 167.8600 56137.00000000
air05 410.8000 26374.00000000
arki001 3602.4800 7581532.09193870
bal8x12 1.6300 471.55000000
bc1 3314.9500 3.33836255
bc 3602.4800 7.00000000
bell3a 2.6400 878430.31600000
bell5 54.6900 8966406.49152000
bienst1 102.3700 46.75000000
bienst2 881.3800 54.60000000
binkar10_1 3605.0900 6742.20002400
bk4x3 0.0200 350.00000000
blend2 6.5600 7.59898500
cap6000 2.2600 -2451372.00000000
dano3_3 185.1500 576.34463303
dano3_4 156.6300 576.43522471
dano3_5 663.8700 576.92491596
dano3mip 3717.0700 731.00000000
danoint 3602.3100 65.66666667
dcmulti 7.1200 188182.00000000
dsbmip 1.3500 -306.76901203
egout 0.0300 568.10070000
enigma 7.1300 0.00000000
fast0507 3619.3200 179.00000000
fiber 2.9100 405935.18000000
fixnet6 2.9600 3983.00000000
gen 0.2200 112313.36271800
gesa2 10.3100 25779856.37169790
gesa2_o 86.0300 25781467.82340410
gesa3 10.1400 27991042.64838270
gesa3_o 20.3700 27991042.64838270
gr4x6 0.0300 202.35000000
gt2 0.9300 21166.00000000
harp2 439.1800 -73895028.00000000
irp 15.0900 12159.49283600
khb05250 0.4600 106940226.00000000
l152lav 19.9500 4722.00000000
lseu 1.5700 1120.00000000
markshare1 274.8000 15.00000000
markshare2 350.8700 37.00000000
mas284 31.1000 91405.72368220
mas74 490.3300 11801.18572900
mas76 252.1700 40005.05414200
misc03 3.2100 3360.00000000
misc06 1.3300 12850.86073738
misc07 107.4100 2810.00000000
mitre 7.5000 115155.00000000
mkc1 1196.0100 -607.16700000
mkc 3602.3100 -551.60600000
mod008 2.5100 307.00000000
mod010 1.2600 6548.00000000
mod011 304.0200 -54558535.01422730
modglob 39.1200 20740508.08630820
n3700 3604.1400 1341199.00000000
n3701 3603.3000 1317126.00000000
n3702 3603.5900 1326806.00000000
n3703 3603.4500 1325309.00000000
n3704 3603.5800 1331120.00000000
n3705 3603.0800 1362932.00000000
n3706 3603.5200 1319181.00000000
n3707 3603.5700 1300918.00000000
n3708 3603.0900 1333483.00000000
n3709 3603.2100 1327536.00000000
n370a 3603.4500 1357665.00000000
n370b 3603.0900 1385587.00000000
n370c 3603.2900 1348372.00000000
n370d 3603.3900 1348372.00000000
n370e 3603.3700 1313313.00000000
neos1 36.6700 19.00000000
neos2 1504.5400 454.86469704
neos3 3601.7200 372.28135552
neos5 54.3400 -4.8603440750590E+10
neos6 2760.3600 83.00000000
noswot 1200.0600 -41.00000000
nw04 14.8000 16862.00000000
p0033 0.1400 3089.00000000
p0201 6.3000 7615.00000000
p0282 2.1800 258411.00000000
p0548 0.4000 8691.00000000
p2756 1.9600 3124.00000000
pk1 129.5600 11.00000000
pp08acuts 28.4700 7350.00000000
pp08a 44.6700 7350.00000000
prod1 118.8700 -56.00000000
qiu 736.4700 -132.87313695
qnet1 5.4200 16029.69268100
qnet1_o 5.0100 16029.69268100
ran10x10a 3.8800 1499.00000000
ran10x10b 1.4400 3073.00000000
ran10x10c 16.0900 13007.00000000
ran10x12 2.1800 2714.00000000
ran10x26 84.0000 4270.00000000
ran12x12 80.2500 2291.00000000
ran12x21 318.7100 3664.00000000
ran13x13 107.5600 3252.00000000
ran14x18 2896.9600 3740.00000000
ran16x16 2296.9600 3823.00000000
ran17x17 51.1300 1373.00000000
ran4x64 3.2600 9711.00000000
ran6x43 4.3100 6330.00000000
ran8x32 67.0100 5247.00000000
rentacar 8.8000 28882470.94755350
rgn 3.8400 82.19999924
rlp2 3.4600 19.00000000
rout 736.9400 1077.56000000
set1ch 3712.6800 54537.75000000
seymour1 3609.8200 410.76370139
seymour 3606.3000 432.00000000
stein27 2.9700 18.00000000
stein45 64.7000 30.00000000
swath1 328.7700 379.07129575
swath2 2590.2900 385.19969295
swath 3604.2800 508.91597500
vpm1 0.1800 20.00000000
vpm2 5.6600 13.75000000

Back to top





CBC: infeasible:     Back to top

Modelname Time (CBC) Status (CBC)
neos4 -- mstat(19) sstat( 1)

Back to top





CBC: fail:     Back to top

Modelname Time (CBC) Status (CBC)
acc-tight-2 -- mstat(14) sstat( 3)
acc-tight-3 -- mstat(14) sstat( 3)
acc-tight-6 -- mstat(14) sstat( 3)

Back to top