## Solver Square Comparison: Considers all models.

Results created on 02/04/10 15:30:16 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver Cbc is represented on the left (rows) and solver GUROBI on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number Filename
Tracefile 1: CBC.trc
Tracefile 2: GUROBI.trc
Solvers used : Cbc
GUROBI
Modeltype(s)   MIP

 GUROBI: optimal GUROBI: locally optimal GUROBI: feasible GUROBI: infeasible GUROBI: unbounded GUROBI: fail GUROBI: no data total Cbc Cbc: optimal 100 - - - - - - 100 Cbc: locally optimal - - - - - - - - Cbc: feasible 5 - 23 - - - - 28 Cbc: infeasible - - - - - - - - Cbc: unbounded - - - - - - - - Cbc: fail 1 - - - - - - 1 Cbc: no data - - - - - - - - total GUROBI 106 - 23 - - - - 129

### Solver return definitions:

Outcome Model Status Solver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-04. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

### Cbc: optimal -- GUROBI: optimal

Modelname Time (Cbc) Time (GUROBI) Ratio (Cbc/GUROBI) Obj (Cbc) Obj (GUROBI)
10teams 7.9400 8.0100 0.991 924.00000000 924.00000000
acc-tight-0 1.5200 0.4600 3.304 0.00000000 0.00000000
acc-tight-1 4.5900 7.4800 0.614 0.00000000 0.00000000
acc-tight-3 1301.4600 10.0900 128.985 0.00000000 0.00000000
acc-tight-4 3.5100 0.5700 6.158 0.00000000 0.00000000
acc-tight-5 277.7500 14.3000 19.423 0.00000000 0.00000000
acc-tight-6 172.6700 26.4900 6.518 0.00000000 0.00000000
air03 2.1800 0.4900 4.449 340160.00000000 340160.00000000
air04 126.5800 14.3000 8.852 56137.00000000 56137.00000000
air05 40.3600 12.8200 3.148 26374.00000000 26374.00000000
bal8x12 0.1200 0.0300 4.000 471.55000000 471.55000000
bc1 1497.3200 131.8400 11.357 3.33836255 3.33836255
bell3a 1.4600 2.3900 0.611 878430.31600000 878430.31600000
bell5 3.1100 0.4500 6.911 8966406.49152000 8966406.49152000
bienst1 206.5200 7.6700 26.926 46.75000000 46.75000000
bienst2 807.4600 42.6300 18.941 54.60000000 54.60000000
binkar10_1 317.3000 14.1600 22.408 6742.20002400 6742.20002400
bk4x3 0.0300 0.0000 --- 350.00000000 350.00000000
blend2 2.8200 0.2500 11.280 7.59898500 7.59898500
cap6000 2.3200 1.8100 1.282 -2451377.00000000 -2451377.00000000
dano3_3 108.3300 41.2800 2.624 576.34463303 576.34463303
dano3_4 243.4300 89.8900 2.708 576.43522471 576.43522471
dano3_5 451.1400 409.1700 1.103 576.92491596 576.92491641
dcmulti 1.8400 0.2800 6.571 188182.00000000 188182.00000000
dsbmip 0.8200 0.1200 6.833 -306.76901203 -306.76901203
egout 0.0400 0.0000 --- 568.10070000 568.10070000
eild76 1491.7500 5.9700 249.874 885.41184700 885.41184700
enigma 2.2300 0.1000 22.300 0.00000000 0.00000000
fast0507 1206.6700 259.6200 4.648 174.00000000 174.00000000
fiber 1.9900 0.2000 9.950 405935.18000000 405935.17999998
fixnet6 1.3600 0.2600 5.231 3983.00000000 3983.00000000
gen 0.1800 0.0300 6.000 112313.36271800 112313.36271800
gesa2 2.4600 0.7500 3.280 25779856.37169790 25779856.37169790
gesa2_o 7.0600 2.1400 3.299 25779856.37169790 25779856.37169790
gesa3 1.1500 0.4600 2.500 27991042.64838270 27991042.64838270
gesa3_o 2.3300 0.4400 5.295 27991042.64838260 27991042.64838270
gr4x6 0.0400 0.0000 --- 202.35000000 202.35000000
gt2 0.0200 0.0100 --- 21166.00000000 21166.00000000
irp 20.1300 4.0700 4.946 12159.49283600 12159.49283600
khb05250 0.4100 0.0600 6.833 106940226.00000000 106940226.00000000
l152lav 1.9100 1.8000 1.061 4722.00000000 4722.00000000
lseu 0.6100 0.0900 6.778 1120.00000000 1120.00000000
mas284 8.7200 4.8100 1.813 91405.72368220 91405.72368220
mas74 318.9400 471.1300 0.677 11801.18572900 11801.18572900
mas76 21.1600 24.2900 0.871 40005.05414200 40005.05414200
misc03 1.5400 0.8000 1.925 3360.00000000 3360.00000000
misc06 0.5300 0.1500 3.533 12850.86073738 12850.86073738
misc07 25.9600 15.1100 1.718 2810.00000000 2810.00000000
mitre 2.1100 0.1800 11.722 115155.00000000 115155.00000000
mod008 0.3300 0.0600 5.500 307.00000000 307.00000000
mod010 0.7500 0.5500 1.364 6548.00000000 6548.00000000
mod011 112.0600 77.8900 1.439 -54558535.01422740 -54558535.01422740
modglob 5.9000 0.0900 65.556 20740508.08630820 20740508.08630820
neos1 7.5600 0.3400 22.235 19.00000000 19.00000000
neos2 10.3200 2.2400 4.607 454.86469704 454.86469704
neos3 14.4300 6.2000 2.327 368.84275100 368.84275100
neos4 15.9900 2.9800 5.366 -4.8603440750590E+10 -4.8603440750591E+10
neos5 4.4300 5.1000 0.869 -4.8603440750590E+10 -4.8603440750591E+10
neos7 1074.2600 3.7300 288.005 721934.00000000 721934.00000000
noswot 1869.1000 322.0400 5.804 -41.00000000 -41.00000000
nug08 17.0800 5.3400 3.199 214.00000000 214.00000000
nw04 11.7500 10.9300 1.075 16862.00000000 16862.00000000
p0033 0.0100 0.0100 --- 3089.00000000 3089.00000000
p0201 1.6300 0.5700 2.860 7615.00000000 7615.00000000
p0282 0.9900 0.1100 9.000 258411.00000000 258411.00000000
p0548 0.1600 0.0300 5.333 8691.00000000 8691.00000000
p2756 1.9300 0.2500 7.720 3124.00000000 3124.00000000
pk1 37.2200 39.6800 0.938 11.00000000 11.00000000
pp08acuts 13.4200 1.1300 11.876 7350.00000000 7350.00000000
pp08a 15.2300 0.7100 21.451 7350.00000000 7350.00000000
prod1 21.7500 12.8700 1.690 -56.00000000 -56.00000000
qap10 200.0100 60.9600 3.281 340.00000000 340.00000000
qiu 184.3100 83.4300 2.209 -132.87313695 -132.87313695
qnet1 2.9200 1.4800 1.973 16029.69268100 16029.69268100
qnet1_o 2.1600 0.8100 2.667 16029.69268100 16029.69268100
ran10x10a 0.7300 0.0800 9.125 1499.00000000 1499.00000000
ran10x10b 0.5300 0.0700 7.571 3073.00000000 3073.00000000
ran10x10c 2.6000 2.2600 1.150 13007.00000000 13007.00000000
ran10x12 0.8200 0.1300 6.308 2714.00000000 2714.00000000
ran10x26 74.3300 16.9900 4.375 4270.00000000 4270.00000000
ran12x12 22.5300 6.6900 3.368 2291.00000000 2291.00000000
ran12x21 97.0500 43.4100 2.236 3664.00000000 3664.00000000
ran13x13 80.9600 17.4000 4.653 3252.00000000 3252.00000000
ran16x16 738.1000 148.2600 4.978 3823.00000000 3823.00000000
ran17x17 8.8000 2.2500 3.911 1373.00000000 1373.00000000
ran4x64 1.0300 0.1500 6.867 9711.00000000 9711.00000000
ran6x43 2.3700 0.1500 15.800 6330.00000000 6330.00000000
ran8x32 22.3100 7.8000 2.860 5247.00000000 5247.00000000
rentacar 4.4300 0.8400 5.274 28882470.94755350 28882470.94743890
rgn 5.8100 0.5000 11.620 82.19999924 82.19999924
rlp2 0.4500 0.0100 45.000 19.00000000 19.00000000
rout 818.3400 67.6000 12.106 1077.56000000 1077.56000000
set1ch 418.4100 0.1500 2789.400 54537.75000000 54537.75000000
seymour1 1752.7200 106.2100 16.502 410.76370139 410.76370139
stein27 1.8100 0.6800 2.662 18.00000000 18.00000000
stein45 23.5400 13.1000 1.797 30.00000000 30.00000000
swath1 48.4600 6.1400 7.893 379.07130045 379.07129575
swath2 157.5000 9.0500 17.403 385.19969295 385.19969295
vpm1 0.2400 0.0000 +INF.000 20.00000000 20.00000000
vpm2 2.9500 0.8500 3.471 13.75000000 13.75000000

### Cbc: feasible -- GUROBI: optimal

Modelname Time (Cbc) Time (GUROBI) Ratio (Cbc/GUROBI) Obj (Cbc) Obj (GUROBI)
arki001 3601.4400 461.9800 7.796 7580930.34444415 7580813.04596374
bc 3603.2200 879.6300 4.096 7.00000000 7.00000000
harp2 3601.3600 99.2300 36.293 -73876299.00000000 -73899798.00000000
neos6 3601.2300 10.9100 330.085 84.00000000 83.00000000
ran14x18 3603.8300 3055.3300 1.180 3736.00000000 3712.00000000

### Cbc: feasible -- GUROBI: feasible

Modelname Time (Cbc) Time (GUROBI) Ratio (Cbc/GUROBI) Obj (Cbc) Obj (GUROBI)
dano3mip 3629.5700 3590.6000 1.011 728.70588235 694.25000000
danoint 3602.6100 3592.4100 1.003 65.66666667 65.66666667
markshare1 3604.2100 703.6400 5.122 4.00000000 9.00000000
markshare2 3601.3200 790.6500 4.555 11.00000000 14.00000000
mkc1 3600.3600 3583.7600 1.005 -607.05000000 -607.16700000
mkc 3600.4900 3592.0600 1.002 -561.24600000 -563.84600000
n3700 3602.6100 3588.4200 1.004 1326280.00000000 1271028.00000000
n3701 3602.1800 3586.9000 1.004 1310970.00000000 1254216.99999997
n3702 3601.9300 3586.3100 1.004 1320387.00000000 1249506.00000000
n3703 3602.7100 3587.0200 1.004 1316442.00000000 1245249.00000042
n3704 3602.1700 3587.4800 1.004 1327179.00000000 1275337.00000000
n3705 3601.9800 3590.5500 1.003 1326774.00000000 1235935.00000000
n3706 3602.0900 3592.0200 1.003 1321735.00000000 1260625.00000000
n3707 3602.2600 3586.7500 1.004 1301218.00000000 1223045.00000000
n3708 3602.1300 3587.5600 1.004 1323344.00000000 1249143.00000000
n3709 3602.2800 3588.2400 1.004 1324904.00000000 1238114.00000000
n370a 3602.0200 3586.1100 1.004 1336397.00000000 1274430.99999976
n370b 3602.2400 3584.1900 1.005 1341333.00000000 1288808.99999938
n370c 3602.4700 3584.7600 1.005 1317009.00000000 1255727.00000000
n370d 3602.1000 3584.2900 1.005 1317009.00000000 1255727.00000000
n370e 3602.3500 3584.9300 1.005 1315648.00000000 1230411.99999999
seymour 3601.5200 3585.9700 1.004 428.00000000 423.00000000
swath 3600.8600 3334.6400 1.080 571.74954100 469.71069600

### Cbc: fail -- GUROBI: optimal

Modelname Time (Cbc) Time (GUROBI) Ratio (Cbc/GUROBI) Status (Cbc) Obj (GUROBI)
acc-tight-2 3601.2800 31.7200 --- mstat(14)sstat( 3) 0.00000000

### Cbc: optimal:

Modelname Time (Cbc) Obj (Cbc)
10teams 7.9400 924.00000000
acc-tight-0 1.5200 0.00000000
acc-tight-1 4.5900 0.00000000
acc-tight-3 1301.4600 0.00000000
acc-tight-4 3.5100 0.00000000
acc-tight-5 277.7500 0.00000000
acc-tight-6 172.6700 0.00000000
air03 2.1800 340160.00000000
air04 126.5800 56137.00000000
air05 40.3600 26374.00000000
bal8x12 0.1200 471.55000000
bc1 1497.3200 3.33836255
bell3a 1.4600 878430.31600000
bell5 3.1100 8966406.49152000
bienst1 206.5200 46.75000000
bienst2 807.4600 54.60000000
binkar10_1 317.3000 6742.20002400
bk4x3 0.0300 350.00000000
blend2 2.8200 7.59898500
cap6000 2.3200 -2451377.00000000
dano3_3 108.3300 576.34463303
dano3_4 243.4300 576.43522471
dano3_5 451.1400 576.92491596
dcmulti 1.8400 188182.00000000
dsbmip 0.8200 -306.76901203
egout 0.0400 568.10070000
eild76 1491.7500 885.41184700
enigma 2.2300 0.00000000
fast0507 1206.6700 174.00000000
fiber 1.9900 405935.18000000
fixnet6 1.3600 3983.00000000
gen 0.1800 112313.36271800
gesa2 2.4600 25779856.37169790
gesa2_o 7.0600 25779856.37169790
gesa3 1.1500 27991042.64838270
gesa3_o 2.3300 27991042.64838260
gr4x6 0.0400 202.35000000
gt2 0.0200 21166.00000000
irp 20.1300 12159.49283600
khb05250 0.4100 106940226.00000000
l152lav 1.9100 4722.00000000
lseu 0.6100 1120.00000000
mas284 8.7200 91405.72368220
mas74 318.9400 11801.18572900
mas76 21.1600 40005.05414200
misc03 1.5400 3360.00000000
misc06 0.5300 12850.86073738
misc07 25.9600 2810.00000000
mitre 2.1100 115155.00000000
mod008 0.3300 307.00000000
mod010 0.7500 6548.00000000
mod011 112.0600 -54558535.01422740
modglob 5.9000 20740508.08630820
neos1 7.5600 19.00000000
neos2 10.3200 454.86469704
neos3 14.4300 368.84275100
neos4 15.9900 -4.8603440750590E+10
neos5 4.4300 -4.8603440750590E+10
neos7 1074.2600 721934.00000000
noswot 1869.1000 -41.00000000
nug08 17.0800 214.00000000
nw04 11.7500 16862.00000000
p0033 0.0100 3089.00000000
p0201 1.6300 7615.00000000
p0282 0.9900 258411.00000000
p0548 0.1600 8691.00000000
p2756 1.9300 3124.00000000
pk1 37.2200 11.00000000
pp08acuts 13.4200 7350.00000000
pp08a 15.2300 7350.00000000
prod1 21.7500 -56.00000000
qap10 200.0100 340.00000000
qiu 184.3100 -132.87313695
qnet1 2.9200 16029.69268100
qnet1_o 2.1600 16029.69268100
ran10x10a 0.7300 1499.00000000
ran10x10b 0.5300 3073.00000000
ran10x10c 2.6000 13007.00000000
ran10x12 0.8200 2714.00000000
ran10x26 74.3300 4270.00000000
ran12x12 22.5300 2291.00000000
ran12x21 97.0500 3664.00000000
ran13x13 80.9600 3252.00000000
ran16x16 738.1000 3823.00000000
ran17x17 8.8000 1373.00000000
ran4x64 1.0300 9711.00000000
ran6x43 2.3700 6330.00000000
ran8x32 22.3100 5247.00000000
rentacar 4.4300 28882470.94755350
rgn 5.8100 82.19999924
rlp2 0.4500 19.00000000
rout 818.3400 1077.56000000
set1ch 418.4100 54537.75000000
seymour1 1752.7200 410.76370139
stein27 1.8100 18.00000000
stein45 23.5400 30.00000000
swath1 48.4600 379.07130045
swath2 157.5000 385.19969295
vpm1 0.2400 20.00000000
vpm2 2.9500 13.75000000

### Cbc: feasible:

Modelname Time (Cbc) Obj (Cbc)
arki001 3601.4400 7580930.34444415
bc 3603.2200 7.00000000
dano3mip 3629.5700 728.70588235
danoint 3602.6100 65.66666667
harp2 3601.3600 -73876299.00000000
markshare1 3604.2100 4.00000000
markshare2 3601.3200 11.00000000
mkc1 3600.3600 -607.05000000
mkc 3600.4900 -561.24600000
n3700 3602.6100 1326280.00000000
n3701 3602.1800 1310970.00000000
n3702 3601.9300 1320387.00000000
n3703 3602.7100 1316442.00000000
n3704 3602.1700 1327179.00000000
n3705 3601.9800 1326774.00000000
n3706 3602.0900 1321735.00000000
n3707 3602.2600 1301218.00000000
n3708 3602.1300 1323344.00000000
n3709 3602.2800 1324904.00000000
n370a 3602.0200 1336397.00000000
n370b 3602.2400 1341333.00000000
n370c 3602.4700 1317009.00000000
n370d 3602.1000 1317009.00000000
n370e 3602.3500 1315648.00000000
neos6 3601.2300 84.00000000
ran14x18 3603.8300 3736.00000000
seymour 3601.5200 428.00000000
swath 3600.8600 571.74954100

### Cbc: fail:

Modelname Time (Cbc) Status (Cbc)
acc-tight-2 -- mstat(14) sstat( 3)

### GUROBI: optimal:

Modelname Time (GUROBI) Obj (GUROBI)
10teams 8.0100 924.00000000
acc-tight-0 0.4600 0.00000000
acc-tight-1 7.4800 0.00000000
acc-tight-2 31.7200 0.00000000
acc-tight-3 10.0900 0.00000000
acc-tight-4 0.5700 0.00000000
acc-tight-5 14.3000 0.00000000
acc-tight-6 26.4900 0.00000000
air03 0.4900 340160.00000000
air04 14.3000 56137.00000000
air05 12.8200 26374.00000000
arki001 461.9800 7580813.04596374
bal8x12 0.0300 471.55000000
bc1 131.8400 3.33836255
bc 879.6300 7.00000000
bell3a 2.3900 878430.31600000
bell5 0.4500 8966406.49152000
bienst1 7.6700 46.75000000
bienst2 42.6300 54.60000000
binkar10_1 14.1600 6742.20002400
bk4x3 0.0000 350.00000000
blend2 0.2500 7.59898500
cap6000 1.8100 -2451377.00000000
dano3_3 41.2800 576.34463303
dano3_4 89.8900 576.43522471
dano3_5 409.1700 576.92491641
dcmulti 0.2800 188182.00000000
dsbmip 0.1200 -306.76901203
egout 0.0000 568.10070000
eild76 5.9700 885.41184700
enigma 0.1000 0.00000000
fast0507 259.6200 174.00000000
fiber 0.2000 405935.17999998
fixnet6 0.2600 3983.00000000
gen 0.0300 112313.36271800
gesa2 0.7500 25779856.37169790
gesa2_o 2.1400 25779856.37169790
gesa3 0.4600 27991042.64838270
gesa3_o 0.4400 27991042.64838270
gr4x6 0.0000 202.35000000
gt2 0.0100 21166.00000000
harp2 99.2300 -73899798.00000000
irp 4.0700 12159.49283600
khb05250 0.0600 106940226.00000000
l152lav 1.8000 4722.00000000
lseu 0.0900 1120.00000000
mas284 4.8100 91405.72368220
mas74 471.1300 11801.18572900
mas76 24.2900 40005.05414200
misc03 0.8000 3360.00000000
misc06 0.1500 12850.86073738
misc07 15.1100 2810.00000000
mitre 0.1800 115155.00000000
mod008 0.0600 307.00000000
mod010 0.5500 6548.00000000
mod011 77.8900 -54558535.01422740
modglob 0.0900 20740508.08630820
neos1 0.3400 19.00000000
neos2 2.2400 454.86469704
neos3 6.2000 368.84275100
neos4 2.9800 -4.8603440750591E+10
neos5 5.1000 -4.8603440750591E+10
neos6 10.9100 83.00000000
neos7 3.7300 721934.00000000
noswot 322.0400 -41.00000000
nug08 5.3400 214.00000000
nw04 10.9300 16862.00000000
p0033 0.0100 3089.00000000
p0201 0.5700 7615.00000000
p0282 0.1100 258411.00000000
p0548 0.0300 8691.00000000
p2756 0.2500 3124.00000000
pk1 39.6800 11.00000000
pp08acuts 1.1300 7350.00000000
pp08a 0.7100 7350.00000000
prod1 12.8700 -56.00000000
qap10 60.9600 340.00000000
qiu 83.4300 -132.87313695
qnet1 1.4800 16029.69268100
qnet1_o 0.8100 16029.69268100
ran10x10a 0.0800 1499.00000000
ran10x10b 0.0700 3073.00000000
ran10x10c 2.2600 13007.00000000
ran10x12 0.1300 2714.00000000
ran10x26 16.9900 4270.00000000
ran12x12 6.6900 2291.00000000
ran12x21 43.4100 3664.00000000
ran13x13 17.4000 3252.00000000
ran14x18 3055.3300 3712.00000000
ran16x16 148.2600 3823.00000000
ran17x17 2.2500 1373.00000000
ran4x64 0.1500 9711.00000000
ran6x43 0.1500 6330.00000000
ran8x32 7.8000 5247.00000000
rentacar 0.8400 28882470.94743890
rgn 0.5000 82.19999924
rlp2 0.0100 19.00000000
rout 67.6000 1077.56000000
set1ch 0.1500 54537.75000000
seymour1 106.2100 410.76370139
stein27 0.6800 18.00000000
stein45 13.1000 30.00000000
swath1 6.1400 379.07129575
swath2 9.0500 385.19969295
vpm1 0.0000 20.00000000
vpm2 0.8500 13.75000000

### GUROBI: feasible:

Modelname Time (GUROBI) Obj (GUROBI)
dano3mip 3590.6000 694.25000000
danoint 3592.4100 65.66666667
markshare1 703.6400 9.00000000
markshare2 790.6500 14.00000000
mkc1 3583.7600 -607.16700000
mkc 3592.0600 -563.84600000
n3700 3588.4200 1271028.00000000
n3701 3586.9000 1254216.99999997
n3702 3586.3100 1249506.00000000
n3703 3587.0200 1245249.00000042
n3704 3587.4800 1275337.00000000
n3705 3590.5500 1235935.00000000
n3706 3592.0200 1260625.00000000
n3707 3586.7500 1223045.00000000
n3708 3587.5600 1249143.00000000
n3709 3588.2400 1238114.00000000
n370a 3586.1100 1274430.99999976
n370b 3584.1900 1288808.99999938
n370c 3584.7600 1255727.00000000
n370d 3584.2900 1255727.00000000
n370e 3584.9300 1230411.99999999
seymour 3585.9700 423.00000000
swath 3334.6400 469.71069600