## Solver Square Comparison: Considers all models.

 Date / Time: 06/01/08 16:28:17

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX is represented on the left (rows) and solver Cbc on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : 1-CPLEX-1.trc Tracefile 2 : 3-CBC-1.trc Solvers used : CPLEX Cbc Modeltype(s) MIP

 Cbc: optimal Cbc: feasible Cbc: infeasible Cbc: unbounded Cbc: fail Cbc: no data total CPLEX CPLEX: optimal 90 5 - - 4 - 99 CPLEX: feasible - 25 - - - - 25 CPLEX: infeasible - - - - - - - CPLEX: unbounded - - - - - - - CPLEX: fail - 1 - - - - 1 CPLEX: no data - - - - - - - total Cbc 90 31 - - 4 - 125

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (CPLEX) Time (Cbc) Ratio (CPLEX/Cbc) Obj (CPLEX) Obj (Cbc) 10teams 4.0900 45.6200 0.090 924.00000000 924.00000000 acc-tight-0 0.4600 2.8200 0.163 0.00000000 0.00000000 acc-tight-1 1.9900 4.6800 0.425 0.00000000 0.00000000 acc-tight-4 1.3400 3.7600 0.356 0.00000000 0.00000000 acc-tight-5 40.5400 521.7100 0.078 0.00000000 0.00000000 air03 0.4000 2.3900 0.167 340160.00000000 340160.00000000 air04 15.8600 248.9600 0.064 56137.00000000 56137.00000000 air05 9.5800 137.0800 0.070 26374.00000000 26374.00000000 bal8x12 0.1100 0.2600 0.423 471.55000000 471.55000000 bc1 133.5900 1113.0900 0.120 3.33836255 3.33836255 bell3a 1.8500 3.3400 0.554 878430.31600000 878430.31600000 bell5 0.1900 2.6400 0.072 8966406.49152000 8966406.49152000 bienst1 34.0500 114.6000 0.297 46.75000000 46.75000000 bienst2 175.5200 1181.1600 0.149 54.60000000 54.60000000 bk4x3 0.0100 0.0200 --- 350.00000000 350.00000000 blend2 1.2600 5.3200 0.237 7.59898500 7.59898500 cap6000 1.0200 255.2300 0.004 -2451377.00000000 -2451377.00000000 dano3_3 71.8800 189.7200 0.379 576.34463451 576.34463303 dano3_4 92.1500 269.3700 0.342 576.43522471 576.43522471 dano3_5 202.0400 1048.9900 0.193 576.92491596 576.92491596 dcmulti 0.3500 6.3000 0.056 188182.00000000 188182.00000000 dsbmip 0.5300 1.2200 0.434 -306.76901203 -306.76901203 egout 0.0100 0.0400 --- 568.10070000 568.10070000 enigma 0.0100 3.1000 0.003 0.00000000 0.00000000 fiber 0.2500 4.2300 0.059 405935.18000000 405935.18000000 fixnet6 0.9100 5.7000 0.160 3983.00000000 3983.00000000 gen 0.0300 0.1800 0.167 112313.36271800 112313.36271800 gesa2 0.3200 4.3600 0.073 25779856.37169790 25779856.37169790 gesa2_o 0.3100 46.9100 0.007 25779856.37169790 25779856.37169790 gesa3 0.5600 2.0100 0.279 27991042.64838270 27991042.64838270 gesa3_o 0.2800 12.0800 0.023 27991042.64838380 27991042.64838270 gr4x6 0.0100 0.0200 --- 202.35000000 202.35000000 gt2 0.0100 0.1700 0.059 21166.00000000 21166.00000000 harp2 242.6500 617.2800 0.393 -73899798.69998661 -73899798.00000000 irp 5.2700 43.2600 0.122 12159.49283600 12159.49283600 khb05250 0.1100 0.7400 0.149 106940226.00000000 106940226.00000000 l152lav 0.8800 4.8500 0.181 4722.00000000 4722.00000000 lseu 0.0700 2.0000 0.035 1120.00000000 1120.00000000 mas284 4.1800 31.4400 0.133 91405.72368220 91405.72368220 mas76 55.3200 197.4800 0.280 40005.05414200 40005.05414200 misc03 1.0600 3.8400 0.276 3360.00000000 3360.00000000 misc06 0.0900 1.4800 0.061 12850.86073738 12850.86073738 misc07 32.6600 104.0300 0.314 2810.00000000 2810.00000000 mitre 0.4900 11.6500 0.042 115155.00000000 115155.00000000 mod008 0.0900 4.3400 0.021 307.00000000 307.00000000 mod010 0.3200 0.8300 0.386 6548.00000000 6548.00000000 mod011 88.5600 192.0600 0.461 -54558535.01422730 -54558535.01422730 modglob 0.1600 32.6400 0.005 20740508.08630820 20740508.08630820 neos1 0.7600 15.5100 0.049 19.00000000 19.00000000 neos2 4.4000 1300.0700 0.003 454.86469704 454.86970173 neos4 3.4000 13.3400 0.255 -4.8603440750589E+10 -4.8603440750589E+10 neos5 3.5900 9.3500 0.384 -4.8603440750589E+10 -4.8603440750589E+10 neos6 65.0500 325.0500 0.200 83.00000000 83.00000000 nw04 33.7100 16.1700 2.085 16862.00000000 16862.00000000 p0033 0.0100 0.0400 --- 3089.00000000 3089.00000000 p0201 0.2700 8.3600 0.032 7615.00000000 7615.00000000 p0282 0.1000 4.8300 0.021 258411.00000000 258411.00000000 p0548 0.0400 0.4100 0.098 8691.00000000 8691.00000000 p2756 0.3300 8.2400 0.040 3124.00000000 3124.00000000 pk1 128.6600 95.9900 1.340 11.00000000 11.00000000 pp08acuts 1.4900 94.5500 0.016 7350.00000000 7350.00000000 pp08a 1.1200 24.0400 0.047 7350.00000000 7350.00000000 prod1 14.3200 151.0600 0.095 -56.00000000 -56.00000000 qiu 34.4500 230.6900 0.149 -132.87313695 -132.87313695 qnet1 1.5400 4.7600 0.324 16029.69268100 16029.69268100 qnet1_o 1.0000 9.9000 0.101 16029.69268100 16029.69268100 ran10x10a 0.1800 1.0900 0.165 1499.00000000 1499.00000000 ran10x10b 0.1400 1.5300 0.092 3073.00000000 3073.00000000 ran10x10c 1.4200 9.4600 0.150 13007.00000000 13007.00000000 ran10x12 0.3200 0.9800 0.327 2714.00000000 2714.00000000 ran10x26 12.5700 74.6500 0.168 4270.00000000 4270.00000000 ran12x12 9.9600 86.9500 0.115 2291.00000000 2291.00000000 ran12x21 64.6300 220.5100 0.293 3664.00000000 3664.00000000 ran13x13 19.2400 158.4600 0.121 3252.00000000 3252.00000000 ran16x16 169.4400 1347.0800 0.126 3823.00000000 3823.00000000 ran17x17 5.8200 44.0500 0.132 1373.00000000 1373.00000000 ran4x64 0.1900 2.2200 0.086 9711.00000000 9711.00000000 ran6x43 0.3100 3.1200 0.099 6330.00000000 6330.00000000 ran8x32 3.4400 102.0700 0.034 5247.00000000 5247.00000000 rentacar 0.4600 20.6600 0.022 28882470.94755350 28882470.94755360 rgn 0.1500 5.3800 0.028 82.19999924 82.19999924 rlp2 0.0200 3.4100 0.006 19.00000000 19.00000000 rout 13.4000 1469.3500 0.009 1077.56000000 1077.56000000 seymour1 215.5700 1575.7400 0.137 410.76370139 410.76370139 stein27 0.2400 2.9700 0.081 18.00000000 18.00000000 stein45 12.0800 75.4900 0.160 30.00000000 30.00000000 swath1 12.6800 394.6700 0.032 379.07129575 379.07129575 swath2 11.3400 901.9800 0.013 385.19969295 385.19969295 vpm1 0.0400 0.1500 0.267 20.00000000 20.00000000 vpm2 0.4700 3.9600 0.119 13.75000000 13.75000000

 Modelname Time (CPLEX) Time (Cbc) Ratio (CPLEX/Cbc) Obj (CPLEX) Obj (Cbc) binkar10_1 18.5400 3603.3600 0.005 6742.20002400 6742.20002400 fast0507 1921.1400 3604.8800 0.533 174.00000000 178.00000000 neos3 34.3900 3602.8900 0.010 368.84275100 369.35192970 ran14x18 2569.6400 2962.8400 0.867 3712.00000000 3754.00000000 set1ch 0.3200 3602.5000 0.000 54537.75000000 54543.00000000

 Modelname Time (CPLEX) Time (Cbc) Ratio (CPLEX/Cbc) Obj (CPLEX) Status (Cbc) acc-tight-2 58.0300 3601.6700 --- 0.00000000 mstat(14) sstat( 3) acc-tight-3 1776.3900 3601.1600 --- 0.00000000 mstat(14) sstat( 3) acc-tight-6 48.4900 3601.1800 --- 0.00000000 mstat(14) sstat( 3) mkc1 30.3200 NA --- -607.20700000 mstat(13) sstat(13)

 Modelname Time (CPLEX) Time (Cbc) Ratio (CPLEX/Cbc) Obj (CPLEX) Obj (Cbc) arki001 2252.9500 3605.8600 0.625 7580813.04593797 7582707.95503836 bc 3600.0900 3216.3800 1.119 7.00000000 7.00000000 dano3mip 3600.2600 3656.4200 0.985 699.66666667 764.96296296 danoint 3600.0200 3602.2500 0.999 65.66666667 65.66666667 markshare1 383.7900 332.7700 1.153 9.00000000 16.00000000 markshare2 479.1800 380.0500 1.261 24.00000000 39.00000000 mas74 133.5300 397.5900 0.336 11801.18572900 11801.18572900 mkc 3600.0900 3602.8400 0.999 -563.84600000 -540.31200000 n3700 3600.1100 3604.0000 0.999 1305784.00000000 1485299.00000000 n3701 3600.0900 3604.0800 0.999 1291970.00000000 1478706.00000000 n3702 3600.1000 3603.2900 0.999 1287849.00000000 1492733.00000000 n3703 3600.1000 3602.0500 0.999 1268328.00000000 2012229.00000000 n3704 3600.1200 3602.6200 0.999 1304408.00000000 1478967.00000000 n3705 3600.0700 3603.6900 0.999 1291866.00000000 1461824.00000000 n3706 3600.0800 3603.4000 0.999 1290398.00000000 1492521.00000000 n3707 3600.0500 3602.5700 0.999 1285797.00000000 2034880.00000000 n3708 3600.1400 3602.9200 0.999 1289368.00000000 1439272.00000000 n3709 3600.1400 3603.7900 0.999 1300945.00000000 1485358.00000000 n370a 3600.1500 3603.9400 0.999 1308329.00000000 1531728.00000000 n370b 3600.1400 3604.0500 0.999 1295708.00000000 1496205.00000000 n370c 3600.1000 3603.6600 0.999 1297332.00000000 1472412.00000000 n370d 3600.0800 3604.0200 0.999 1297332.00000000 1472412.00000000 n370e 3600.1100 3602.3400 0.999 1272104.00000000 2007778.00000000 noswot 894.4000 1170.9300 0.764 -41.00000000 -41.00000000 seymour 3600.0700 3602.6900 0.999 424.00000000 430.00000000

 Modelname Time (CPLEX) Time (Cbc) Ratio (CPLEX/Cbc) Status (CPLEX) Obj (Cbc) swath 1221.4000 3602.3000 --- mstat(14) sstat( 4) 514.60367300

 Modelname Time (CPLEX) Obj (CPLEX) 10teams 4.0900 924.00000000 acc-tight-0 0.4600 0.00000000 acc-tight-1 1.9900 0.00000000 acc-tight-2 58.0300 0.00000000 acc-tight-3 1776.3900 0.00000000 acc-tight-4 1.3400 0.00000000 acc-tight-5 40.5400 0.00000000 acc-tight-6 48.4900 0.00000000 air03 0.4000 340160.00000000 air04 15.8600 56137.00000000 air05 9.5800 26374.00000000 bal8x12 0.1100 471.55000000 bc1 133.5900 3.33836255 bell3a 1.8500 878430.31600000 bell5 0.1900 8966406.49152000 bienst1 34.0500 46.75000000 bienst2 175.5200 54.60000000 binkar10_1 18.5400 6742.20002400 bk4x3 0.0100 350.00000000 blend2 1.2600 7.59898500 cap6000 1.0200 -2451377.00000000 dano3_3 71.8800 576.34463451 dano3_4 92.1500 576.43522471 dano3_5 202.0400 576.92491596 dcmulti 0.3500 188182.00000000 dsbmip 0.5300 -306.76901203 egout 0.0100 568.10070000 enigma 0.0100 0.00000000 fast0507 1921.1400 174.00000000 fiber 0.2500 405935.18000000 fixnet6 0.9100 3983.00000000 gen 0.0300 112313.36271800 gesa2 0.3200 25779856.37169790 gesa2_o 0.3100 25779856.37169790 gesa3 0.5600 27991042.64838270 gesa3_o 0.2800 27991042.64838380 gr4x6 0.0100 202.35000000 gt2 0.0100 21166.00000000 harp2 242.6500 -73899798.69998661 irp 5.2700 12159.49283600 khb05250 0.1100 106940226.00000000 l152lav 0.8800 4722.00000000 lseu 0.0700 1120.00000000 mas284 4.1800 91405.72368220 mas76 55.3200 40005.05414200 misc03 1.0600 3360.00000000 misc06 0.0900 12850.86073738 misc07 32.6600 2810.00000000 mitre 0.4900 115155.00000000 mkc1 30.3200 -607.20700000 mod008 0.0900 307.00000000 mod010 0.3200 6548.00000000 mod011 88.5600 -54558535.01422730 modglob 0.1600 20740508.08630820 neos1 0.7600 19.00000000 neos2 4.4000 454.86469704 neos3 34.3900 368.84275100 neos4 3.4000 -4.8603440750589E+10 neos5 3.5900 -4.8603440750589E+10 neos6 65.0500 83.00000000 nw04 33.7100 16862.00000000 p0033 0.0100 3089.00000000 p0201 0.2700 7615.00000000 p0282 0.1000 258411.00000000 p0548 0.0400 8691.00000000 p2756 0.3300 3124.00000000 pk1 128.6600 11.00000000 pp08acuts 1.4900 7350.00000000 pp08a 1.1200 7350.00000000 prod1 14.3200 -56.00000000 qiu 34.4500 -132.87313695 qnet1 1.5400 16029.69268100 qnet1_o 1.0000 16029.69268100 ran10x10a 0.1800 1499.00000000 ran10x10b 0.1400 3073.00000000 ran10x10c 1.4200 13007.00000000 ran10x12 0.3200 2714.00000000 ran10x26 12.5700 4270.00000000 ran12x12 9.9600 2291.00000000 ran12x21 64.6300 3664.00000000 ran13x13 19.2400 3252.00000000 ran14x18 2569.6400 3712.00000000 ran16x16 169.4400 3823.00000000 ran17x17 5.8200 1373.00000000 ran4x64 0.1900 9711.00000000 ran6x43 0.3100 6330.00000000 ran8x32 3.4400 5247.00000000 rentacar 0.4600 28882470.94755350 rgn 0.1500 82.19999924 rlp2 0.0200 19.00000000 rout 13.4000 1077.56000000 set1ch 0.3200 54537.75000000 seymour1 215.5700 410.76370139 stein27 0.2400 18.00000000 stein45 12.0800 30.00000000 swath1 12.6800 379.07129575 swath2 11.3400 385.19969295 vpm1 0.0400 20.00000000 vpm2 0.4700 13.75000000

 Modelname Time (CPLEX) Obj (CPLEX) arki001 2252.9500 7580813.04593797 bc 3600.0900 7.00000000 dano3mip 3600.2600 699.66666667 danoint 3600.0200 65.66666667 markshare1 383.7900 9.00000000 markshare2 479.1800 24.00000000 mas74 133.5300 11801.18572900 mkc 3600.0900 -563.84600000 n3700 3600.1100 1305784.00000000 n3701 3600.0900 1291970.00000000 n3702 3600.1000 1287849.00000000 n3703 3600.1000 1268328.00000000 n3704 3600.1200 1304408.00000000 n3705 3600.0700 1291866.00000000 n3706 3600.0800 1290398.00000000 n3707 3600.0500 1285797.00000000 n3708 3600.1400 1289368.00000000 n3709 3600.1400 1300945.00000000 n370a 3600.1500 1308329.00000000 n370b 3600.1400 1295708.00000000 n370c 3600.1000 1297332.00000000 n370d 3600.0800 1297332.00000000 n370e 3600.1100 1272104.00000000 noswot 894.4000 -41.00000000 seymour 3600.0700 424.00000000

 Modelname Time (CPLEX) Status (CPLEX) swath -- mstat(14) sstat( 4)

 Modelname Time (Cbc) Obj (Cbc) 10teams 45.6200 924.00000000 acc-tight-0 2.8200 0.00000000 acc-tight-1 4.6800 0.00000000 acc-tight-4 3.7600 0.00000000 acc-tight-5 521.7100 0.00000000 air03 2.3900 340160.00000000 air04 248.9600 56137.00000000 air05 137.0800 26374.00000000 bal8x12 0.2600 471.55000000 bc1 1113.0900 3.33836255 bell3a 3.3400 878430.31600000 bell5 2.6400 8966406.49152000 bienst1 114.6000 46.75000000 bienst2 1181.1600 54.60000000 bk4x3 0.0200 350.00000000 blend2 5.3200 7.59898500 cap6000 255.2300 -2451377.00000000 dano3_3 189.7200 576.34463303 dano3_4 269.3700 576.43522471 dano3_5 1048.9900 576.92491596 dcmulti 6.3000 188182.00000000 dsbmip 1.2200 -306.76901203 egout 0.0400 568.10070000 enigma 3.1000 0.00000000 fiber 4.2300 405935.18000000 fixnet6 5.7000 3983.00000000 gen 0.1800 112313.36271800 gesa2 4.3600 25779856.37169790 gesa2_o 46.9100 25779856.37169790 gesa3 2.0100 27991042.64838270 gesa3_o 12.0800 27991042.64838270 gr4x6 0.0200 202.35000000 gt2 0.1700 21166.00000000 harp2 617.2800 -73899798.00000000 irp 43.2600 12159.49283600 khb05250 0.7400 106940226.00000000 l152lav 4.8500 4722.00000000 lseu 2.0000 1120.00000000 mas284 31.4400 91405.72368220 mas76 197.4800 40005.05414200 misc03 3.8400 3360.00000000 misc06 1.4800 12850.86073738 misc07 104.0300 2810.00000000 mitre 11.6500 115155.00000000 mod008 4.3400 307.00000000 mod010 0.8300 6548.00000000 mod011 192.0600 -54558535.01422730 modglob 32.6400 20740508.08630820 neos1 15.5100 19.00000000 neos2 1300.0700 454.86970173 neos4 13.3400 -4.8603440750589E+10 neos5 9.3500 -4.8603440750589E+10 neos6 325.0500 83.00000000 nw04 16.1700 16862.00000000 p0033 0.0400 3089.00000000 p0201 8.3600 7615.00000000 p0282 4.8300 258411.00000000 p0548 0.4100 8691.00000000 p2756 8.2400 3124.00000000 pk1 95.9900 11.00000000 pp08acuts 94.5500 7350.00000000 pp08a 24.0400 7350.00000000 prod1 151.0600 -56.00000000 qiu 230.6900 -132.87313695 qnet1 4.7600 16029.69268100 qnet1_o 9.9000 16029.69268100 ran10x10a 1.0900 1499.00000000 ran10x10b 1.5300 3073.00000000 ran10x10c 9.4600 13007.00000000 ran10x12 0.9800 2714.00000000 ran10x26 74.6500 4270.00000000 ran12x12 86.9500 2291.00000000 ran12x21 220.5100 3664.00000000 ran13x13 158.4600 3252.00000000 ran16x16 1347.0800 3823.00000000 ran17x17 44.0500 1373.00000000 ran4x64 2.2200 9711.00000000 ran6x43 3.1200 6330.00000000 ran8x32 102.0700 5247.00000000 rentacar 20.6600 28882470.94755360 rgn 5.3800 82.19999924 rlp2 3.4100 19.00000000 rout 1469.3500 1077.56000000 seymour1 1575.7400 410.76370139 stein27 2.9700 18.00000000 stein45 75.4900 30.00000000 swath1 394.6700 379.07129575 swath2 901.9800 385.19969295 vpm1 0.1500 20.00000000 vpm2 3.9600 13.75000000

 Modelname Time (Cbc) Obj (Cbc) arki001 3605.8600 7582707.95503836 bc 3216.3800 7.00000000 binkar10_1 3603.3600 6742.20002400 dano3mip 3656.4200 764.96296296 danoint 3602.2500 65.66666667 fast0507 3604.8800 178.00000000 markshare1 332.7700 16.00000000 markshare2 380.0500 39.00000000 mas74 397.5900 11801.18572900 mkc 3602.8400 -540.31200000 n3700 3604.0000 1485299.00000000 n3701 3604.0800 1478706.00000000 n3702 3603.2900 1492733.00000000 n3703 3602.0500 2012229.00000000 n3704 3602.6200 1478967.00000000 n3705 3603.6900 1461824.00000000 n3706 3603.4000 1492521.00000000 n3707 3602.5700 2034880.00000000 n3708 3602.9200 1439272.00000000 n3709 3603.7900 1485358.00000000 n370a 3603.9400 1531728.00000000 n370b 3604.0500 1496205.00000000 n370c 3603.6600 1472412.00000000 n370d 3604.0200 1472412.00000000 n370e 3602.3400 2007778.00000000 neos3 3602.8900 369.35192970 noswot 1170.9300 -41.00000000 ran14x18 2962.8400 3754.00000000 set1ch 3602.5000 54543.00000000 seymour 3602.6900 430.00000000 swath 3602.3000 514.60367300