## Solver Square Comparison: Considers all models.

 Date / Time: 10/04/08 13:46:30

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX is represented on the left (rows) and solver SCIP11 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : CPLEX-1.trc Tracefile 2 : SCIP11-1.trc Solvers used : CPLEX SCIP11 Modeltype(s) MIP

 SCIP11: optimal SCIP11: feasible SCIP11: infeasible SCIP11: unbounded SCIP11: fail SCIP11: no data total CPLEX CPLEX: optimal 93 7 - - - - 100 CPLEX: feasible 1 23 - - - - 24 CPLEX: infeasible - - - - - - - CPLEX: unbounded - - - - - - - CPLEX: fail - 1 - - - - 1 CPLEX: no data - - - - - - - total SCIP11 94 31 - - - - 125

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (CPLEX) Time (SCIP11) Ratio (CPLEX/SCIP11) Obj (CPLEX) Obj (SCIP11) 10teams 4.3200 20.7000 0.209 924.00000000 924.00000000 acc-tight-0 0.4800 3.1100 0.154 0.00000000 0.00000000 acc-tight-1 1.9800 126.7200 0.016 0.00000000 0.00000000 acc-tight-2 56.1900 643.7600 0.087 0.00000000 0.00000000 acc-tight-3 1700.7700 117.4600 14.480 0.00000000 0.00000000 acc-tight-4 1.3300 94.8400 0.014 0.00000000 0.00000000 acc-tight-5 39.5900 354.9100 0.112 0.00000000 0.00000000 acc-tight-6 49.1500 1390.8200 0.035 0.00000000 0.00000000 air03 0.4600 36.7300 0.013 340160.00000000 340160.00000000 air05 9.6300 84.8800 0.113 26374.00000000 26374.00000000 bal8x12 0.1000 0.5600 0.179 471.55000000 471.55000000 bc1 133.6400 352.1900 0.379 3.33836255 3.33836255 bell3a 1.8600 21.5300 0.086 878430.31600000 878430.31600000 bell5 0.1800 0.8800 0.205 8966406.49152000 8966406.49152000 bienst1 35.4700 54.3700 0.652 46.75000000 46.75000000 bienst2 190.6700 520.5800 0.366 54.60000000 54.60000000 binkar10_1 18.7000 1970.4700 0.009 6742.20002400 6742.20002400 bk4x3 0.0000 0.0300 --- 350.00000000 350.00000000 blend2 1.3200 0.6300 2.095 7.59898500 7.59898500 cap6000 1.0800 8.1300 0.133 -2451377.00000000 -2451377.00000000 dano3_3 72.8300 492.8500 0.148 576.34463451 576.34463303 dano3_4 91.9000 725.1000 0.127 576.43522471 576.43522471 dano3_5 245.1400 1625.0900 0.151 576.92491596 576.92491596 dcmulti 0.3500 3.4000 0.103 188182.00000000 188182.00000000 dsbmip 0.5200 0.4800 1.083 -306.76901203 -306.76901203 egout 0.0000 0.0400 --- 568.10070000 568.10070000 enigma 0.0100 0.7400 0.014 0.00000000 0.00000000 fiber 0.2400 1.5500 0.155 405935.18000000 405935.18000000 fixnet6 1.0000 5.5600 0.180 3983.00000000 3983.00000000 gen 0.0200 0.2400 0.083 112313.36271800 112313.36271800 gesa2 0.3300 1.7600 0.188 25779856.37169790 25779856.37169790 gesa2_o 0.3200 1.8000 0.178 25779856.37169790 25779856.37169790 gesa3 0.6100 2.5100 0.243 27991042.64838270 27991042.64838270 gesa3_o 0.2700 3.2500 0.083 27991042.64838380 27991042.64838270 gr4x6 0.0100 0.0500 0.200 202.35000000 202.35000000 gt2 0.0200 0.1400 0.143 21166.00000000 21166.00000000 irp 5.0400 68.5600 0.074 12159.49283600 12159.49283600 khb05250 0.1100 0.9100 0.121 106940226.00000000 106940226.00000000 l152lav 0.8800 7.8900 0.112 4722.00000000 4722.00000000 lseu 0.0600 0.4400 0.136 1120.00000000 1120.00000000 mas284 4.2600 51.6200 0.083 91405.72368220 91405.72368220 mas74 328.6000 2282.5900 0.144 11801.18572900 11801.18572900 mas76 57.2300 164.5500 0.348 40005.05414200 40005.05414200 misc03 1.0400 2.5600 0.406 3360.00000000 3360.00000000 misc07 32.9700 66.8900 0.493 2810.00000000 2810.00000000 mitre 0.5200 18.4900 0.028 115155.00000000 115155.00000000 mod008 0.1000 0.7600 0.132 307.00000000 307.00000000 mod010 0.3400 2.0500 0.166 6548.00000000 6548.00000000 mod011 109.4300 437.3100 0.250 -54558535.01422730 -54558535.01422720 modglob 0.1500 0.7400 0.203 20740508.08630820 20740508.08630820 neos1 0.7200 23.3800 0.031 19.00000000 19.00000000 neos2 29.5200 223.2200 0.132 454.86469704 454.86469703 neos4 3.2000 4.5200 0.708 -4.8603440750589E+10 -4.8603440750589E+10 neos5 3.1200 4.2700 0.731 -4.8603440750589E+10 -4.8603440750589E+10 neos6 80.6100 606.3300 0.133 83.00000000 83.00000000 nw04 33.0400 67.1200 0.492 16862.00000000 16862.00000000 p0033 0.0100 0.1300 0.077 3089.00000000 3089.00000000 p0201 0.2700 1.9300 0.140 7615.00000000 7615.00000000 p0282 0.1000 0.7700 0.130 258411.00000000 258411.00000000 p0548 0.0400 0.4400 0.091 8691.00000000 8691.00000000 p2756 0.3100 2.9600 0.105 3124.00000000 3124.00000000 pk1 129.5300 246.1200 0.526 11.00000000 11.00000000 pp08acuts 1.4200 3.5000 0.406 7350.00000000 7350.00000000 pp08a 1.0600 2.8800 0.368 7350.00000000 7350.00000000 prod1 15.5800 45.0700 0.346 -56.00000000 -56.00000000 qiu 48.5300 226.3400 0.214 -132.87313695 -132.87313695 qnet1 1.5200 7.9800 0.190 16029.69268100 16029.69268100 qnet1_o 0.9800 3.6900 0.266 16029.69268100 16029.69268100 ran10x10a 0.1600 1.0300 0.155 1499.00000000 1499.00000000 ran10x10b 0.1200 0.6200 0.194 3073.00000000 3073.00000000 ran10x10c 1.4300 4.1500 0.345 13007.00000000 13007.00000000 ran10x12 0.3400 0.8200 0.415 2714.00000000 2714.00000000 ran10x26 12.6100 100.4000 0.126 4270.00000000 4270.00000000 ran12x12 9.5200 44.5100 0.214 2291.00000000 2291.00000000 ran12x21 63.1100 261.5000 0.241 3664.00000000 3664.00000000 ran13x13 19.4500 108.5600 0.179 3252.00000000 3252.00000000 ran16x16 163.8600 1202.8400 0.136 3823.00000000 3823.00000000 ran17x17 5.2600 36.1200 0.146 1373.00000000 1373.00000000 ran4x64 0.1800 1.3300 0.135 9711.00000000 9711.00000000 ran6x43 0.3100 3.0400 0.102 6330.00000000 6330.00000000 ran8x32 3.2600 65.6300 0.050 5247.00000000 5247.00000000 rentacar 0.4600 4.8800 0.094 28882470.94755350 28882470.94755340 rgn 0.1500 1.4200 0.106 82.19999924 82.19999704 rlp2 0.0200 4.5400 0.004 19.00000000 19.00000000 rout 12.0600 74.8300 0.161 1077.56000000 1077.56000000 set1ch 0.3300 0.9000 0.367 54537.75000000 54537.75000000 seymour1 219.5900 1317.9900 0.167 410.76370139 410.76370139 stein27 0.2400 2.2700 0.106 18.00000000 18.00000000 stein45 11.0900 51.2300 0.216 30.00000000 30.00000000 swath1 13.2900 115.2900 0.115 379.07129575 379.07129575 swath2 11.3200 104.0600 0.109 385.19969295 385.19969295 vpm1 0.0800 0.3000 0.267 20.00000000 20.00000000 vpm2 0.7800 2.3600 0.331 13.75000000 13.75000000

 Modelname Time (CPLEX) Time (SCIP11) Ratio (CPLEX/SCIP11) Obj (CPLEX) Obj (SCIP11) air04 16.5400 186.4700 0.089 56137.00000000 56138.00000000 fast0507 1862.9000 3600.8500 0.517 174.00000000 175.00000000 harp2 281.9200 3600.0200 0.078 -73899798.69998661 -73899798.00000000 misc06 0.1000 0.6000 0.167 12850.86073738 12851.89767834 mkc1 31.6300 3600.0400 0.009 -607.20700000 -606.71000000 neos3 45.4900 3600.0200 0.013 368.84275100 441.33723249 ran14x18 2572.4600 3600.0000 0.715 3712.00000000 3736.00000000

 Modelname Time (CPLEX) Time (SCIP11) Ratio (CPLEX/SCIP11) Obj (CPLEX) Obj (SCIP11) noswot 3600.0100 285.5000 12.609 -41.00000000 -41.00000000

 Modelname Time (CPLEX) Time (SCIP11) Ratio (CPLEX/SCIP11) Obj (CPLEX) Obj (SCIP11) arki001 3600.0400 3600.0200 1.000 7580813.04595096 7580827.88272227 bc 3600.2300 3600.2200 1.000 7.00000000 7.00000000 dano3mip 3600.3600 3600.2600 1.000 717.18181818 759.71428571 danoint 3600.0000 3600.0300 1.000 65.66666667 65.66666667 markshare1 3600.0100 3595.8500 1.001 6.00000000 8.00000000 markshare2 3600.0100 3600.0100 1.000 17.00000000 17.00000000 mkc 3600.1000 3600.0400 1.000 -563.84600000 -551.22600000 n3700 3600.0900 3600.0600 1.000 1305784.00000000 1342560.00000000 n3701 3600.1400 3600.1300 1.000 1288319.00000000 1310970.00000000 n3702 3600.0800 3600.1200 1.000 1281202.00000000 1317425.00000000 n3703 3600.1000 3600.0500 1.000 1268328.00000000 1316442.00000000 n3704 3600.0900 3600.1400 1.000 1304313.00000000 1327179.00000000 n3705 3600.1000 3600.1300 1.000 1306784.00000000 1342540.00000000 n3706 3600.1000 3600.1400 1.000 1281325.00000000 1321735.00000000 n3707 3600.1000 3600.0700 1.000 1257876.00000000 1301218.00000000 n3708 3600.1200 3600.1200 1.000 1297991.00000000 1329479.00000000 n3709 3600.1000 3600.0600 1.000 1301093.00000000 1324904.00000000 n370a 3600.1200 3600.1800 1.000 1322031.00000000 1353042.00000000 n370b 3600.1000 3600.1100 1.000 1302170.00000000 1353622.00000000 n370c 3600.1200 3600.2000 1.000 1303884.00000000 1343749.00000000 n370d 3600.1000 3600.1200 1.000 1303884.00000000 1343749.00000000 n370e 3600.1500 3600.0400 1.000 1274838.00000000 1309467.99999998 seymour 3600.0600 3600.0500 1.000 424.00000000 426.00000000

 Modelname Time (CPLEX) Time (SCIP11) Ratio (CPLEX/SCIP11) Status (CPLEX) Obj (SCIP11) swath 1220.1400 3600.0600 --- mstat(14) sstat( 4) 502.85720300

 Modelname Time (CPLEX) Obj (CPLEX) 10teams 4.3200 924.00000000 acc-tight-0 0.4800 0.00000000 acc-tight-1 1.9800 0.00000000 acc-tight-2 56.1900 0.00000000 acc-tight-3 1700.7700 0.00000000 acc-tight-4 1.3300 0.00000000 acc-tight-5 39.5900 0.00000000 acc-tight-6 49.1500 0.00000000 air03 0.4600 340160.00000000 air04 16.5400 56137.00000000 air05 9.6300 26374.00000000 bal8x12 0.1000 471.55000000 bc1 133.6400 3.33836255 bell3a 1.8600 878430.31600000 bell5 0.1800 8966406.49152000 bienst1 35.4700 46.75000000 bienst2 190.6700 54.60000000 binkar10_1 18.7000 6742.20002400 bk4x3 0.0000 350.00000000 blend2 1.3200 7.59898500 cap6000 1.0800 -2451377.00000000 dano3_3 72.8300 576.34463451 dano3_4 91.9000 576.43522471 dano3_5 245.1400 576.92491596 dcmulti 0.3500 188182.00000000 dsbmip 0.5200 -306.76901203 egout 0.0000 568.10070000 enigma 0.0100 0.00000000 fast0507 1862.9000 174.00000000 fiber 0.2400 405935.18000000 fixnet6 1.0000 3983.00000000 gen 0.0200 112313.36271800 gesa2 0.3300 25779856.37169790 gesa2_o 0.3200 25779856.37169790 gesa3 0.6100 27991042.64838270 gesa3_o 0.2700 27991042.64838380 gr4x6 0.0100 202.35000000 gt2 0.0200 21166.00000000 harp2 281.9200 -73899798.69998661 irp 5.0400 12159.49283600 khb05250 0.1100 106940226.00000000 l152lav 0.8800 4722.00000000 lseu 0.0600 1120.00000000 mas284 4.2600 91405.72368220 mas74 328.6000 11801.18572900 mas76 57.2300 40005.05414200 misc03 1.0400 3360.00000000 misc06 0.1000 12850.86073738 misc07 32.9700 2810.00000000 mitre 0.5200 115155.00000000 mkc1 31.6300 -607.20700000 mod008 0.1000 307.00000000 mod010 0.3400 6548.00000000 mod011 109.4300 -54558535.01422730 modglob 0.1500 20740508.08630820 neos1 0.7200 19.00000000 neos2 29.5200 454.86469704 neos3 45.4900 368.84275100 neos4 3.2000 -4.8603440750589E+10 neos5 3.1200 -4.8603440750589E+10 neos6 80.6100 83.00000000 nw04 33.0400 16862.00000000 p0033 0.0100 3089.00000000 p0201 0.2700 7615.00000000 p0282 0.1000 258411.00000000 p0548 0.0400 8691.00000000 p2756 0.3100 3124.00000000 pk1 129.5300 11.00000000 pp08acuts 1.4200 7350.00000000 pp08a 1.0600 7350.00000000 prod1 15.5800 -56.00000000 qiu 48.5300 -132.87313695 qnet1 1.5200 16029.69268100 qnet1_o 0.9800 16029.69268100 ran10x10a 0.1600 1499.00000000 ran10x10b 0.1200 3073.00000000 ran10x10c 1.4300 13007.00000000 ran10x12 0.3400 2714.00000000 ran10x26 12.6100 4270.00000000 ran12x12 9.5200 2291.00000000 ran12x21 63.1100 3664.00000000 ran13x13 19.4500 3252.00000000 ran14x18 2572.4600 3712.00000000 ran16x16 163.8600 3823.00000000 ran17x17 5.2600 1373.00000000 ran4x64 0.1800 9711.00000000 ran6x43 0.3100 6330.00000000 ran8x32 3.2600 5247.00000000 rentacar 0.4600 28882470.94755350 rgn 0.1500 82.19999924 rlp2 0.0200 19.00000000 rout 12.0600 1077.56000000 set1ch 0.3300 54537.75000000 seymour1 219.5900 410.76370139 stein27 0.2400 18.00000000 stein45 11.0900 30.00000000 swath1 13.2900 379.07129575 swath2 11.3200 385.19969295 vpm1 0.0800 20.00000000 vpm2 0.7800 13.75000000

 Modelname Time (CPLEX) Obj (CPLEX) arki001 3600.0400 7580813.04595096 bc 3600.2300 7.00000000 dano3mip 3600.3600 717.18181818 danoint 3600.0000 65.66666667 markshare1 3600.0100 6.00000000 markshare2 3600.0100 17.00000000 mkc 3600.1000 -563.84600000 n3700 3600.0900 1305784.00000000 n3701 3600.1400 1288319.00000000 n3702 3600.0800 1281202.00000000 n3703 3600.1000 1268328.00000000 n3704 3600.0900 1304313.00000000 n3705 3600.1000 1306784.00000000 n3706 3600.1000 1281325.00000000 n3707 3600.1000 1257876.00000000 n3708 3600.1200 1297991.00000000 n3709 3600.1000 1301093.00000000 n370a 3600.1200 1322031.00000000 n370b 3600.1000 1302170.00000000 n370c 3600.1200 1303884.00000000 n370d 3600.1000 1303884.00000000 n370e 3600.1500 1274838.00000000 noswot 3600.0100 -41.00000000 seymour 3600.0600 424.00000000

 Modelname Time (CPLEX) Status (CPLEX) swath -- mstat(14) sstat( 4)

 Modelname Time (SCIP11) Obj (SCIP11) 10teams 20.7000 924.00000000 acc-tight-0 3.1100 0.00000000 acc-tight-1 126.7200 0.00000000 acc-tight-2 643.7600 0.00000000 acc-tight-3 117.4600 0.00000000 acc-tight-4 94.8400 0.00000000 acc-tight-5 354.9100 0.00000000 acc-tight-6 1390.8200 0.00000000 air03 36.7300 340160.00000000 air05 84.8800 26374.00000000 bal8x12 0.5600 471.55000000 bc1 352.1900 3.33836255 bell3a 21.5300 878430.31600000 bell5 0.8800 8966406.49152000 bienst1 54.3700 46.75000000 bienst2 520.5800 54.60000000 binkar10_1 1970.4700 6742.20002400 bk4x3 0.0300 350.00000000 blend2 0.6300 7.59898500 cap6000 8.1300 -2451377.00000000 dano3_3 492.8500 576.34463303 dano3_4 725.1000 576.43522471 dano3_5 1625.0900 576.92491596 dcmulti 3.4000 188182.00000000 dsbmip 0.4800 -306.76901203 egout 0.0400 568.10070000 enigma 0.7400 0.00000000 fiber 1.5500 405935.18000000 fixnet6 5.5600 3983.00000000 gen 0.2400 112313.36271800 gesa2 1.7600 25779856.37169790 gesa2_o 1.8000 25779856.37169790 gesa3 2.5100 27991042.64838270 gesa3_o 3.2500 27991042.64838270 gr4x6 0.0500 202.35000000 gt2 0.1400 21166.00000000 irp 68.5600 12159.49283600 khb05250 0.9100 106940226.00000000 l152lav 7.8900 4722.00000000 lseu 0.4400 1120.00000000 mas284 51.6200 91405.72368220 mas74 2282.5900 11801.18572900 mas76 164.5500 40005.05414200 misc03 2.5600 3360.00000000 misc07 66.8900 2810.00000000 mitre 18.4900 115155.00000000 mod008 0.7600 307.00000000 mod010 2.0500 6548.00000000 mod011 437.3100 -54558535.01422720 modglob 0.7400 20740508.08630820 neos1 23.3800 19.00000000 neos2 223.2200 454.86469703 neos4 4.5200 -4.8603440750589E+10 neos5 4.2700 -4.8603440750589E+10 neos6 606.3300 83.00000000 noswot 285.5000 -41.00000000 nw04 67.1200 16862.00000000 p0033 0.1300 3089.00000000 p0201 1.9300 7615.00000000 p0282 0.7700 258411.00000000 p0548 0.4400 8691.00000000 p2756 2.9600 3124.00000000 pk1 246.1200 11.00000000 pp08acuts 3.5000 7350.00000000 pp08a 2.8800 7350.00000000 prod1 45.0700 -56.00000000 qiu 226.3400 -132.87313695 qnet1 7.9800 16029.69268100 qnet1_o 3.6900 16029.69268100 ran10x10a 1.0300 1499.00000000 ran10x10b 0.6200 3073.00000000 ran10x10c 4.1500 13007.00000000 ran10x12 0.8200 2714.00000000 ran10x26 100.4000 4270.00000000 ran12x12 44.5100 2291.00000000 ran12x21 261.5000 3664.00000000 ran13x13 108.5600 3252.00000000 ran16x16 1202.8400 3823.00000000 ran17x17 36.1200 1373.00000000 ran4x64 1.3300 9711.00000000 ran6x43 3.0400 6330.00000000 ran8x32 65.6300 5247.00000000 rentacar 4.8800 28882470.94755340 rgn 1.4200 82.19999704 rlp2 4.5400 19.00000000 rout 74.8300 1077.56000000 set1ch 0.9000 54537.75000000 seymour1 1317.9900 410.76370139 stein27 2.2700 18.00000000 stein45 51.2300 30.00000000 swath1 115.2900 379.07129575 swath2 104.0600 385.19969295 vpm1 0.3000 20.00000000 vpm2 2.3600 13.75000000

 Modelname Time (SCIP11) Obj (SCIP11) air04 186.4700 56138.00000000 arki001 3600.0200 7580827.88272227 bc 3600.2200 7.00000000 dano3mip 3600.2600 759.71428571 danoint 3600.0300 65.66666667 fast0507 3600.8500 175.00000000 harp2 3600.0200 -73899798.00000000 markshare1 3595.8500 8.00000000 markshare2 3600.0100 17.00000000 misc06 0.6000 12851.89767834 mkc1 3600.0400 -606.71000000 mkc 3600.0400 -551.22600000 n3700 3600.0600 1342560.00000000 n3701 3600.1300 1310970.00000000 n3702 3600.1200 1317425.00000000 n3703 3600.0500 1316442.00000000 n3704 3600.1400 1327179.00000000 n3705 3600.1300 1342540.00000000 n3706 3600.1400 1321735.00000000 n3707 3600.0700 1301218.00000000 n3708 3600.1200 1329479.00000000 n3709 3600.0600 1324904.00000000 n370a 3600.1800 1353042.00000000 n370b 3600.1100 1353622.00000000 n370c 3600.2000 1343749.00000000 n370d 3600.1200 1343749.00000000 n370e 3600.0400 1309467.99999998 neos3 3600.0200 441.33723249 ran14x18 3600.0000 3736.00000000 seymour 3600.0500 426.00000000 swath 3600.0600 502.85720300