## Solver Square Comparison: Considers all models.

 Date / Time: 09/14/08 17:33:04

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX is represented on the left (rows) and solver SCIP on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : CPLEX-1.trc Tracefile 2 : SCIP-1.trc Solvers used : CPLEX SCIP Modeltype(s) MIP

 SCIP: optimal SCIP: feasible SCIP: infeasible SCIP: unbounded SCIP: fail SCIP: no data total CPLEX CPLEX: optimal 96 2 - - 2 - 100 CPLEX: feasible 1 23 - - - - 24 CPLEX: infeasible - - - - - - - CPLEX: unbounded - - - - - - - CPLEX: fail - 1 - - - - 1 CPLEX: no data - - - - - - - total SCIP 97 26 - - 2 - 125

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Obj (SCIP) 10teams 4.3200 56.8100 0.076 924.00000000 924.00000000 acc-tight-0 0.4800 20.3900 0.024 0.00000000 0.00000000 acc-tight-1 1.9800 160.7600 0.012 0.00000000 0.00000000 acc-tight-2 56.1900 1430.2700 0.039 0.00000000 0.00000000 acc-tight-3 1700.7700 256.5600 6.629 0.00000000 0.00000000 acc-tight-4 1.3300 156.6400 0.008 0.00000000 0.00000000 acc-tight-5 39.5900 516.8400 0.077 0.00000000 0.00000000 air03 0.4600 15.5900 0.030 340160.00000000 340160.00000000 air04 16.5400 301.8700 0.055 56137.00000000 56137.00000000 air05 9.6300 216.9900 0.044 26374.00000000 26374.00000000 bal8x12 0.1000 0.2700 0.370 471.55000000 471.55000000 bc1 133.6400 1162.0200 0.115 3.33836255 3.33836255 bell3a 1.8600 25.4000 0.073 878430.31600000 878430.31600000 bell5 0.1800 1.1400 0.158 8966406.49152000 8966406.49152000 bienst1 35.4700 395.0400 0.090 46.75000000 46.75000000 bienst2 190.6700 1822.8800 0.105 54.60000000 54.60000000 binkar10_1 18.7000 1638.0100 0.011 6742.20002400 6742.20002400 bk4x3 0.0000 0.0100 --- 350.00000000 350.00000000 blend2 1.3200 0.6200 2.129 7.59898500 7.59898500 cap6000 1.0800 10.3300 0.105 -2451377.00000000 -2451377.00000000 dano3_3 72.8300 345.9300 0.211 576.34463451 576.34463303 dano3_4 91.9000 568.1600 0.162 576.43522471 576.43522471 dano3_5 245.1400 1758.2200 0.139 576.92491596 576.92491596 dcmulti 0.3500 5.4000 0.065 188182.00000000 188182.00000000 dsbmip 0.5200 2.2100 0.235 -306.76901203 -306.76901203 egout 0.0000 0.0600 0.000 568.10070000 568.10070000 enigma 0.0100 0.3100 0.032 0.00000000 0.00000000 fast0507 1862.9000 2938.1200 0.634 174.00000000 174.00000000 fiber 0.2400 1.9700 0.122 405935.18000000 405935.18000000 fixnet6 1.0000 3.1700 0.315 3983.00000000 3983.00000000 gen 0.0200 0.3300 0.061 112313.36271800 112313.36271800 gesa2 0.3300 7.4800 0.044 25779856.37169790 25779856.36715450 gesa2_o 0.3200 10.3000 0.031 25779856.37169790 25779856.29279900 gesa3 0.6100 10.3900 0.059 27991042.64838270 27991042.64146980 gesa3_o 0.2700 10.5800 0.026 27991042.64838380 27991042.64838270 gr4x6 0.0100 0.0200 --- 202.35000000 202.35000000 gt2 0.0200 0.1600 0.125 21166.00000000 21166.00000000 irp 5.0400 43.1700 0.117 12159.49283600 12159.49283600 khb05250 0.1100 1.0000 0.110 106940226.00000000 106940226.00000000 l152lav 0.8800 9.8400 0.089 4722.00000000 4722.00000000 lseu 0.0600 0.3500 0.171 1120.00000000 1120.00000000 mas284 4.2600 58.0300 0.073 91405.72368220 91405.72363652 mas74 328.6000 2627.6800 0.125 11801.18572900 11801.18572900 mas76 57.2300 228.2000 0.251 40005.05414200 40005.05414200 misc03 1.0400 2.0800 0.500 3360.00000000 3360.00000000 misc06 0.1000 0.9000 0.111 12850.86073738 12850.86073738 misc07 32.9700 101.0700 0.326 2810.00000000 2810.00000000 mitre 0.5200 93.8200 0.006 115155.00000000 115155.00000000 mod008 0.1000 1.0200 0.098 307.00000000 307.00000000 mod010 0.3400 1.3500 0.252 6548.00000000 6548.00000000 mod011 109.4300 385.5700 0.284 -54558535.01422730 -54558535.01422730 modglob 0.1500 2.9100 0.052 20740508.08630820 20740508.08328070 neos1 0.7200 15.8500 0.045 19.00000000 19.00000000 neos2 29.5200 207.9900 0.142 454.86469704 454.86469704 neos3 45.4900 2474.7200 0.018 368.84275100 368.84275100 neos4 3.2000 4.6200 0.693 -4.8603440750589E+10 -4.8603440750589E+10 neos5 3.1200 4.3800 0.712 -4.8603440750589E+10 -4.8603440750589E+10 neos6 80.6100 2474.8100 0.033 83.00000000 83.00000000 nw04 33.0400 89.2200 0.370 16862.00000000 16862.00000000 p0033 0.0100 0.0700 0.143 3089.00000000 3089.00000000 p0201 0.2700 3.2100 0.084 7615.00000000 7615.00000011 p0282 0.1000 1.0500 0.095 258411.00000000 258411.00000000 p0548 0.0400 0.7600 0.053 8691.00000000 8691.00000000 p2756 0.3100 4.0000 0.078 3124.00000000 3124.00000000 pk1 129.5300 245.9100 0.527 11.00000000 11.00000000 pp08acuts 1.4200 3.6000 0.394 7350.00000000 7350.00000000 pp08a 1.0600 3.6400 0.291 7350.00000000 7350.00000000 prod1 15.5800 68.6600 0.227 -56.00000000 -56.00000000 qiu 48.5300 264.1800 0.184 -132.87313695 -132.87313695 qnet1 1.5200 6.7100 0.227 16029.69268100 16029.69268100 qnet1_o 0.9800 9.9500 0.098 16029.69268100 16029.69268100 ran10x10a 0.1600 1.0200 0.157 1499.00000000 1499.00000000 ran10x10b 0.1200 0.8500 0.141 3073.00000000 3073.00000000 ran10x10c 1.4300 6.9700 0.205 13007.00000000 13007.00000000 ran10x12 0.3400 1.0500 0.324 2714.00000000 2714.00000000 ran10x26 12.6100 108.4500 0.116 4270.00000000 4270.00000000 ran12x12 9.5200 52.7200 0.181 2291.00000000 2291.00000000 ran12x21 63.1100 353.7400 0.178 3664.00000000 3664.00000000 ran13x13 19.4500 146.9800 0.132 3252.00000000 3252.00000000 ran16x16 163.8600 1603.2200 0.102 3823.00000000 3823.00000000 ran17x17 5.2600 32.1000 0.164 1373.00000000 1373.00000000 ran4x64 0.1800 1.3400 0.134 9711.00000000 9711.00000000 ran6x43 0.3100 2.0000 0.155 6330.00000000 6330.00000000 ran8x32 3.2600 53.0100 0.061 5247.00000000 5247.00000000 rentacar 0.4600 4.9400 0.093 28882470.94755350 28882470.08510510 rgn 0.1500 2.3200 0.065 82.19999924 82.19999924 rlp2 0.0200 8.0700 0.002 19.00000000 19.00000000 rout 12.0600 191.7700 0.063 1077.56000000 1077.56000000 set1ch 0.3300 2.4600 0.134 54537.75000000 54537.75000000 seymour1 219.5900 2230.1300 0.098 410.76370139 410.76370139 stein27 0.2400 2.3300 0.103 18.00000000 18.00000000 stein45 11.0900 65.4400 0.169 30.00000000 30.00000000 swath1 13.2900 131.9800 0.101 379.07129575 379.07129575 swath2 11.3200 80.9000 0.140 385.19969295 385.19969295 vpm1 0.0800 0.1000 0.800 20.00000000 20.00000000 vpm2 0.7800 2.8900 0.270 13.75000000 13.75000000

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Obj (SCIP) mkc1 31.6300 3600.0500 0.009 -607.20700000 -606.95000000 ran14x18 2572.4600 3600.0000 0.715 3712.00000000 3735.00000000

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Status (SCIP) acc-tight-6 49.1500 3600.0300 --- 0.00000000 mstat(14) sstat( 3) harp2 281.9200 NA --- -73899798.69998661 mstat(13) sstat(13)

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Obj (SCIP) noswot 3600.0100 392.6400 9.169 -41.00000000 -41.00000000

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Obj (SCIP) arki001 3600.0400 166.7600 21.588 7580813.04595096 7592731.44380228 bc 3600.2300 3600.1400 1.000 7.00000000 7.00000000 dano3mip 3600.3600 3600.1800 1.000 717.18181818 742.64062500 danoint 3600.0000 3600.0000 1.000 65.66666667 65.66666667 markshare1 3600.0100 3217.2200 1.119 6.00000000 6.00000000 markshare2 3600.0100 3324.2500 1.083 17.00000000 22.00000000 mkc 3600.1000 3600.0300 1.000 -563.84600000 -552.06800000 n3700 3600.0900 3600.0700 1.000 1305784.00000000 1342560.00000000 n3701 3600.1400 3600.0800 1.000 1288319.00000000 1310970.00000000 n3702 3600.0800 3600.0900 1.000 1281202.00000000 1320387.00000000 n3703 3600.1000 3600.0800 1.000 1268328.00000000 1316442.00000000 n3704 3600.0900 3600.1200 1.000 1304313.00000000 1327179.00000000 n3705 3600.1000 3600.1100 1.000 1306784.00000000 1342540.00000000 n3706 3600.1000 3600.0900 1.000 1281325.00000000 1321735.00000000 n3707 3600.1000 3600.1000 1.000 1257876.00000000 1301218.00000000 n3708 3600.1200 3600.1000 1.000 1297991.00000000 1306953.00000000 n3709 3600.1000 3600.0600 1.000 1301093.00000000 1324904.00000000 n370a 3600.1200 3600.1200 1.000 1322031.00000000 1353042.00000000 n370b 3600.1000 3600.1000 1.000 1302170.00000000 1349157.99999994 n370c 3600.1200 3600.0700 1.000 1303884.00000000 1339048.99999992 n370d 3600.1000 3600.1100 1.000 1303884.00000000 1339048.99999992 n370e 3600.1500 3600.0700 1.000 1274838.00000000 1298206.00000000 seymour 3600.0600 3600.0500 1.000 424.00000000 426.00000000

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Status (CPLEX) Obj (SCIP) swath 1220.1400 3600.0300 --- mstat(14) sstat( 4) 468.48473300

 Modelname Time (CPLEX) Obj (CPLEX) 10teams 4.3200 924.00000000 acc-tight-0 0.4800 0.00000000 acc-tight-1 1.9800 0.00000000 acc-tight-2 56.1900 0.00000000 acc-tight-3 1700.7700 0.00000000 acc-tight-4 1.3300 0.00000000 acc-tight-5 39.5900 0.00000000 acc-tight-6 49.1500 0.00000000 air03 0.4600 340160.00000000 air04 16.5400 56137.00000000 air05 9.6300 26374.00000000 bal8x12 0.1000 471.55000000 bc1 133.6400 3.33836255 bell3a 1.8600 878430.31600000 bell5 0.1800 8966406.49152000 bienst1 35.4700 46.75000000 bienst2 190.6700 54.60000000 binkar10_1 18.7000 6742.20002400 bk4x3 0.0000 350.00000000 blend2 1.3200 7.59898500 cap6000 1.0800 -2451377.00000000 dano3_3 72.8300 576.34463451 dano3_4 91.9000 576.43522471 dano3_5 245.1400 576.92491596 dcmulti 0.3500 188182.00000000 dsbmip 0.5200 -306.76901203 egout 0.0000 568.10070000 enigma 0.0100 0.00000000 fast0507 1862.9000 174.00000000 fiber 0.2400 405935.18000000 fixnet6 1.0000 3983.00000000 gen 0.0200 112313.36271800 gesa2 0.3300 25779856.37169790 gesa2_o 0.3200 25779856.37169790 gesa3 0.6100 27991042.64838270 gesa3_o 0.2700 27991042.64838380 gr4x6 0.0100 202.35000000 gt2 0.0200 21166.00000000 harp2 281.9200 -73899798.69998661 irp 5.0400 12159.49283600 khb05250 0.1100 106940226.00000000 l152lav 0.8800 4722.00000000 lseu 0.0600 1120.00000000 mas284 4.2600 91405.72368220 mas74 328.6000 11801.18572900 mas76 57.2300 40005.05414200 misc03 1.0400 3360.00000000 misc06 0.1000 12850.86073738 misc07 32.9700 2810.00000000 mitre 0.5200 115155.00000000 mkc1 31.6300 -607.20700000 mod008 0.1000 307.00000000 mod010 0.3400 6548.00000000 mod011 109.4300 -54558535.01422730 modglob 0.1500 20740508.08630820 neos1 0.7200 19.00000000 neos2 29.5200 454.86469704 neos3 45.4900 368.84275100 neos4 3.2000 -4.8603440750589E+10 neos5 3.1200 -4.8603440750589E+10 neos6 80.6100 83.00000000 nw04 33.0400 16862.00000000 p0033 0.0100 3089.00000000 p0201 0.2700 7615.00000000 p0282 0.1000 258411.00000000 p0548 0.0400 8691.00000000 p2756 0.3100 3124.00000000 pk1 129.5300 11.00000000 pp08acuts 1.4200 7350.00000000 pp08a 1.0600 7350.00000000 prod1 15.5800 -56.00000000 qiu 48.5300 -132.87313695 qnet1 1.5200 16029.69268100 qnet1_o 0.9800 16029.69268100 ran10x10a 0.1600 1499.00000000 ran10x10b 0.1200 3073.00000000 ran10x10c 1.4300 13007.00000000 ran10x12 0.3400 2714.00000000 ran10x26 12.6100 4270.00000000 ran12x12 9.5200 2291.00000000 ran12x21 63.1100 3664.00000000 ran13x13 19.4500 3252.00000000 ran14x18 2572.4600 3712.00000000 ran16x16 163.8600 3823.00000000 ran17x17 5.2600 1373.00000000 ran4x64 0.1800 9711.00000000 ran6x43 0.3100 6330.00000000 ran8x32 3.2600 5247.00000000 rentacar 0.4600 28882470.94755350 rgn 0.1500 82.19999924 rlp2 0.0200 19.00000000 rout 12.0600 1077.56000000 set1ch 0.3300 54537.75000000 seymour1 219.5900 410.76370139 stein27 0.2400 18.00000000 stein45 11.0900 30.00000000 swath1 13.2900 379.07129575 swath2 11.3200 385.19969295 vpm1 0.0800 20.00000000 vpm2 0.7800 13.75000000

 Modelname Time (CPLEX) Obj (CPLEX) arki001 3600.0400 7580813.04595096 bc 3600.2300 7.00000000 dano3mip 3600.3600 717.18181818 danoint 3600.0000 65.66666667 markshare1 3600.0100 6.00000000 markshare2 3600.0100 17.00000000 mkc 3600.1000 -563.84600000 n3700 3600.0900 1305784.00000000 n3701 3600.1400 1288319.00000000 n3702 3600.0800 1281202.00000000 n3703 3600.1000 1268328.00000000 n3704 3600.0900 1304313.00000000 n3705 3600.1000 1306784.00000000 n3706 3600.1000 1281325.00000000 n3707 3600.1000 1257876.00000000 n3708 3600.1200 1297991.00000000 n3709 3600.1000 1301093.00000000 n370a 3600.1200 1322031.00000000 n370b 3600.1000 1302170.00000000 n370c 3600.1200 1303884.00000000 n370d 3600.1000 1303884.00000000 n370e 3600.1500 1274838.00000000 noswot 3600.0100 -41.00000000 seymour 3600.0600 424.00000000

 Modelname Time (CPLEX) Status (CPLEX) swath -- mstat(14) sstat( 4)

 Modelname Time (SCIP) Obj (SCIP) 10teams 56.8100 924.00000000 acc-tight-0 20.3900 0.00000000 acc-tight-1 160.7600 0.00000000 acc-tight-2 1430.2700 0.00000000 acc-tight-3 256.5600 0.00000000 acc-tight-4 156.6400 0.00000000 acc-tight-5 516.8400 0.00000000 air03 15.5900 340160.00000000 air04 301.8700 56137.00000000 air05 216.9900 26374.00000000 bal8x12 0.2700 471.55000000 bc1 1162.0200 3.33836255 bell3a 25.4000 878430.31600000 bell5 1.1400 8966406.49152000 bienst1 395.0400 46.75000000 bienst2 1822.8800 54.60000000 binkar10_1 1638.0100 6742.20002400 bk4x3 0.0100 350.00000000 blend2 0.6200 7.59898500 cap6000 10.3300 -2451377.00000000 dano3_3 345.9300 576.34463303 dano3_4 568.1600 576.43522471 dano3_5 1758.2200 576.92491596 dcmulti 5.4000 188182.00000000 dsbmip 2.2100 -306.76901203 egout 0.0600 568.10070000 enigma 0.3100 0.00000000 fast0507 2938.1200 174.00000000 fiber 1.9700 405935.18000000 fixnet6 3.1700 3983.00000000 gen 0.3300 112313.36271800 gesa2 7.4800 25779856.36715450 gesa2_o 10.3000 25779856.29279900 gesa3 10.3900 27991042.64146980 gesa3_o 10.5800 27991042.64838270 gr4x6 0.0200 202.35000000 gt2 0.1600 21166.00000000 irp 43.1700 12159.49283600 khb05250 1.0000 106940226.00000000 l152lav 9.8400 4722.00000000 lseu 0.3500 1120.00000000 mas284 58.0300 91405.72363652 mas74 2627.6800 11801.18572900 mas76 228.2000 40005.05414200 misc03 2.0800 3360.00000000 misc06 0.9000 12850.86073738 misc07 101.0700 2810.00000000 mitre 93.8200 115155.00000000 mod008 1.0200 307.00000000 mod010 1.3500 6548.00000000 mod011 385.5700 -54558535.01422730 modglob 2.9100 20740508.08328070 neos1 15.8500 19.00000000 neos2 207.9900 454.86469704 neos3 2474.7200 368.84275100 neos4 4.6200 -4.8603440750589E+10 neos5 4.3800 -4.8603440750589E+10 neos6 2474.8100 83.00000000 noswot 392.6400 -41.00000000 nw04 89.2200 16862.00000000 p0033 0.0700 3089.00000000 p0201 3.2100 7615.00000011 p0282 1.0500 258411.00000000 p0548 0.7600 8691.00000000 p2756 4.0000 3124.00000000 pk1 245.9100 11.00000000 pp08acuts 3.6000 7350.00000000 pp08a 3.6400 7350.00000000 prod1 68.6600 -56.00000000 qiu 264.1800 -132.87313695 qnet1 6.7100 16029.69268100 qnet1_o 9.9500 16029.69268100 ran10x10a 1.0200 1499.00000000 ran10x10b 0.8500 3073.00000000 ran10x10c 6.9700 13007.00000000 ran10x12 1.0500 2714.00000000 ran10x26 108.4500 4270.00000000 ran12x12 52.7200 2291.00000000 ran12x21 353.7400 3664.00000000 ran13x13 146.9800 3252.00000000 ran16x16 1603.2200 3823.00000000 ran17x17 32.1000 1373.00000000 ran4x64 1.3400 9711.00000000 ran6x43 2.0000 6330.00000000 ran8x32 53.0100 5247.00000000 rentacar 4.9400 28882470.08510510 rgn 2.3200 82.19999924 rlp2 8.0700 19.00000000 rout 191.7700 1077.56000000 set1ch 2.4600 54537.75000000 seymour1 2230.1300 410.76370139 stein27 2.3300 18.00000000 stein45 65.4400 30.00000000 swath1 131.9800 379.07129575 swath2 80.9000 385.19969295 vpm1 0.1000 20.00000000 vpm2 2.8900 13.75000000

 Modelname Time (SCIP) Obj (SCIP) arki001 166.7600 7592731.44380228 bc 3600.1400 7.00000000 dano3mip 3600.1800 742.64062500 danoint 3600.0000 65.66666667 markshare1 3217.2200 6.00000000 markshare2 3324.2500 22.00000000 mkc1 3600.0500 -606.95000000 mkc 3600.0300 -552.06800000 n3700 3600.0700 1342560.00000000 n3701 3600.0800 1310970.00000000 n3702 3600.0900 1320387.00000000 n3703 3600.0800 1316442.00000000 n3704 3600.1200 1327179.00000000 n3705 3600.1100 1342540.00000000 n3706 3600.0900 1321735.00000000 n3707 3600.1000 1301218.00000000 n3708 3600.1000 1306953.00000000 n3709 3600.0600 1324904.00000000 n370a 3600.1200 1353042.00000000 n370b 3600.1000 1349157.99999994 n370c 3600.0700 1339048.99999992 n370d 3600.1100 1339048.99999992 n370e 3600.0700 1298206.00000000 ran14x18 3600.0000 3735.00000000 seymour 3600.0500 426.00000000 swath 3600.0300 468.48473300

 Modelname Time (SCIP) Status (SCIP) acc-tight-6 -- mstat(14) sstat( 3) harp2 -- mstat(13) sstat(13)