## Solver Square Comparison: Considers all models.

 Date / Time: 06/01/08 16:28:17

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX is represented on the left (rows) and solver SCIP on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : 1-CPLEX-1.trc Tracefile 2 : 2-SCIP-1.trc Solvers used : CPLEX SCIP Modeltype(s) MIP

 SCIP: optimal SCIP: feasible SCIP: infeasible SCIP: unbounded SCIP: fail SCIP: no data total CPLEX CPLEX: optimal 93 4 - - 2 - 99 CPLEX: feasible 2 23 - - - - 25 CPLEX: infeasible - - - - - - - CPLEX: unbounded - - - - - - - CPLEX: fail - 1 - - - - 1 CPLEX: no data - - - - - - - total SCIP 95 28 - - 2 - 125

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Obj (SCIP) 10teams 4.0900 85.1200 0.048 924.00000000 924.00000000 acc-tight-0 0.4600 20.4400 0.023 0.00000000 0.00000000 acc-tight-1 1.9900 189.8200 0.010 0.00000000 0.00000000 acc-tight-4 1.3400 156.6700 0.009 0.00000000 0.00000000 acc-tight-5 40.5400 952.6700 0.043 0.00000000 0.00000000 acc-tight-6 48.4900 898.3200 0.054 0.00000000 0.00000000 air03 0.4000 15.2000 0.026 340160.00000000 340160.00000000 air04 15.8600 201.9700 0.079 56137.00000000 56138.00000000 air05 9.5800 265.3100 0.036 26374.00000000 26374.00000000 bal8x12 0.1100 0.2800 0.393 471.55000000 471.55000000 bc1 133.5900 1063.5700 0.126 3.33836255 3.33836255 bell3a 1.8500 25.0800 0.074 878430.31600000 878430.31600000 bell5 0.1900 1.1700 0.162 8966406.49152000 8966406.49152000 bienst1 34.0500 386.6800 0.088 46.75000000 46.75000000 bienst2 175.5200 1818.9900 0.096 54.60000000 54.60000000 binkar10_1 18.5400 1112.6500 0.017 6742.20002400 6742.20002400 bk4x3 0.0100 0.0100 --- 350.00000000 350.00000000 blend2 1.2600 0.6200 2.032 7.59898500 7.59898500 cap6000 1.0200 10.1200 0.101 -2451377.00000000 -2451377.00000000 dano3_3 71.8800 435.7600 0.165 576.34463451 576.34463303 dano3_4 92.1500 514.8800 0.179 576.43522471 576.43522471 dano3_5 202.0400 1767.1700 0.114 576.92491596 576.92491596 dcmulti 0.3500 3.5400 0.099 188182.00000000 188182.00000000 dsbmip 0.5300 2.1000 0.252 -306.76901203 -306.76901203 egout 0.0100 0.0500 0.200 568.10070000 568.10070000 enigma 0.0100 0.4000 0.025 0.00000000 0.00000000 fiber 0.2500 2.3100 0.108 405935.18000000 405935.18000000 fixnet6 0.9100 3.3100 0.275 3983.00000000 3983.00000000 gen 0.0300 0.2700 0.111 112313.36271800 112313.36271800 gesa2 0.3200 8.0300 0.040 25779856.37169790 25779856.36715450 gesa2_o 0.3100 10.6500 0.029 25779856.37169790 25779856.29279900 gesa3 0.5600 10.6000 0.053 27991042.64838270 27991042.64398030 gesa3_o 0.2800 11.2500 0.025 27991042.64838380 27991042.64785830 gr4x6 0.0100 0.0100 --- 202.35000000 202.35000000 gt2 0.0100 0.1400 0.071 21166.00000000 21166.00000000 irp 5.2700 49.9100 0.106 12159.49283600 12159.49283600 khb05250 0.1100 0.9900 0.111 106940226.00000000 106940226.00000000 l152lav 0.8800 13.1200 0.067 4722.00000000 4722.00000000 lseu 0.0700 0.3400 0.206 1120.00000000 1120.00000000 mas284 4.1800 59.1000 0.071 91405.72368220 91405.72368220 mas76 55.3200 231.2800 0.239 40005.05414200 40005.05414200 misc03 1.0600 3.1600 0.335 3360.00000000 3360.00000000 misc06 0.0900 0.9200 0.098 12850.86073738 12850.86073738 misc07 32.6600 72.3100 0.452 2810.00000000 2810.00000000 mitre 0.4900 113.0900 0.004 115155.00000000 115155.00000000 mod008 0.0900 1.0100 0.089 307.00000000 307.00000000 mod010 0.3200 1.2800 0.250 6548.00000000 6548.00000000 mod011 88.5600 427.9800 0.207 -54558535.01422730 -54558535.01422730 modglob 0.1600 2.6100 0.061 20740508.08630820 20740508.08446230 neos1 0.7600 16.8400 0.045 19.00000000 19.00000000 neos2 4.4000 211.0200 0.021 454.86469704 454.86469704 neos3 34.3900 3041.2300 0.011 368.84275100 368.84275100 neos4 3.4000 4.4100 0.771 -4.8603440750589E+10 -4.8603440750589E+10 neos5 3.5900 4.1200 0.871 -4.8603440750589E+10 -4.8603440750589E+10 neos6 65.0500 2235.4400 0.029 83.00000000 83.00000000 nw04 33.7100 100.2100 0.336 16862.00000000 16862.00000000 p0033 0.0100 0.0800 0.125 3089.00000000 3089.00000000 p0201 0.2700 3.6600 0.074 7615.00000000 7615.00000000 p0282 0.1000 1.0600 0.094 258411.00000000 258411.00000000 p0548 0.0400 0.7700 0.052 8691.00000000 8691.00000000 p2756 0.3300 4.7500 0.069 3124.00000000 3124.00000000 pk1 128.6600 236.3400 0.544 11.00000000 11.00000000 pp08acuts 1.4900 3.8900 0.383 7350.00000000 7350.00000000 pp08a 1.1200 3.6200 0.309 7350.00000000 7350.00000000 prod1 14.3200 62.9400 0.228 -56.00000000 -56.00000000 qiu 34.4500 301.3300 0.114 -132.87313695 -132.87313695 qnet1 1.5400 9.1600 0.168 16029.69268100 16029.69268100 qnet1_o 1.0000 6.1400 0.163 16029.69268100 16029.69268100 ran10x10a 0.1800 0.9800 0.184 1499.00000000 1499.00000000 ran10x10b 0.1400 0.8200 0.171 3073.00000000 3073.00000000 ran10x10c 1.4200 6.3600 0.223 13007.00000000 13007.00000000 ran10x12 0.3200 1.0800 0.296 2714.00000000 2714.00000000 ran10x26 12.5700 105.9600 0.119 4270.00000000 4270.00000000 ran12x12 9.9600 46.3300 0.215 2291.00000000 2291.00000000 ran12x21 64.6300 377.3000 0.171 3664.00000000 3664.00000000 ran13x13 19.2400 146.5600 0.131 3252.00000000 3252.00000000 ran16x16 169.4400 1908.7800 0.089 3823.00000000 3823.00000000 ran17x17 5.8200 30.8500 0.189 1373.00000000 1373.00000000 ran4x64 0.1900 2.3100 0.082 9711.00000000 9711.00000000 ran6x43 0.3100 1.5800 0.196 6330.00000000 6330.00000000 ran8x32 3.4400 37.0900 0.093 5247.00000000 5247.00000000 rentacar 0.4600 5.2100 0.088 28882470.94755350 28882470.08510510 rgn 0.1500 1.9600 0.077 82.19999924 82.19999924 rlp2 0.0200 8.9400 0.002 19.00000000 19.00000000 rout 13.4000 293.9600 0.046 1077.56000000 1077.56000000 set1ch 0.3200 2.4900 0.129 54537.75000000 54537.75000000 seymour1 215.5700 1560.6600 0.138 410.76370139 410.76370139 stein27 0.2400 2.3400 0.103 18.00000000 18.00000000 stein45 12.0800 63.9000 0.189 30.00000000 30.00000000 swath1 12.6800 142.7600 0.089 379.07129575 379.07129575 swath2 11.3400 159.2700 0.071 385.19969295 385.19969295 vpm1 0.0400 0.1000 0.400 20.00000000 20.00000000 vpm2 0.4700 3.6700 0.128 13.75000000 13.75000000

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Obj (SCIP) fast0507 1921.1400 3559.2100 0.540 174.00000000 175.00000000 harp2 242.6500 1821.3200 0.133 -73899798.69998661 -73899787.00000000 mkc1 30.3200 3461.9200 0.009 -607.20700000 -607.20700000 ran14x18 2569.6400 3555.1200 0.723 3712.00000000 3735.00000000

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Status (SCIP) acc-tight-2 58.0300 3600.0200 --- 0.00000000 mstat(14) sstat( 3) acc-tight-3 1776.3900 3600.0300 --- 0.00000000 mstat(14) sstat( 3)

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Obj (SCIP) arki001 2252.9500 137.6700 16.365 7580813.04593797 7590989.63795922 noswot 894.4000 465.5700 1.921 -41.00000000 -41.00000000

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Obj (CPLEX) Obj (SCIP) bc 3600.0900 3583.3200 1.005 7.00000000 7.00000000 dano3mip 3600.2600 3600.1500 1.000 699.66666667 729.81690141 danoint 3600.0200 3600.0000 1.000 65.66666667 65.66666667 markshare1 383.7900 349.5600 1.098 9.00000000 16.00000000 markshare2 479.1800 404.9800 1.183 24.00000000 11.00000000 mas74 133.5300 1002.4200 0.133 11801.18572900 11857.37125820 mkc 3600.0900 3534.7300 1.018 -563.84600000 -554.94200000 n3700 3600.1100 3597.3600 1.001 1305784.00000000 1342560.00000000 n3701 3600.0900 3600.1000 1.000 1291970.00000000 1310970.00000000 n3702 3600.1000 3600.0700 1.000 1287849.00000000 1320387.00000000 n3703 3600.1000 3600.1200 1.000 1268328.00000000 1316442.00000000 n3704 3600.1200 3600.0900 1.000 1304408.00000000 1327179.00000000 n3705 3600.0700 3600.3800 1.000 1291866.00000000 1342540.00000000 n3706 3600.0800 3600.1200 1.000 1290398.00000000 1321735.00000000 n3707 3600.0500 3598.0800 1.001 1285797.00000000 1301218.00000000 n3708 3600.1400 3599.0100 1.000 1289368.00000000 1313681.00000000 n3709 3600.1400 3600.1100 1.000 1300945.00000000 1324904.00000000 n370a 3600.1500 3600.1100 1.000 1308329.00000000 1353042.00000000 n370b 3600.1400 3589.7500 1.003 1295708.00000000 1371162.00000002 n370c 3600.1000 3600.1200 1.000 1297332.00000000 1339434.00000000 n370d 3600.0800 3600.1200 1.000 1297332.00000000 1339434.00000000 n370e 3600.1100 3600.1400 1.000 1272104.00000000 1294544.00000000 seymour 3600.0700 3600.0500 1.000 424.00000000 425.00000000

 Modelname Time (CPLEX) Time (SCIP) Ratio (CPLEX/SCIP) Status (CPLEX) Obj (SCIP) swath 1221.4000 3472.6400 --- mstat(14) sstat( 4) 496.73085800

 Modelname Time (CPLEX) Obj (CPLEX) 10teams 4.0900 924.00000000 acc-tight-0 0.4600 0.00000000 acc-tight-1 1.9900 0.00000000 acc-tight-2 58.0300 0.00000000 acc-tight-3 1776.3900 0.00000000 acc-tight-4 1.3400 0.00000000 acc-tight-5 40.5400 0.00000000 acc-tight-6 48.4900 0.00000000 air03 0.4000 340160.00000000 air04 15.8600 56137.00000000 air05 9.5800 26374.00000000 bal8x12 0.1100 471.55000000 bc1 133.5900 3.33836255 bell3a 1.8500 878430.31600000 bell5 0.1900 8966406.49152000 bienst1 34.0500 46.75000000 bienst2 175.5200 54.60000000 binkar10_1 18.5400 6742.20002400 bk4x3 0.0100 350.00000000 blend2 1.2600 7.59898500 cap6000 1.0200 -2451377.00000000 dano3_3 71.8800 576.34463451 dano3_4 92.1500 576.43522471 dano3_5 202.0400 576.92491596 dcmulti 0.3500 188182.00000000 dsbmip 0.5300 -306.76901203 egout 0.0100 568.10070000 enigma 0.0100 0.00000000 fast0507 1921.1400 174.00000000 fiber 0.2500 405935.18000000 fixnet6 0.9100 3983.00000000 gen 0.0300 112313.36271800 gesa2 0.3200 25779856.37169790 gesa2_o 0.3100 25779856.37169790 gesa3 0.5600 27991042.64838270 gesa3_o 0.2800 27991042.64838380 gr4x6 0.0100 202.35000000 gt2 0.0100 21166.00000000 harp2 242.6500 -73899798.69998661 irp 5.2700 12159.49283600 khb05250 0.1100 106940226.00000000 l152lav 0.8800 4722.00000000 lseu 0.0700 1120.00000000 mas284 4.1800 91405.72368220 mas76 55.3200 40005.05414200 misc03 1.0600 3360.00000000 misc06 0.0900 12850.86073738 misc07 32.6600 2810.00000000 mitre 0.4900 115155.00000000 mkc1 30.3200 -607.20700000 mod008 0.0900 307.00000000 mod010 0.3200 6548.00000000 mod011 88.5600 -54558535.01422730 modglob 0.1600 20740508.08630820 neos1 0.7600 19.00000000 neos2 4.4000 454.86469704 neos3 34.3900 368.84275100 neos4 3.4000 -4.8603440750589E+10 neos5 3.5900 -4.8603440750589E+10 neos6 65.0500 83.00000000 nw04 33.7100 16862.00000000 p0033 0.0100 3089.00000000 p0201 0.2700 7615.00000000 p0282 0.1000 258411.00000000 p0548 0.0400 8691.00000000 p2756 0.3300 3124.00000000 pk1 128.6600 11.00000000 pp08acuts 1.4900 7350.00000000 pp08a 1.1200 7350.00000000 prod1 14.3200 -56.00000000 qiu 34.4500 -132.87313695 qnet1 1.5400 16029.69268100 qnet1_o 1.0000 16029.69268100 ran10x10a 0.1800 1499.00000000 ran10x10b 0.1400 3073.00000000 ran10x10c 1.4200 13007.00000000 ran10x12 0.3200 2714.00000000 ran10x26 12.5700 4270.00000000 ran12x12 9.9600 2291.00000000 ran12x21 64.6300 3664.00000000 ran13x13 19.2400 3252.00000000 ran14x18 2569.6400 3712.00000000 ran16x16 169.4400 3823.00000000 ran17x17 5.8200 1373.00000000 ran4x64 0.1900 9711.00000000 ran6x43 0.3100 6330.00000000 ran8x32 3.4400 5247.00000000 rentacar 0.4600 28882470.94755350 rgn 0.1500 82.19999924 rlp2 0.0200 19.00000000 rout 13.4000 1077.56000000 set1ch 0.3200 54537.75000000 seymour1 215.5700 410.76370139 stein27 0.2400 18.00000000 stein45 12.0800 30.00000000 swath1 12.6800 379.07129575 swath2 11.3400 385.19969295 vpm1 0.0400 20.00000000 vpm2 0.4700 13.75000000

 Modelname Time (CPLEX) Obj (CPLEX) arki001 2252.9500 7580813.04593797 bc 3600.0900 7.00000000 dano3mip 3600.2600 699.66666667 danoint 3600.0200 65.66666667 markshare1 383.7900 9.00000000 markshare2 479.1800 24.00000000 mas74 133.5300 11801.18572900 mkc 3600.0900 -563.84600000 n3700 3600.1100 1305784.00000000 n3701 3600.0900 1291970.00000000 n3702 3600.1000 1287849.00000000 n3703 3600.1000 1268328.00000000 n3704 3600.1200 1304408.00000000 n3705 3600.0700 1291866.00000000 n3706 3600.0800 1290398.00000000 n3707 3600.0500 1285797.00000000 n3708 3600.1400 1289368.00000000 n3709 3600.1400 1300945.00000000 n370a 3600.1500 1308329.00000000 n370b 3600.1400 1295708.00000000 n370c 3600.1000 1297332.00000000 n370d 3600.0800 1297332.00000000 n370e 3600.1100 1272104.00000000 noswot 894.4000 -41.00000000 seymour 3600.0700 424.00000000

 Modelname Time (CPLEX) Status (CPLEX) swath -- mstat(14) sstat( 4)

 Modelname Time (SCIP) Obj (SCIP) 10teams 85.1200 924.00000000 acc-tight-0 20.4400 0.00000000 acc-tight-1 189.8200 0.00000000 acc-tight-4 156.6700 0.00000000 acc-tight-5 952.6700 0.00000000 acc-tight-6 898.3200 0.00000000 air03 15.2000 340160.00000000 air04 201.9700 56138.00000000 air05 265.3100 26374.00000000 arki001 137.6700 7590989.63795922 bal8x12 0.2800 471.55000000 bc1 1063.5700 3.33836255 bell3a 25.0800 878430.31600000 bell5 1.1700 8966406.49152000 bienst1 386.6800 46.75000000 bienst2 1818.9900 54.60000000 binkar10_1 1112.6500 6742.20002400 bk4x3 0.0100 350.00000000 blend2 0.6200 7.59898500 cap6000 10.1200 -2451377.00000000 dano3_3 435.7600 576.34463303 dano3_4 514.8800 576.43522471 dano3_5 1767.1700 576.92491596 dcmulti 3.5400 188182.00000000 dsbmip 2.1000 -306.76901203 egout 0.0500 568.10070000 enigma 0.4000 0.00000000 fiber 2.3100 405935.18000000 fixnet6 3.3100 3983.00000000 gen 0.2700 112313.36271800 gesa2 8.0300 25779856.36715450 gesa2_o 10.6500 25779856.29279900 gesa3 10.6000 27991042.64398030 gesa3_o 11.2500 27991042.64785830 gr4x6 0.0100 202.35000000 gt2 0.1400 21166.00000000 irp 49.9100 12159.49283600 khb05250 0.9900 106940226.00000000 l152lav 13.1200 4722.00000000 lseu 0.3400 1120.00000000 mas284 59.1000 91405.72368220 mas76 231.2800 40005.05414200 misc03 3.1600 3360.00000000 misc06 0.9200 12850.86073738 misc07 72.3100 2810.00000000 mitre 113.0900 115155.00000000 mod008 1.0100 307.00000000 mod010 1.2800 6548.00000000 mod011 427.9800 -54558535.01422730 modglob 2.6100 20740508.08446230 neos1 16.8400 19.00000000 neos2 211.0200 454.86469704 neos3 3041.2300 368.84275100 neos4 4.4100 -4.8603440750589E+10 neos5 4.1200 -4.8603440750589E+10 neos6 2235.4400 83.00000000 noswot 465.5700 -41.00000000 nw04 100.2100 16862.00000000 p0033 0.0800 3089.00000000 p0201 3.6600 7615.00000000 p0282 1.0600 258411.00000000 p0548 0.7700 8691.00000000 p2756 4.7500 3124.00000000 pk1 236.3400 11.00000000 pp08acuts 3.8900 7350.00000000 pp08a 3.6200 7350.00000000 prod1 62.9400 -56.00000000 qiu 301.3300 -132.87313695 qnet1 9.1600 16029.69268100 qnet1_o 6.1400 16029.69268100 ran10x10a 0.9800 1499.00000000 ran10x10b 0.8200 3073.00000000 ran10x10c 6.3600 13007.00000000 ran10x12 1.0800 2714.00000000 ran10x26 105.9600 4270.00000000 ran12x12 46.3300 2291.00000000 ran12x21 377.3000 3664.00000000 ran13x13 146.5600 3252.00000000 ran16x16 1908.7800 3823.00000000 ran17x17 30.8500 1373.00000000 ran4x64 2.3100 9711.00000000 ran6x43 1.5800 6330.00000000 ran8x32 37.0900 5247.00000000 rentacar 5.2100 28882470.08510510 rgn 1.9600 82.19999924 rlp2 8.9400 19.00000000 rout 293.9600 1077.56000000 set1ch 2.4900 54537.75000000 seymour1 1560.6600 410.76370139 stein27 2.3400 18.00000000 stein45 63.9000 30.00000000 swath1 142.7600 379.07129575 swath2 159.2700 385.19969295 vpm1 0.1000 20.00000000 vpm2 3.6700 13.75000000

 Modelname Time (SCIP) Obj (SCIP) bc 3583.3200 7.00000000 dano3mip 3600.1500 729.81690141 danoint 3600.0000 65.66666667 fast0507 3559.2100 175.00000000 harp2 1821.3200 -73899787.00000000 markshare1 349.5600 16.00000000 markshare2 404.9800 11.00000000 mas74 1002.4200 11857.37125820 mkc1 3461.9200 -607.20700000 mkc 3534.7300 -554.94200000 n3700 3597.3600 1342560.00000000 n3701 3600.1000 1310970.00000000 n3702 3600.0700 1320387.00000000 n3703 3600.1200 1316442.00000000 n3704 3600.0900 1327179.00000000 n3705 3600.3800 1342540.00000000 n3706 3600.1200 1321735.00000000 n3707 3598.0800 1301218.00000000 n3708 3599.0100 1313681.00000000 n3709 3600.1100 1324904.00000000 n370a 3600.1100 1353042.00000000 n370b 3589.7500 1371162.00000002 n370c 3600.1200 1339434.00000000 n370d 3600.1200 1339434.00000000 n370e 3600.1400 1294544.00000000 ran14x18 3555.1200 3735.00000000 seymour 3600.0500 425.00000000 swath 3472.6400 496.73085800