Solver Square Comparison: Considers all models.

 Date / Time: 09/14/08 17:33:05

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver SCIP is represented on the left (rows) and solver Glpk on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : SCIP-1.trc Tracefile 2 : GLPK-1.trc Solvers used : SCIP Glpk Modeltype(s) MIP

 Glpk: optimal Glpk: feasible Glpk: infeasible Glpk: unbounded Glpk: fail Glpk: no data total SCIP SCIP: optimal 63 31 - - 3 - 97 SCIP: feasible - 26 - - - - 26 SCIP: infeasible - - - - - - - SCIP: unbounded - - - - - - - SCIP: fail - 1 - - 1 - 2 SCIP: no data - - - - - - - total Glpk 63 58 - - 4 - 125

Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (SCIP) Time (Glpk) Ratio (SCIP/Glpk) Obj (SCIP) Obj (Glpk) 10teams 56.8100 132.4400 0.429 924.00000000 924.00000000 acc-tight-0 20.3900 33.8300 0.603 0.00000000 0.00000000 acc-tight-1 160.7600 44.5600 3.608 0.00000000 0.00000000 acc-tight-4 156.6400 41.8300 3.745 0.00000000 0.00000000 acc-tight-5 516.8400 66.7700 7.741 0.00000000 0.00000000 air03 15.5900 0.6000 25.983 340160.00000000 340160.00000000 bal8x12 0.2700 0.1000 2.700 471.55000000 471.55000000 bc1 1162.0200 3238.2800 0.359 3.33836255 3.33836255 bell3a 25.4000 22.6700 1.120 878430.31600000 878430.31600000 bell5 1.1400 231.3100 0.005 8966406.49152000 8966406.49152000 bienst1 395.0400 413.5900 0.955 46.75000000 46.75000000 bienst2 1822.8800 2597.6400 0.702 54.60000000 54.60000000 bk4x3 0.0100 0.0000 --- 350.00000000 350.00000000 blend2 0.6200 9.5700 0.065 7.59898500 7.59898500 dano3_3 345.9300 70.5900 4.901 576.34463303 576.34463303 dano3_4 568.1600 108.4100 5.241 576.43522471 576.43522471 dano3_5 1758.2200 1378.9000 1.275 576.92491596 576.92491596 dcmulti 5.4000 4.5400 1.189 188182.00000000 188182.00000000 dsbmip 2.2100 0.2400 9.208 -306.76901203 -306.76901203 egout 0.0600 0.0200 3.000 568.10070000 568.10070000 enigma 0.3100 35.4500 0.009 0.00000000 0.00000000 fiber 1.9700 136.8000 0.014 405935.18000000 405935.18000000 fixnet6 3.1700 6.1200 0.518 3983.00000000 3983.00000000 gen 0.3300 0.2300 1.435 112313.36271800 112313.36271800 gesa2 7.4800 268.3800 0.028 25779856.36715450 25779856.37169790 gesa3 10.3900 3.5200 2.952 27991042.64146980 27991042.64838270 gesa3_o 10.5800 5.3000 1.996 27991042.64838270 27991042.64838270 gr4x6 0.0200 0.0200 --- 202.35000000 202.35000000 gt2 0.1600 0.1200 1.333 21166.00000000 21166.00000000 irp 43.1700 72.6000 0.595 12159.49283600 12159.49283600 khb05250 1.0000 4.4900 0.223 106940226.00000000 106940226.00000000 l152lav 9.8400 153.8000 0.064 4722.00000000 4722.00000000 lseu 0.3500 0.8100 0.432 1120.00000000 1120.00000000 mas284 58.0300 185.6300 0.313 91405.72363652 91405.72368220 misc03 2.0800 20.4000 0.102 3360.00000000 3360.00000000 misc06 0.9000 0.3400 2.647 12850.86073738 12850.86073738 mitre 93.8200 280.0600 0.335 115155.00000000 115155.00000000 mod008 1.0200 3.3600 0.304 307.00000000 307.00000000 mod010 1.3500 1.0400 1.298 6548.00000000 6548.00000000 neos4 4.6200 1944.2700 0.002 -4.8603440750589E+10 -4.8587177297581E+10 neos5 4.3800 1954.4900 0.002 -4.8603440750589E+10 -4.8587177297581E+10 nw04 89.2200 31.0100 2.877 16862.00000000 16862.00000000 p0033 0.0700 0.0200 3.500 3089.00000000 3089.00000000 p0201 3.2100 4.1600 0.772 7615.00000011 7615.00000000 p0282 1.0500 0.5800 1.810 258411.00000000 258411.00000000 p0548 0.7600 0.8400 0.905 8691.00000000 8691.00000000 p2756 4.0000 32.7100 0.122 3124.00000000 3124.00000000 pp08acuts 3.6000 2695.2900 0.001 7350.00000000 7350.00000000 qnet1 6.7100 12.2000 0.550 16029.69268100 16029.69268100 qnet1_o 9.9500 6.3400 1.569 16029.69268100 16029.69268100 ran10x10a 1.0200 21.8900 0.047 1499.00000000 1499.00000000 ran10x10b 0.8500 7.7100 0.110 3073.00000000 3073.00000000 ran10x10c 6.9700 827.1200 0.008 13007.00000000 13007.00000000 ran10x12 1.0500 5.1100 0.205 2714.00000000 2714.00000000 ran4x64 1.3400 4.6800 0.286 9711.00000000 9711.00000000 ran6x43 2.0000 17.1200 0.117 6330.00000000 6330.00000000 ran8x32 53.0100 2209.3200 0.024 5247.00000000 5247.00000000 rentacar 4.9400 2.1000 2.352 28882470.08510510 28882470.94755350 rgn 2.3200 2.0000 1.160 82.19999924 82.19999924 stein27 2.3300 4.1800 0.557 18.00000000 18.00000000 stein45 65.4400 129.1200 0.507 30.00000000 30.00000000 vpm1 0.1000 38.0200 0.003 20.00000000 20.00000000 vpm2 2.8900 489.5200 0.006 13.75000000 13.75000000

 Modelname Time (SCIP) Time (Glpk) Ratio (SCIP/Glpk) Obj (SCIP) Obj (Glpk) air04 301.8700 3597.0600 0.084 56137.00000000 56167.00000000 air05 216.9900 3585.3100 0.061 26374.00000000 26374.00000000 binkar10_1 1638.0100 3550.3300 0.461 6742.20002400 6753.10001300 cap6000 10.3300 3514.8500 0.003 -2451377.00000000 -2315081.00000000 gesa2_o 10.3000 3584.0100 0.003 25779856.29279900 25795208.86238610 mas74 2627.6800 3582.9700 0.733 11801.18572900 11877.69436060 mas76 228.2000 3580.1300 0.064 40005.05414200 40121.91226290 misc07 101.0700 2134.6400 0.047 2810.00000000 2810.00000000 mod011 385.5700 3514.2700 0.110 -54558535.01422730 -54558535.01422730 modglob 2.9100 3586.6700 0.001 20740508.08328070 20798910.76650850 neos1 15.8500 3559.6400 0.004 19.00000000 21.00000000 neos2 207.9900 3557.6300 0.058 454.86469704 1210.42276247 neos3 2474.7200 3552.4700 0.697 368.84275100 1279.68092075 neos6 2474.8100 3574.9600 0.692 83.00000000 89.00000000 noswot 392.6400 3590.2000 0.109 -41.00000000 -41.00000000 pk1 245.9100 3583.2700 0.069 11.00000000 11.00000000 pp08a 3.6400 3585.0900 0.001 7350.00000000 7370.00000000 prod1 68.6600 3537.4500 0.019 -56.00000000 -56.00000000 qiu 264.1800 3577.3100 0.074 -132.87313695 -132.87313695 ran10x26 108.4500 3588.6200 0.030 4270.00000000 4270.00000000 ran12x12 52.7200 3587.4500 0.015 2291.00000000 2291.00000000 ran12x21 353.7400 3588.1800 0.099 3664.00000000 3715.00000000 ran13x13 146.9800 3589.4800 0.041 3252.00000000 3252.00000000 ran16x16 1603.2200 3586.5000 0.447 3823.00000000 3836.00000000 ran17x17 32.1000 3589.9200 0.009 1373.00000000 1391.00000000 rlp2 8.0700 46.5900 0.173 19.00000000 19.00000000 rout 191.7700 2782.6800 0.069 1077.56000000 1077.56000000 set1ch 2.4600 3587.2000 0.001 54537.75000000 58065.00000000 seymour1 2230.1300 3565.0100 0.626 410.76370139 410.83591734 swath1 131.9800 3544.5200 0.037 379.07129575 379.07129575 swath2 80.9000 3539.7400 0.023 385.19969295 385.19969295

 Modelname Time (SCIP) Time (Glpk) Ratio (SCIP/Glpk) Obj (SCIP) Status (Glpk) acc-tight-2 1430.2700 3582.6300 --- 0.00000000 mstat(14) sstat( 3) acc-tight-3 256.5600 3588.9200 --- 0.00000000 mstat(14) sstat( 3) fast0507 2938.1200 3612.5200 --- 174.00000000 mstat(14) sstat( 3)

 Modelname Time (SCIP) Time (Glpk) Ratio (SCIP/Glpk) Obj (SCIP) Obj (Glpk) arki001 166.7600 443.5600 0.376 7592731.44380228 7581130.51694198 bc 3600.1400 2709.6300 1.329 7.00000000 9.00000000 dano3mip 3600.1800 3608.9300 0.998 742.64062500 766.91891892 danoint 3600.0000 521.9900 6.897 65.66666667 66.27272727 markshare1 3217.2200 3586.9600 0.897 6.00000000 15.00000000 markshare2 3324.2500 3584.8200 0.927 22.00000000 40.00000000 mkc1 3600.0500 3493.7500 1.030 -606.95000000 -606.16700000 mkc 3600.0300 3504.2300 1.027 -552.06800000 -454.43000000 n3700 3600.0700 3547.3000 1.015 1342560.00000000 1975456.00000000 n3701 3600.0800 3551.8300 1.014 1310970.00000000 1871470.00000000 n3702 3600.0900 3549.8200 1.014 1320387.00000000 1882613.00000000 n3703 3600.0800 3553.7100 1.013 1316442.00000000 2066729.00000000 n3704 3600.1200 3553.8200 1.013 1327179.00000000 2019324.00000000 n3705 3600.1100 3539.9400 1.017 1342540.00000000 1966442.00000000 n3706 3600.0900 3553.1100 1.013 1321735.00000000 2114635.00000000 n3707 3600.1000 3557.6100 1.012 1301218.00000000 2076597.00000000 n3708 3600.1000 3536.5400 1.018 1306953.00000000 1977030.00000000 n3709 3600.0600 3546.4700 1.015 1324904.00000000 1982316.00000000 n370a 3600.1200 3553.6800 1.013 1353042.00000000 2038077.00000000 n370b 3600.1000 3560.1600 1.011 1349157.99999994 1913041.00000000 n370c 3600.0700 3561.6400 1.011 1339048.99999992 2084575.00000000 n370d 3600.1100 3563.1700 1.010 1339048.99999992 2084575.00000000 n370e 3600.0700 3530.9700 1.020 1298206.00000000 2085925.00000000 ran14x18 3600.0000 3588.6400 1.003 3735.00000000 3837.00000000 seymour 3600.0500 3587.3400 1.004 426.00000000 430.00000000 swath 3600.0300 3549.5900 1.014 468.48473300 507.84604300

 Modelname Time (SCIP) Time (Glpk) Ratio (SCIP/Glpk) Status (SCIP) Obj (Glpk) harp2 NA 3587.9000 --- mstat(13) sstat(13) -73533274.00000000

 Modelname Time (SCIP) Time (Glpk) Ratio (SCIP/Glpk) Status (SCIP) Status (Glpk) acc-tight-6 3600.0300 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)

 Modelname Time (SCIP) Obj (SCIP) 10teams 56.8100 924.00000000 acc-tight-0 20.3900 0.00000000 acc-tight-1 160.7600 0.00000000 acc-tight-2 1430.2700 0.00000000 acc-tight-3 256.5600 0.00000000 acc-tight-4 156.6400 0.00000000 acc-tight-5 516.8400 0.00000000 air03 15.5900 340160.00000000 air04 301.8700 56137.00000000 air05 216.9900 26374.00000000 bal8x12 0.2700 471.55000000 bc1 1162.0200 3.33836255 bell3a 25.4000 878430.31600000 bell5 1.1400 8966406.49152000 bienst1 395.0400 46.75000000 bienst2 1822.8800 54.60000000 binkar10_1 1638.0100 6742.20002400 bk4x3 0.0100 350.00000000 blend2 0.6200 7.59898500 cap6000 10.3300 -2451377.00000000 dano3_3 345.9300 576.34463303 dano3_4 568.1600 576.43522471 dano3_5 1758.2200 576.92491596 dcmulti 5.4000 188182.00000000 dsbmip 2.2100 -306.76901203 egout 0.0600 568.10070000 enigma 0.3100 0.00000000 fast0507 2938.1200 174.00000000 fiber 1.9700 405935.18000000 fixnet6 3.1700 3983.00000000 gen 0.3300 112313.36271800 gesa2 7.4800 25779856.36715450 gesa2_o 10.3000 25779856.29279900 gesa3 10.3900 27991042.64146980 gesa3_o 10.5800 27991042.64838270 gr4x6 0.0200 202.35000000 gt2 0.1600 21166.00000000 irp 43.1700 12159.49283600 khb05250 1.0000 106940226.00000000 l152lav 9.8400 4722.00000000 lseu 0.3500 1120.00000000 mas284 58.0300 91405.72363652 mas74 2627.6800 11801.18572900 mas76 228.2000 40005.05414200 misc03 2.0800 3360.00000000 misc06 0.9000 12850.86073738 misc07 101.0700 2810.00000000 mitre 93.8200 115155.00000000 mod008 1.0200 307.00000000 mod010 1.3500 6548.00000000 mod011 385.5700 -54558535.01422730 modglob 2.9100 20740508.08328070 neos1 15.8500 19.00000000 neos2 207.9900 454.86469704 neos3 2474.7200 368.84275100 neos4 4.6200 -4.8603440750589E+10 neos5 4.3800 -4.8603440750589E+10 neos6 2474.8100 83.00000000 noswot 392.6400 -41.00000000 nw04 89.2200 16862.00000000 p0033 0.0700 3089.00000000 p0201 3.2100 7615.00000011 p0282 1.0500 258411.00000000 p0548 0.7600 8691.00000000 p2756 4.0000 3124.00000000 pk1 245.9100 11.00000000 pp08acuts 3.6000 7350.00000000 pp08a 3.6400 7350.00000000 prod1 68.6600 -56.00000000 qiu 264.1800 -132.87313695 qnet1 6.7100 16029.69268100 qnet1_o 9.9500 16029.69268100 ran10x10a 1.0200 1499.00000000 ran10x10b 0.8500 3073.00000000 ran10x10c 6.9700 13007.00000000 ran10x12 1.0500 2714.00000000 ran10x26 108.4500 4270.00000000 ran12x12 52.7200 2291.00000000 ran12x21 353.7400 3664.00000000 ran13x13 146.9800 3252.00000000 ran16x16 1603.2200 3823.00000000 ran17x17 32.1000 1373.00000000 ran4x64 1.3400 9711.00000000 ran6x43 2.0000 6330.00000000 ran8x32 53.0100 5247.00000000 rentacar 4.9400 28882470.08510510 rgn 2.3200 82.19999924 rlp2 8.0700 19.00000000 rout 191.7700 1077.56000000 set1ch 2.4600 54537.75000000 seymour1 2230.1300 410.76370139 stein27 2.3300 18.00000000 stein45 65.4400 30.00000000 swath1 131.9800 379.07129575 swath2 80.9000 385.19969295 vpm1 0.1000 20.00000000 vpm2 2.8900 13.75000000

 Modelname Time (SCIP) Obj (SCIP) arki001 166.7600 7592731.44380228 bc 3600.1400 7.00000000 dano3mip 3600.1800 742.64062500 danoint 3600.0000 65.66666667 markshare1 3217.2200 6.00000000 markshare2 3324.2500 22.00000000 mkc1 3600.0500 -606.95000000 mkc 3600.0300 -552.06800000 n3700 3600.0700 1342560.00000000 n3701 3600.0800 1310970.00000000 n3702 3600.0900 1320387.00000000 n3703 3600.0800 1316442.00000000 n3704 3600.1200 1327179.00000000 n3705 3600.1100 1342540.00000000 n3706 3600.0900 1321735.00000000 n3707 3600.1000 1301218.00000000 n3708 3600.1000 1306953.00000000 n3709 3600.0600 1324904.00000000 n370a 3600.1200 1353042.00000000 n370b 3600.1000 1349157.99999994 n370c 3600.0700 1339048.99999992 n370d 3600.1100 1339048.99999992 n370e 3600.0700 1298206.00000000 ran14x18 3600.0000 3735.00000000 seymour 3600.0500 426.00000000 swath 3600.0300 468.48473300

 Modelname Time (SCIP) Status (SCIP) acc-tight-6 -- mstat(14) sstat( 3) harp2 -- mstat(13) sstat(13)

 Modelname Time (Glpk) Obj (Glpk) 10teams 132.4400 924.00000000 acc-tight-0 33.8300 0.00000000 acc-tight-1 44.5600 0.00000000 acc-tight-4 41.8300 0.00000000 acc-tight-5 66.7700 0.00000000 air03 0.6000 340160.00000000 bal8x12 0.1000 471.55000000 bc1 3238.2800 3.33836255 bell3a 22.6700 878430.31600000 bell5 231.3100 8966406.49152000 bienst1 413.5900 46.75000000 bienst2 2597.6400 54.60000000 bk4x3 0.0000 350.00000000 blend2 9.5700 7.59898500 dano3_3 70.5900 576.34463303 dano3_4 108.4100 576.43522471 dano3_5 1378.9000 576.92491596 dcmulti 4.5400 188182.00000000 dsbmip 0.2400 -306.76901203 egout 0.0200 568.10070000 enigma 35.4500 0.00000000 fiber 136.8000 405935.18000000 fixnet6 6.1200 3983.00000000 gen 0.2300 112313.36271800 gesa2 268.3800 25779856.37169790 gesa3 3.5200 27991042.64838270 gesa3_o 5.3000 27991042.64838270 gr4x6 0.0200 202.35000000 gt2 0.1200 21166.00000000 irp 72.6000 12159.49283600 khb05250 4.4900 106940226.00000000 l152lav 153.8000 4722.00000000 lseu 0.8100 1120.00000000 mas284 185.6300 91405.72368220 misc03 20.4000 3360.00000000 misc06 0.3400 12850.86073738 mitre 280.0600 115155.00000000 mod008 3.3600 307.00000000 mod010 1.0400 6548.00000000 neos4 1944.2700 -4.8587177297581E+10 neos5 1954.4900 -4.8587177297581E+10 nw04 31.0100 16862.00000000 p0033 0.0200 3089.00000000 p0201 4.1600 7615.00000000 p0282 0.5800 258411.00000000 p0548 0.8400 8691.00000000 p2756 32.7100 3124.00000000 pp08acuts 2695.2900 7350.00000000 qnet1 12.2000 16029.69268100 qnet1_o 6.3400 16029.69268100 ran10x10a 21.8900 1499.00000000 ran10x10b 7.7100 3073.00000000 ran10x10c 827.1200 13007.00000000 ran10x12 5.1100 2714.00000000 ran4x64 4.6800 9711.00000000 ran6x43 17.1200 6330.00000000 ran8x32 2209.3200 5247.00000000 rentacar 2.1000 28882470.94755350 rgn 2.0000 82.19999924 stein27 4.1800 18.00000000 stein45 129.1200 30.00000000 vpm1 38.0200 20.00000000 vpm2 489.5200 13.75000000

 Modelname Time (Glpk) Obj (Glpk) air04 3597.0600 56167.00000000 air05 3585.3100 26374.00000000 arki001 443.5600 7581130.51694198 bc 2709.6300 9.00000000 binkar10_1 3550.3300 6753.10001300 cap6000 3514.8500 -2315081.00000000 dano3mip 3608.9300 766.91891892 danoint 521.9900 66.27272727 gesa2_o 3584.0100 25795208.86238610 harp2 3587.9000 -73533274.00000000 markshare1 3586.9600 15.00000000 markshare2 3584.8200 40.00000000 mas74 3582.9700 11877.69436060 mas76 3580.1300 40121.91226290 misc07 2134.6400 2810.00000000 mkc1 3493.7500 -606.16700000 mkc 3504.2300 -454.43000000 mod011 3514.2700 -54558535.01422730 modglob 3586.6700 20798910.76650850 n3700 3547.3000 1975456.00000000 n3701 3551.8300 1871470.00000000 n3702 3549.8200 1882613.00000000 n3703 3553.7100 2066729.00000000 n3704 3553.8200 2019324.00000000 n3705 3539.9400 1966442.00000000 n3706 3553.1100 2114635.00000000 n3707 3557.6100 2076597.00000000 n3708 3536.5400 1977030.00000000 n3709 3546.4700 1982316.00000000 n370a 3553.6800 2038077.00000000 n370b 3560.1600 1913041.00000000 n370c 3561.6400 2084575.00000000 n370d 3563.1700 2084575.00000000 n370e 3530.9700 2085925.00000000 neos1 3559.6400 21.00000000 neos2 3557.6300 1210.42276247 neos3 3552.4700 1279.68092075 neos6 3574.9600 89.00000000 noswot 3590.2000 -41.00000000 pk1 3583.2700 11.00000000 pp08a 3585.0900 7370.00000000 prod1 3537.4500 -56.00000000 qiu 3577.3100 -132.87313695 ran10x26 3588.6200 4270.00000000 ran12x12 3587.4500 2291.00000000 ran12x21 3588.1800 3715.00000000 ran13x13 3589.4800 3252.00000000 ran14x18 3588.6400 3837.00000000 ran16x16 3586.5000 3836.00000000 ran17x17 3589.9200 1391.00000000 rlp2 46.5900 19.00000000 rout 2782.6800 1077.56000000 set1ch 3587.2000 58065.00000000 seymour1 3565.0100 410.83591734 seymour 3587.3400 430.00000000 swath1 3544.5200 379.07129575 swath2 3539.7400 385.19969295 swath 3549.5900 507.84604300

 Modelname Time (Glpk) Status (Glpk) acc-tight-2 -- mstat(14) sstat( 3) acc-tight-3 -- mstat(14) sstat( 3) acc-tight-6 -- mstat(13) sstat(13) fast0507 -- mstat(14) sstat( 3)