Solver Square Comparison: Considers all models.

 Date / Time: 09/14/08 17:33:04

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CPLEX is represented on the left (rows) and solver Glpk on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : CPLEX-1.trc Tracefile 2 : GLPK-1.trc Solvers used : CPLEX Glpk Modeltype(s) MIP

 Glpk: optimal Glpk: feasible Glpk: infeasible Glpk: unbounded Glpk: fail Glpk: no data total CPLEX CPLEX: optimal 63 33 - - 4 - 100 CPLEX: feasible - 24 - - - - 24 CPLEX: infeasible - - - - - - - CPLEX: unbounded - - - - - - - CPLEX: fail - 1 - - - - 1 CPLEX: no data - - - - - - - total Glpk 63 58 - - 4 - 125

Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (CPLEX) Time (Glpk) Ratio (CPLEX/Glpk) Obj (CPLEX) Obj (Glpk) 10teams 4.3200 132.4400 0.033 924.00000000 924.00000000 acc-tight-0 0.4800 33.8300 0.014 0.00000000 0.00000000 acc-tight-1 1.9800 44.5600 0.044 0.00000000 0.00000000 acc-tight-4 1.3300 41.8300 0.032 0.00000000 0.00000000 acc-tight-5 39.5900 66.7700 0.593 0.00000000 0.00000000 air03 0.4600 0.6000 0.767 340160.00000000 340160.00000000 bal8x12 0.1000 0.1000 1.000 471.55000000 471.55000000 bc1 133.6400 3238.2800 0.041 3.33836255 3.33836255 bell3a 1.8600 22.6700 0.082 878430.31600000 878430.31600000 bell5 0.1800 231.3100 0.001 8966406.49152000 8966406.49152000 bienst1 35.4700 413.5900 0.086 46.75000000 46.75000000 bienst2 190.6700 2597.6400 0.073 54.60000000 54.60000000 bk4x3 0.0000 0.0000 --- 350.00000000 350.00000000 blend2 1.3200 9.5700 0.138 7.59898500 7.59898500 dano3_3 72.8300 70.5900 1.032 576.34463451 576.34463303 dano3_4 91.9000 108.4100 0.848 576.43522471 576.43522471 dano3_5 245.1400 1378.9000 0.178 576.92491596 576.92491596 dcmulti 0.3500 4.5400 0.077 188182.00000000 188182.00000000 dsbmip 0.5200 0.2400 2.167 -306.76901203 -306.76901203 egout 0.0000 0.0200 --- 568.10070000 568.10070000 enigma 0.0100 35.4500 0.000 0.00000000 0.00000000 fiber 0.2400 136.8000 0.002 405935.18000000 405935.18000000 fixnet6 1.0000 6.1200 0.163 3983.00000000 3983.00000000 gen 0.0200 0.2300 0.087 112313.36271800 112313.36271800 gesa2 0.3300 268.3800 0.001 25779856.37169790 25779856.37169790 gesa3 0.6100 3.5200 0.173 27991042.64838270 27991042.64838270 gesa3_o 0.2700 5.3000 0.051 27991042.64838380 27991042.64838270 gr4x6 0.0100 0.0200 --- 202.35000000 202.35000000 gt2 0.0200 0.1200 0.167 21166.00000000 21166.00000000 irp 5.0400 72.6000 0.069 12159.49283600 12159.49283600 khb05250 0.1100 4.4900 0.024 106940226.00000000 106940226.00000000 l152lav 0.8800 153.8000 0.006 4722.00000000 4722.00000000 lseu 0.0600 0.8100 0.074 1120.00000000 1120.00000000 mas284 4.2600 185.6300 0.023 91405.72368220 91405.72368220 misc03 1.0400 20.4000 0.051 3360.00000000 3360.00000000 misc06 0.1000 0.3400 0.294 12850.86073738 12850.86073738 mitre 0.5200 280.0600 0.002 115155.00000000 115155.00000000 mod008 0.1000 3.3600 0.030 307.00000000 307.00000000 mod010 0.3400 1.0400 0.327 6548.00000000 6548.00000000 neos4 3.2000 1944.2700 0.002 -4.8603440750589E+10 -4.8587177297581E+10 neos5 3.1200 1954.4900 0.002 -4.8603440750589E+10 -4.8587177297581E+10 nw04 33.0400 31.0100 1.065 16862.00000000 16862.00000000 p0033 0.0100 0.0200 --- 3089.00000000 3089.00000000 p0201 0.2700 4.1600 0.065 7615.00000000 7615.00000000 p0282 0.1000 0.5800 0.172 258411.00000000 258411.00000000 p0548 0.0400 0.8400 0.048 8691.00000000 8691.00000000 p2756 0.3100 32.7100 0.009 3124.00000000 3124.00000000 pp08acuts 1.4200 2695.2900 0.001 7350.00000000 7350.00000000 qnet1 1.5200 12.2000 0.125 16029.69268100 16029.69268100 qnet1_o 0.9800 6.3400 0.155 16029.69268100 16029.69268100 ran10x10a 0.1600 21.8900 0.007 1499.00000000 1499.00000000 ran10x10b 0.1200 7.7100 0.016 3073.00000000 3073.00000000 ran10x10c 1.4300 827.1200 0.002 13007.00000000 13007.00000000 ran10x12 0.3400 5.1100 0.067 2714.00000000 2714.00000000 ran4x64 0.1800 4.6800 0.038 9711.00000000 9711.00000000 ran6x43 0.3100 17.1200 0.018 6330.00000000 6330.00000000 ran8x32 3.2600 2209.3200 0.001 5247.00000000 5247.00000000 rentacar 0.4600 2.1000 0.219 28882470.94755350 28882470.94755350 rgn 0.1500 2.0000 0.075 82.19999924 82.19999924 stein27 0.2400 4.1800 0.057 18.00000000 18.00000000 stein45 11.0900 129.1200 0.086 30.00000000 30.00000000 vpm1 0.0800 38.0200 0.002 20.00000000 20.00000000 vpm2 0.7800 489.5200 0.002 13.75000000 13.75000000

 Modelname Time (CPLEX) Time (Glpk) Ratio (CPLEX/Glpk) Obj (CPLEX) Obj (Glpk) air04 16.5400 3597.0600 0.005 56137.00000000 56167.00000000 air05 9.6300 3585.3100 0.003 26374.00000000 26374.00000000 binkar10_1 18.7000 3550.3300 0.005 6742.20002400 6753.10001300 cap6000 1.0800 3514.8500 0.000 -2451377.00000000 -2315081.00000000 gesa2_o 0.3200 3584.0100 0.000 25779856.37169790 25795208.86238610 harp2 281.9200 3587.9000 0.079 -73899798.69998661 -73533274.00000000 mas74 328.6000 3582.9700 0.092 11801.18572900 11877.69436060 mas76 57.2300 3580.1300 0.016 40005.05414200 40121.91226290 misc07 32.9700 2134.6400 0.015 2810.00000000 2810.00000000 mkc1 31.6300 3493.7500 0.009 -607.20700000 -606.16700000 mod011 109.4300 3514.2700 0.031 -54558535.01422730 -54558535.01422730 modglob 0.1500 3586.6700 0.000 20740508.08630820 20798910.76650850 neos1 0.7200 3559.6400 0.000 19.00000000 21.00000000 neos2 29.5200 3557.6300 0.008 454.86469704 1210.42276247 neos3 45.4900 3552.4700 0.013 368.84275100 1279.68092075 neos6 80.6100 3574.9600 0.023 83.00000000 89.00000000 pk1 129.5300 3583.2700 0.036 11.00000000 11.00000000 pp08a 1.0600 3585.0900 0.000 7350.00000000 7370.00000000 prod1 15.5800 3537.4500 0.004 -56.00000000 -56.00000000 qiu 48.5300 3577.3100 0.014 -132.87313695 -132.87313695 ran10x26 12.6100 3588.6200 0.004 4270.00000000 4270.00000000 ran12x12 9.5200 3587.4500 0.003 2291.00000000 2291.00000000 ran12x21 63.1100 3588.1800 0.018 3664.00000000 3715.00000000 ran13x13 19.4500 3589.4800 0.005 3252.00000000 3252.00000000 ran14x18 2572.4600 3588.6400 0.717 3712.00000000 3837.00000000 ran16x16 163.8600 3586.5000 0.046 3823.00000000 3836.00000000 ran17x17 5.2600 3589.9200 0.001 1373.00000000 1391.00000000 rlp2 0.0200 46.5900 0.000 19.00000000 19.00000000 rout 12.0600 2782.6800 0.004 1077.56000000 1077.56000000 set1ch 0.3300 3587.2000 0.000 54537.75000000 58065.00000000 seymour1 219.5900 3565.0100 0.062 410.76370139 410.83591734 swath1 13.2900 3544.5200 0.004 379.07129575 379.07129575 swath2 11.3200 3539.7400 0.003 385.19969295 385.19969295

 Modelname Time (CPLEX) Time (Glpk) Ratio (CPLEX/Glpk) Obj (CPLEX) Status (Glpk) acc-tight-2 56.1900 3582.6300 --- 0.00000000 mstat(14) sstat( 3) acc-tight-3 1700.7700 3588.9200 --- 0.00000000 mstat(14) sstat( 3) acc-tight-6 49.1500 NA --- 0.00000000 mstat(13) sstat(13) fast0507 1862.9000 3612.5200 --- 174.00000000 mstat(14) sstat( 3)

 Modelname Time (CPLEX) Time (Glpk) Ratio (CPLEX/Glpk) Obj (CPLEX) Obj (Glpk) arki001 3600.0400 443.5600 8.116 7580813.04595096 7581130.51694198 bc 3600.2300 2709.6300 1.329 7.00000000 9.00000000 dano3mip 3600.3600 3608.9300 0.998 717.18181818 766.91891892 danoint 3600.0000 521.9900 6.897 65.66666667 66.27272727 markshare1 3600.0100 3586.9600 1.004 6.00000000 15.00000000 markshare2 3600.0100 3584.8200 1.004 17.00000000 40.00000000 mkc 3600.1000 3504.2300 1.027 -563.84600000 -454.43000000 n3700 3600.0900 3547.3000 1.015 1305784.00000000 1975456.00000000 n3701 3600.1400 3551.8300 1.014 1288319.00000000 1871470.00000000 n3702 3600.0800 3549.8200 1.014 1281202.00000000 1882613.00000000 n3703 3600.1000 3553.7100 1.013 1268328.00000000 2066729.00000000 n3704 3600.0900 3553.8200 1.013 1304313.00000000 2019324.00000000 n3705 3600.1000 3539.9400 1.017 1306784.00000000 1966442.00000000 n3706 3600.1000 3553.1100 1.013 1281325.00000000 2114635.00000000 n3707 3600.1000 3557.6100 1.012 1257876.00000000 2076597.00000000 n3708 3600.1200 3536.5400 1.018 1297991.00000000 1977030.00000000 n3709 3600.1000 3546.4700 1.015 1301093.00000000 1982316.00000000 n370a 3600.1200 3553.6800 1.013 1322031.00000000 2038077.00000000 n370b 3600.1000 3560.1600 1.011 1302170.00000000 1913041.00000000 n370c 3600.1200 3561.6400 1.011 1303884.00000000 2084575.00000000 n370d 3600.1000 3563.1700 1.010 1303884.00000000 2084575.00000000 n370e 3600.1500 3530.9700 1.020 1274838.00000000 2085925.00000000 noswot 3600.0100 3590.2000 1.003 -41.00000000 -41.00000000 seymour 3600.0600 3587.3400 1.004 424.00000000 430.00000000

 Modelname Time (CPLEX) Time (Glpk) Ratio (CPLEX/Glpk) Status (CPLEX) Obj (Glpk) swath 1220.1400 3549.5900 --- mstat(14) sstat( 4) 507.84604300

 Modelname Time (CPLEX) Obj (CPLEX) 10teams 4.3200 924.00000000 acc-tight-0 0.4800 0.00000000 acc-tight-1 1.9800 0.00000000 acc-tight-2 56.1900 0.00000000 acc-tight-3 1700.7700 0.00000000 acc-tight-4 1.3300 0.00000000 acc-tight-5 39.5900 0.00000000 acc-tight-6 49.1500 0.00000000 air03 0.4600 340160.00000000 air04 16.5400 56137.00000000 air05 9.6300 26374.00000000 bal8x12 0.1000 471.55000000 bc1 133.6400 3.33836255 bell3a 1.8600 878430.31600000 bell5 0.1800 8966406.49152000 bienst1 35.4700 46.75000000 bienst2 190.6700 54.60000000 binkar10_1 18.7000 6742.20002400 bk4x3 0.0000 350.00000000 blend2 1.3200 7.59898500 cap6000 1.0800 -2451377.00000000 dano3_3 72.8300 576.34463451 dano3_4 91.9000 576.43522471 dano3_5 245.1400 576.92491596 dcmulti 0.3500 188182.00000000 dsbmip 0.5200 -306.76901203 egout 0.0000 568.10070000 enigma 0.0100 0.00000000 fast0507 1862.9000 174.00000000 fiber 0.2400 405935.18000000 fixnet6 1.0000 3983.00000000 gen 0.0200 112313.36271800 gesa2 0.3300 25779856.37169790 gesa2_o 0.3200 25779856.37169790 gesa3 0.6100 27991042.64838270 gesa3_o 0.2700 27991042.64838380 gr4x6 0.0100 202.35000000 gt2 0.0200 21166.00000000 harp2 281.9200 -73899798.69998661 irp 5.0400 12159.49283600 khb05250 0.1100 106940226.00000000 l152lav 0.8800 4722.00000000 lseu 0.0600 1120.00000000 mas284 4.2600 91405.72368220 mas74 328.6000 11801.18572900 mas76 57.2300 40005.05414200 misc03 1.0400 3360.00000000 misc06 0.1000 12850.86073738 misc07 32.9700 2810.00000000 mitre 0.5200 115155.00000000 mkc1 31.6300 -607.20700000 mod008 0.1000 307.00000000 mod010 0.3400 6548.00000000 mod011 109.4300 -54558535.01422730 modglob 0.1500 20740508.08630820 neos1 0.7200 19.00000000 neos2 29.5200 454.86469704 neos3 45.4900 368.84275100 neos4 3.2000 -4.8603440750589E+10 neos5 3.1200 -4.8603440750589E+10 neos6 80.6100 83.00000000 nw04 33.0400 16862.00000000 p0033 0.0100 3089.00000000 p0201 0.2700 7615.00000000 p0282 0.1000 258411.00000000 p0548 0.0400 8691.00000000 p2756 0.3100 3124.00000000 pk1 129.5300 11.00000000 pp08acuts 1.4200 7350.00000000 pp08a 1.0600 7350.00000000 prod1 15.5800 -56.00000000 qiu 48.5300 -132.87313695 qnet1 1.5200 16029.69268100 qnet1_o 0.9800 16029.69268100 ran10x10a 0.1600 1499.00000000 ran10x10b 0.1200 3073.00000000 ran10x10c 1.4300 13007.00000000 ran10x12 0.3400 2714.00000000 ran10x26 12.6100 4270.00000000 ran12x12 9.5200 2291.00000000 ran12x21 63.1100 3664.00000000 ran13x13 19.4500 3252.00000000 ran14x18 2572.4600 3712.00000000 ran16x16 163.8600 3823.00000000 ran17x17 5.2600 1373.00000000 ran4x64 0.1800 9711.00000000 ran6x43 0.3100 6330.00000000 ran8x32 3.2600 5247.00000000 rentacar 0.4600 28882470.94755350 rgn 0.1500 82.19999924 rlp2 0.0200 19.00000000 rout 12.0600 1077.56000000 set1ch 0.3300 54537.75000000 seymour1 219.5900 410.76370139 stein27 0.2400 18.00000000 stein45 11.0900 30.00000000 swath1 13.2900 379.07129575 swath2 11.3200 385.19969295 vpm1 0.0800 20.00000000 vpm2 0.7800 13.75000000

 Modelname Time (CPLEX) Obj (CPLEX) arki001 3600.0400 7580813.04595096 bc 3600.2300 7.00000000 dano3mip 3600.3600 717.18181818 danoint 3600.0000 65.66666667 markshare1 3600.0100 6.00000000 markshare2 3600.0100 17.00000000 mkc 3600.1000 -563.84600000 n3700 3600.0900 1305784.00000000 n3701 3600.1400 1288319.00000000 n3702 3600.0800 1281202.00000000 n3703 3600.1000 1268328.00000000 n3704 3600.0900 1304313.00000000 n3705 3600.1000 1306784.00000000 n3706 3600.1000 1281325.00000000 n3707 3600.1000 1257876.00000000 n3708 3600.1200 1297991.00000000 n3709 3600.1000 1301093.00000000 n370a 3600.1200 1322031.00000000 n370b 3600.1000 1302170.00000000 n370c 3600.1200 1303884.00000000 n370d 3600.1000 1303884.00000000 n370e 3600.1500 1274838.00000000 noswot 3600.0100 -41.00000000 seymour 3600.0600 424.00000000

 Modelname Time (CPLEX) Status (CPLEX) swath -- mstat(14) sstat( 4)

 Modelname Time (Glpk) Obj (Glpk) 10teams 132.4400 924.00000000 acc-tight-0 33.8300 0.00000000 acc-tight-1 44.5600 0.00000000 acc-tight-4 41.8300 0.00000000 acc-tight-5 66.7700 0.00000000 air03 0.6000 340160.00000000 bal8x12 0.1000 471.55000000 bc1 3238.2800 3.33836255 bell3a 22.6700 878430.31600000 bell5 231.3100 8966406.49152000 bienst1 413.5900 46.75000000 bienst2 2597.6400 54.60000000 bk4x3 0.0000 350.00000000 blend2 9.5700 7.59898500 dano3_3 70.5900 576.34463303 dano3_4 108.4100 576.43522471 dano3_5 1378.9000 576.92491596 dcmulti 4.5400 188182.00000000 dsbmip 0.2400 -306.76901203 egout 0.0200 568.10070000 enigma 35.4500 0.00000000 fiber 136.8000 405935.18000000 fixnet6 6.1200 3983.00000000 gen 0.2300 112313.36271800 gesa2 268.3800 25779856.37169790 gesa3 3.5200 27991042.64838270 gesa3_o 5.3000 27991042.64838270 gr4x6 0.0200 202.35000000 gt2 0.1200 21166.00000000 irp 72.6000 12159.49283600 khb05250 4.4900 106940226.00000000 l152lav 153.8000 4722.00000000 lseu 0.8100 1120.00000000 mas284 185.6300 91405.72368220 misc03 20.4000 3360.00000000 misc06 0.3400 12850.86073738 mitre 280.0600 115155.00000000 mod008 3.3600 307.00000000 mod010 1.0400 6548.00000000 neos4 1944.2700 -4.8587177297581E+10 neos5 1954.4900 -4.8587177297581E+10 nw04 31.0100 16862.00000000 p0033 0.0200 3089.00000000 p0201 4.1600 7615.00000000 p0282 0.5800 258411.00000000 p0548 0.8400 8691.00000000 p2756 32.7100 3124.00000000 pp08acuts 2695.2900 7350.00000000 qnet1 12.2000 16029.69268100 qnet1_o 6.3400 16029.69268100 ran10x10a 21.8900 1499.00000000 ran10x10b 7.7100 3073.00000000 ran10x10c 827.1200 13007.00000000 ran10x12 5.1100 2714.00000000 ran4x64 4.6800 9711.00000000 ran6x43 17.1200 6330.00000000 ran8x32 2209.3200 5247.00000000 rentacar 2.1000 28882470.94755350 rgn 2.0000 82.19999924 stein27 4.1800 18.00000000 stein45 129.1200 30.00000000 vpm1 38.0200 20.00000000 vpm2 489.5200 13.75000000

 Modelname Time (Glpk) Obj (Glpk) air04 3597.0600 56167.00000000 air05 3585.3100 26374.00000000 arki001 443.5600 7581130.51694198 bc 2709.6300 9.00000000 binkar10_1 3550.3300 6753.10001300 cap6000 3514.8500 -2315081.00000000 dano3mip 3608.9300 766.91891892 danoint 521.9900 66.27272727 gesa2_o 3584.0100 25795208.86238610 harp2 3587.9000 -73533274.00000000 markshare1 3586.9600 15.00000000 markshare2 3584.8200 40.00000000 mas74 3582.9700 11877.69436060 mas76 3580.1300 40121.91226290 misc07 2134.6400 2810.00000000 mkc1 3493.7500 -606.16700000 mkc 3504.2300 -454.43000000 mod011 3514.2700 -54558535.01422730 modglob 3586.6700 20798910.76650850 n3700 3547.3000 1975456.00000000 n3701 3551.8300 1871470.00000000 n3702 3549.8200 1882613.00000000 n3703 3553.7100 2066729.00000000 n3704 3553.8200 2019324.00000000 n3705 3539.9400 1966442.00000000 n3706 3553.1100 2114635.00000000 n3707 3557.6100 2076597.00000000 n3708 3536.5400 1977030.00000000 n3709 3546.4700 1982316.00000000 n370a 3553.6800 2038077.00000000 n370b 3560.1600 1913041.00000000 n370c 3561.6400 2084575.00000000 n370d 3563.1700 2084575.00000000 n370e 3530.9700 2085925.00000000 neos1 3559.6400 21.00000000 neos2 3557.6300 1210.42276247 neos3 3552.4700 1279.68092075 neos6 3574.9600 89.00000000 noswot 3590.2000 -41.00000000 pk1 3583.2700 11.00000000 pp08a 3585.0900 7370.00000000 prod1 3537.4500 -56.00000000 qiu 3577.3100 -132.87313695 ran10x26 3588.6200 4270.00000000 ran12x12 3587.4500 2291.00000000 ran12x21 3588.1800 3715.00000000 ran13x13 3589.4800 3252.00000000 ran14x18 3588.6400 3837.00000000 ran16x16 3586.5000 3836.00000000 ran17x17 3589.9200 1391.00000000 rlp2 46.5900 19.00000000 rout 2782.6800 1077.56000000 set1ch 3587.2000 58065.00000000 seymour1 3565.0100 410.83591734 seymour 3587.3400 430.00000000 swath1 3544.5200 379.07129575 swath2 3539.7400 385.19969295 swath 3549.5900 507.84604300

 Modelname Time (Glpk) Status (Glpk) acc-tight-2 -- mstat(14) sstat( 3) acc-tight-3 -- mstat(14) sstat( 3) acc-tight-6 -- mstat(13) sstat(13) fast0507 -- mstat(14) sstat( 3)