## Solver Square Comparison: Considers all models.

 Date / Time: 08/25/08 16:26:11

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC11 is represented on the left (rows) and solver CBC20 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : 22.4.trc Tracefile 2 : 22.7.trc Solvers used : CBC11 CBC20 Modeltype(s) MIP

 CBC20: optimal CBC20: feasible CBC20: infeasible CBC20: unbounded CBC20: fail CBC20: no data total CBC11 CBC11: optimal - - - - - - - CBC11: feasible 64 3 - - 2 - 69 CBC11: infeasible 4 - - - 4 - 8 CBC11: unbounded - - - - - - - CBC11: fail 13 18 - - 2 - 33 CBC11: no data - - - - - - - total CBC20 81 21 - - 8 - 110

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (CBC11) Time (CBC20) Ratio (CBC11/CBC20) Obj (CBC11) Obj (CBC20) acc-tight-0 79.4800 3.8400 20.698 0.00000000 0.00000000 acc-tight-4 67.7100 8.5600 7.910 0.00000000 0.00000000 air03 8.1100 5.1800 1.566 340160.00000000 340160.00000000 air04 91.1400 298.6500 0.305 56137.00000000 56137.00000000 air05 152.7400 422.5000 0.362 26374.00000000 26374.00000000 bal8x12 2.3400 1.7300 1.353 471.55000000 471.55000000 bell3a 19.1600 3.1600 6.063 878430.31600000 878430.31600000 bk4x3 0.0000 0.0100 --- 350.00000000 350.00000000 blend2 99.5500 12.4600 7.990 7.59898500 7.59898500 cap6000 37.3800 12.4000 3.015 -2451377.00000000 -2451377.00000000 dcmulti 6.7600 6.7100 1.007 188182.00000000 188182.00000000 dsbmip 6.6700 1.0800 6.176 -306.76901203 -306.76901203 egout 0.0100 0.0300 --- 568.10070000 568.10070000 enigma 89.8100 6.1600 14.580 0.00000000 0.00000000 fiber 12.8600 2.0000 6.430 405935.18000000 405935.18000000 fixnet6 6.7900 11.5100 0.590 3983.00000000 3983.00000000 gen 0.1400 0.1900 0.737 112325.86584600 112313.36271800 gesa2 20.7400 11.2300 1.847 25779856.37169780 25779856.37169790 gesa2_o 55.9100 42.3500 1.320 25779856.37169790 25779856.37169790 gesa3 14.0200 11.6000 1.209 27991042.64838260 27991042.64838270 gesa3_o 8.2400 13.1500 0.627 27991042.64838270 27991042.64838270 gr4x6 0.0200 0.0300 --- 202.35000000 202.35000000 gt2 1.7700 0.0500 35.400 21166.00000000 21166.00000000 irp 41.0900 244.0700 0.168 12159.49283600 12159.49283600 khb05250 0.3900 0.4600 0.848 106940226.00000000 106940226.00000000 l152lav 30.0500 23.8300 1.261 4722.00000000 4722.00000000 lseu 3.4000 1.7700 1.921 1120.00000000 1120.00000000 mas76 496.5700 241.3000 2.058 40005.05414200 40005.05414200 misc03 9.4800 3.3400 2.838 3360.00000000 3360.00000000 misc06 2.0600 1.3400 1.537 12850.86073738 12850.86073738 misc07 96.3800 108.7200 0.886 2810.00000000 2810.00000000 mitre 12.5400 10.1600 1.234 115155.00000000 115155.00000000 mod008 1.0300 1.7800 0.579 307.00000000 307.00000000 mod010 2.5600 1.1200 2.286 6548.00000000 6548.00000000 mod011 153.0800 248.0700 0.617 -54558535.01422740 -54558535.01422730 modglob 28.7600 30.0400 0.957 20740508.08630820 20740508.08630820 nw04 44.9000 25.0300 1.794 16862.00000000 16862.00000000 p0033 0.1700 0.0600 2.833 3089.00000000 3089.00000000 p0201 15.3000 7.6800 1.992 7615.00000000 7615.00000000 p0282 4.5600 3.1900 1.429 258411.00000000 258411.00000000 p0548 0.3400 0.5800 0.586 8691.00000000 8691.00000000 p2756 7.2600 2.4300 2.988 3124.00000000 3124.00000000 pk1 244.2700 129.1600 1.891 11.00000000 11.00000000 pp08acuts 58.0900 40.0900 1.449 7350.00000000 7350.00000000 pp08a 91.0000 75.2400 1.209 7350.00000000 7350.00000000 prod1 170.7700 134.6000 1.269 -56.00000000 -56.00000000 qnet1 5.2800 7.1300 0.741 16029.69268100 16029.69268100 qnet1_o 7.7900 6.2200 1.252 16029.69268100 16029.69268100 ran10x10a 4.7400 3.5300 1.343 1499.00000000 1499.00000000 ran10x10b 4.2500 2.3800 1.786 3073.00000000 3073.00000000 ran10x10c 17.3100 11.3300 1.528 13007.00000000 13007.00000000 ran10x12 3.6400 2.5900 1.405 2714.00000000 2714.00000000 ran10x26 571.5800 112.6900 5.072 4270.00000000 4270.00000000 ran12x12 176.2700 47.1800 3.736 2291.00000000 2291.00000000 ran13x13 353.2600 169.8700 2.080 3252.00000000 3252.00000000 ran17x17 91.5700 26.1100 3.507 1373.00000000 1373.00000000 ran4x64 3.9300 1.9500 2.015 9711.00000000 9711.00000000 ran6x43 6.6800 3.7100 1.801 6330.00000000 6330.00000000 ran8x32 223.3700 43.7500 5.106 5247.00000000 5247.00000000 stein27 2.4000 2.9500 0.814 18.00000000 18.00000000 stein45 48.8600 64.5800 0.757 30.00000000 30.00000000 swath1 730.0800 743.8200 0.982 379.07130045 379.07129575 vpm1 1.4600 0.2000 7.300 20.00000000 20.00000000 vpm2 11.4400 8.6600 1.321 13.75000000 13.75000000

 Modelname Time (CBC11) Time (CBC20) Ratio (CBC11/CBC20) Obj (CBC11) Obj (CBC20) neos2 50.6300 1800.5500 0.028 454.86469325 468.53452713 neos3 315.0000 1800.7300 0.175 368.84273693 387.48814776 swath2 1443.6100 1801.1400 0.801 385.19969295 387.63980365

 Modelname Time (CBC11) Time (CBC20) Ratio (CBC11/CBC20) Obj (CBC11) Status (CBC20) dano3_3 306.3000 NA --- 576.34463303 mstat(13) sstat(13) dano3_4 279.9000 NA --- 576.43522471 mstat(13) sstat(13)

 Modelname Time (CBC11) Time (CBC20) Ratio (CBC11/CBC20) Status (CBC11) Obj (CBC20) mas284 69.3600 31.0800 --- mstat(19) sstat( 1) 91405.72368220 neos4 58.0700 42.0800 --- mstat(19) sstat( 1) -4.8603440750589E+10 neos5 54.6200 33.9300 --- mstat(19) sstat( 1) -4.8603440750589E+10 rlp2 0.9400 3.9600 --- mstat(19) sstat( 1) 19.00000000

 Modelname Time (CBC11) Time (CBC20) Ratio (CBC11/CBC20) Status (CBC11) Status (CBC20) acc-tight-2 1800.2600 NA --- mstat(19) sstat( 1) mstat(13) sstat(13) acc-tight-3 1800.1200 NA --- mstat(19) sstat( 1) mstat(13) sstat(13) acc-tight-5 1800.3000 NA --- mstat(19) sstat( 1) mstat(13) sstat(13) acc-tight-6 1800.1400 NA --- mstat(19) sstat( 1) mstat(13) sstat(13)

 Modelname Time (CBC11) Time (CBC20) Ratio (CBC11/CBC20) Status (CBC11) Obj (CBC20) 10teams 1800.4200 35.9300 --- mstat(14) sstat( 2) 924.00000000 acc-tight-1 1800.5400 6.0500 --- mstat(14) sstat( 2) 0.00000000 bienst1 1800.0600 103.6800 --- mstat(14) sstat( 2) 46.75000000 bienst2 1800.1100 762.9600 --- mstat(14) sstat( 2) 54.60000000 harp2 1800.3800 1788.4700 --- mstat(14) sstat( 2) -73889532.00000000 neos1 1801.9800 970.2200 --- mstat(14) sstat( 2) 19.00000000 neos6 1801.7700 441.4500 --- mstat(14) sstat( 2) 83.00000000 qiu 1800.4800 293.6300 --- mstat(14) sstat( 2) -132.87313695 ran12x21 1800.7200 247.7600 --- mstat(14) sstat( 2) 3664.00000000 ran16x16 1801.7700 992.1700 --- mstat(14) sstat( 2) 3823.00000000 rentacar 12.7000 6.0900 --- mstat(13) sstat(13) 28882470.94755350 rgn NA 3.5000 --- mstat(13) sstat(13) 82.19999924 bell5 1803.6700 82.9300 --- mstat(14) sstat( 2) 8966406.49152000

 Modelname Time (CBC11) Time (CBC20) Ratio (CBC11/CBC20) Status (CBC11) Obj (CBC20) arki001 1800.8200 1801.4900 --- mstat(14) sstat( 2) 7582515.66574672 bc1 NA 1803.2900 --- mstat(13) sstat(13) 3.33836255 bc NA 1801.8500 --- mstat(13) sstat(13) 7.00000000 binkar10_1 1801.5000 1801.6600 --- mstat(14) sstat( 2) 6746.64002300 danoint 1800.5000 1800.9200 --- mstat(14) sstat( 2) 66.37500000 fast0507 1813.3400 1806.2800 --- mstat(14) sstat( 2) 179.00000000 mkc1 NA 1800.4400 --- mstat(13) sstat(13) -607.20700000 mkc 1801.1400 1802.2200 --- mstat(14) sstat( 2) -534.34200000 ran14x18 1801.6900 1802.8000 --- mstat(14) sstat( 2) 3735.00000000 rout 1801.3500 1802.4900 --- mstat(14) sstat( 2) 1077.56000000 set1ch 1801.3900 1802.4400 --- mstat(14) sstat( 2) 54555.00000000 seymour1 1801.7000 1825.8300 --- mstat(14) sstat( 2) 411.08574808 seymour 1801.7700 1802.5000 --- mstat(14) sstat( 2) 435.00000000 swath NA 1802.1400 --- mstat(13) sstat(13) 517.86689600 markshare1 1804.9500 1804.5300 --- mstat(14) sstat( 2) 11.00000000 markshare2 1805.3600 1803.2400 --- mstat(14) sstat( 2) 14.00000000 mas74 1802.6200 1803.5200 --- mstat(14) sstat( 2) 11801.18572900 noswot 1802.7600 1758.7600 --- mstat(14) sstat( 2) -41.00000000

 Modelname Time (CBC11) Time (CBC20) Ratio (CBC11/CBC20) Status (CBC11) Status (CBC20) dano3_5 1806.8600 NA --- mstat(14) sstat( 2) mstat(13) sstat(13) dano3mip 1814.3800 NA --- mstat(14) sstat( 2) mstat(13) sstat(13)

 Modelname Time (CBC11) Obj (CBC11) acc-tight-0 79.4800 0.00000000 acc-tight-4 67.7100 0.00000000 air03 8.1100 340160.00000000 air04 91.1400 56137.00000000 air05 152.7400 26374.00000000 bal8x12 2.3400 471.55000000 bell3a 19.1600 878430.31600000 bk4x3 0.0000 350.00000000 blend2 99.5500 7.59898500 cap6000 37.3800 -2451377.00000000 dano3_3 306.3000 576.34463303 dano3_4 279.9000 576.43522471 dcmulti 6.7600 188182.00000000 dsbmip 6.6700 -306.76901203 egout 0.0100 568.10070000 enigma 89.8100 0.00000000 fiber 12.8600 405935.18000000 fixnet6 6.7900 3983.00000000 gen 0.1400 112325.86584600 gesa2 20.7400 25779856.37169780 gesa2_o 55.9100 25779856.37169790 gesa3 14.0200 27991042.64838260 gesa3_o 8.2400 27991042.64838270 gr4x6 0.0200 202.35000000 gt2 1.7700 21166.00000000 irp 41.0900 12159.49283600 khb05250 0.3900 106940226.00000000 l152lav 30.0500 4722.00000000 lseu 3.4000 1120.00000000 mas76 496.5700 40005.05414200 misc03 9.4800 3360.00000000 misc06 2.0600 12850.86073738 misc07 96.3800 2810.00000000 mitre 12.5400 115155.00000000 mod008 1.0300 307.00000000 mod010 2.5600 6548.00000000 mod011 153.0800 -54558535.01422740 modglob 28.7600 20740508.08630820 neos2 50.6300 454.86469325 neos3 315.0000 368.84273693 nw04 44.9000 16862.00000000 p0033 0.1700 3089.00000000 p0201 15.3000 7615.00000000 p0282 4.5600 258411.00000000 p0548 0.3400 8691.00000000 p2756 7.2600 3124.00000000 pk1 244.2700 11.00000000 pp08acuts 58.0900 7350.00000000 pp08a 91.0000 7350.00000000 prod1 170.7700 -56.00000000 qnet1 5.2800 16029.69268100 qnet1_o 7.7900 16029.69268100 ran10x10a 4.7400 1499.00000000 ran10x10b 4.2500 3073.00000000 ran10x10c 17.3100 13007.00000000 ran10x12 3.6400 2714.00000000 ran10x26 571.5800 4270.00000000 ran12x12 176.2700 2291.00000000 ran13x13 353.2600 3252.00000000 ran17x17 91.5700 1373.00000000 ran4x64 3.9300 9711.00000000 ran6x43 6.6800 6330.00000000 ran8x32 223.3700 5247.00000000 stein27 2.4000 18.00000000 stein45 48.8600 30.00000000 swath1 730.0800 379.07130045 swath2 1443.6100 385.19969295 vpm1 1.4600 20.00000000 vpm2 11.4400 13.75000000

 Modelname Time (CBC11) Status (CBC11) acc-tight-2 -- mstat(19) sstat( 1) acc-tight-3 -- mstat(19) sstat( 1) acc-tight-5 -- mstat(19) sstat( 1) acc-tight-6 -- mstat(19) sstat( 1) mas284 -- mstat(19) sstat( 1) neos4 -- mstat(19) sstat( 1) neos5 -- mstat(19) sstat( 1) rlp2 -- mstat(19) sstat( 1)

 Modelname Time (CBC11) Status (CBC11) 10teams -- mstat(14) sstat( 2) acc-tight-1 -- mstat(14) sstat( 2) arki001 -- mstat(14) sstat( 2) bc1 -- mstat(13) sstat(13) bc -- mstat(13) sstat(13) bienst1 -- mstat(14) sstat( 2) bienst2 -- mstat(14) sstat( 2) binkar10_1 -- mstat(14) sstat( 2) dano3_5 -- mstat(14) sstat( 2) dano3mip -- mstat(14) sstat( 2) danoint -- mstat(14) sstat( 2) fast0507 -- mstat(14) sstat( 2) harp2 -- mstat(14) sstat( 2) mkc1 -- mstat(13) sstat(13) mkc -- mstat(14) sstat( 2) neos1 -- mstat(14) sstat( 2) neos6 -- mstat(14) sstat( 2) qiu -- mstat(14) sstat( 2) ran12x21 -- mstat(14) sstat( 2) ran14x18 -- mstat(14) sstat( 2) ran16x16 -- mstat(14) sstat( 2) rentacar -- mstat(13) sstat(13) rgn -- mstat(13) sstat(13) rout -- mstat(14) sstat( 2) set1ch -- mstat(14) sstat( 2) seymour1 -- mstat(14) sstat( 2) seymour -- mstat(14) sstat( 2) swath -- mstat(13) sstat(13) markshare1 -- mstat(14) sstat( 2) markshare2 -- mstat(14) sstat( 2) mas74 -- mstat(14) sstat( 2) bell5 -- mstat(14) sstat( 2) noswot -- mstat(14) sstat( 2)

 Modelname Time (CBC20) Obj (CBC20) 10teams 35.9300 924.00000000 acc-tight-0 3.8400 0.00000000 acc-tight-1 6.0500 0.00000000 acc-tight-4 8.5600 0.00000000 air03 5.1800 340160.00000000 air04 298.6500 56137.00000000 air05 422.5000 26374.00000000 bal8x12 1.7300 471.55000000 bell3a 3.1600 878430.31600000 bienst1 103.6800 46.75000000 bienst2 762.9600 54.60000000 bk4x3 0.0100 350.00000000 blend2 12.4600 7.59898500 cap6000 12.4000 -2451377.00000000 dcmulti 6.7100 188182.00000000 dsbmip 1.0800 -306.76901203 egout 0.0300 568.10070000 enigma 6.1600 0.00000000 fiber 2.0000 405935.18000000 fixnet6 11.5100 3983.00000000 gen 0.1900 112313.36271800 gesa2 11.2300 25779856.37169790 gesa2_o 42.3500 25779856.37169790 gesa3 11.6000 27991042.64838270 gesa3_o 13.1500 27991042.64838270 gr4x6 0.0300 202.35000000 gt2 0.0500 21166.00000000 harp2 1788.4700 -73889532.00000000 irp 244.0700 12159.49283600 khb05250 0.4600 106940226.00000000 l152lav 23.8300 4722.00000000 lseu 1.7700 1120.00000000 mas284 31.0800 91405.72368220 mas76 241.3000 40005.05414200 misc03 3.3400 3360.00000000 misc06 1.3400 12850.86073738 misc07 108.7200 2810.00000000 mitre 10.1600 115155.00000000 mod008 1.7800 307.00000000 mod010 1.1200 6548.00000000 mod011 248.0700 -54558535.01422730 modglob 30.0400 20740508.08630820 neos1 970.2200 19.00000000 neos4 42.0800 -4.8603440750589E+10 neos5 33.9300 -4.8603440750589E+10 neos6 441.4500 83.00000000 nw04 25.0300 16862.00000000 p0033 0.0600 3089.00000000 p0201 7.6800 7615.00000000 p0282 3.1900 258411.00000000 p0548 0.5800 8691.00000000 p2756 2.4300 3124.00000000 pk1 129.1600 11.00000000 pp08acuts 40.0900 7350.00000000 pp08a 75.2400 7350.00000000 prod1 134.6000 -56.00000000 qiu 293.6300 -132.87313695 qnet1 7.1300 16029.69268100 qnet1_o 6.2200 16029.69268100 ran10x10a 3.5300 1499.00000000 ran10x10b 2.3800 3073.00000000 ran10x10c 11.3300 13007.00000000 ran10x12 2.5900 2714.00000000 ran10x26 112.6900 4270.00000000 ran12x12 47.1800 2291.00000000 ran12x21 247.7600 3664.00000000 ran13x13 169.8700 3252.00000000 ran16x16 992.1700 3823.00000000 ran17x17 26.1100 1373.00000000 ran4x64 1.9500 9711.00000000 ran6x43 3.7100 6330.00000000 ran8x32 43.7500 5247.00000000 rentacar 6.0900 28882470.94755350 rgn 3.5000 82.19999924 rlp2 3.9600 19.00000000 stein27 2.9500 18.00000000 stein45 64.5800 30.00000000 swath1 743.8200 379.07129575 vpm1 0.2000 20.00000000 vpm2 8.6600 13.75000000 bell5 82.9300 8966406.49152000

 Modelname Time (CBC20) Obj (CBC20) arki001 1801.4900 7582515.66574672 bc1 1803.2900 3.33836255 bc 1801.8500 7.00000000 binkar10_1 1801.6600 6746.64002300 danoint 1800.9200 66.37500000 fast0507 1806.2800 179.00000000 mkc1 1800.4400 -607.20700000 mkc 1802.2200 -534.34200000 neos2 1800.5500 468.53452713 neos3 1800.7300 387.48814776 ran14x18 1802.8000 3735.00000000 rout 1802.4900 1077.56000000 set1ch 1802.4400 54555.00000000 seymour1 1825.8300 411.08574808 seymour 1802.5000 435.00000000 swath2 1801.1400 387.63980365 swath 1802.1400 517.86689600 markshare1 1804.5300 11.00000000 markshare2 1803.2400 14.00000000 mas74 1803.5200 11801.18572900 noswot 1758.7600 -41.00000000

 Modelname Time (CBC20) Status (CBC20) acc-tight-2 -- mstat(13) sstat(13) acc-tight-3 -- mstat(13) sstat(13) acc-tight-5 -- mstat(13) sstat(13) acc-tight-6 -- mstat(13) sstat(13) dano3_3 -- mstat(13) sstat(13) dano3_4 -- mstat(13) sstat(13) dano3_5 -- mstat(13) sstat(13) dano3mip -- mstat(13) sstat(13)