## Solver Square Comparison: Considers all models.

 Date / Time: 08/25/08 16:26:12

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC12 is represented on the left (rows) and solver CBC20 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : 22.5.trc Tracefile 2 : 22.7.trc Solvers used : CBC12 CBC20 Modeltype(s) MIP

 CBC20: optimal CBC20: feasible CBC20: infeasible CBC20: unbounded CBC20: fail CBC20: no data total CBC12 CBC12: optimal - - - - - - - CBC12: feasible 68 2 - - - - 70 CBC12: infeasible - - - - - - - CBC12: unbounded - - - - - - - CBC12: fail 13 19 - - 8 - 40 CBC12: no data - - - - - - - total CBC20 81 21 - - 8 - 110

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (CBC12) Time (CBC20) Ratio (CBC12/CBC20) Obj (CBC12) Obj (CBC20) acc-tight-0 36.1500 3.8400 9.414 0.00000000 0.00000000 acc-tight-1 397.4500 6.0500 65.694 0.00000000 0.00000000 acc-tight-4 105.8300 8.5600 12.363 0.00000000 0.00000000 air03 5.0600 5.1800 0.977 340160.00000000 340160.00000000 air04 124.9700 298.6500 0.418 56137.00000000 56137.00000000 air05 348.7400 422.5000 0.825 26374.00000000 26374.00000000 bal8x12 1.0100 1.7300 0.584 471.55000000 471.55000000 bell3a 15.2900 3.1600 4.839 878430.31600000 878430.31600000 bk4x3 0.0000 0.0100 --- 350.00000000 350.00000000 blend2 14.1500 12.4600 1.136 7.59898500 7.59898500 cap6000 57.7900 12.4000 4.660 -2451377.00000000 -2451377.00000000 dcmulti 2.5200 6.7100 0.376 188182.00000000 188182.00000000 dsbmip 46.7700 1.0800 43.306 -306.76901203 -306.76901203 egout 0.0200 0.0300 --- 568.10070000 568.10070000 enigma 14.6200 6.1600 2.373 0.00000000 0.00000000 fiber 4.4900 2.0000 2.245 405935.18000000 405935.18000000 fixnet6 8.7200 11.5100 0.758 3983.00000000 3983.00000000 gen 0.4800 0.1900 2.526 112313.36271800 112313.36271800 gesa2 89.8500 11.2300 8.001 25779856.37169790 25779856.37169790 gesa2_o 500.3600 42.3500 11.815 25779856.37169790 25779856.37169790 gesa3 5.2900 11.6000 0.456 27991042.64838270 27991042.64838270 gesa3_o 7.0600 13.1500 0.537 27991042.64838270 27991042.64838270 gr4x6 0.0200 0.0300 --- 202.35000000 202.35000000 gt2 0.4700 0.0500 9.400 21166.00000000 21166.00000000 irp 87.6500 244.0700 0.359 12159.49283600 12159.49283600 khb05250 0.2800 0.4600 0.609 106940226.00000000 106940226.00000000 l152lav 35.7100 23.8300 1.499 4722.00000000 4722.00000000 lseu 2.1400 1.7700 1.209 1120.00000000 1120.00000000 mas284 63.5000 31.0800 2.043 91405.72368220 91405.72368220 mas76 424.9300 241.3000 1.761 40005.05414200 40005.05414200 misc03 9.8400 3.3400 2.946 3360.00000000 3360.00000000 misc06 0.8300 1.3400 0.619 12850.86073738 12850.86073738 misc07 95.1000 108.7200 0.875 2810.00000000 2810.00000000 mitre 8.6200 10.1600 0.848 115155.00000000 115155.00000000 mod008 1.2200 1.7800 0.685 307.00000000 307.00000000 mod010 8.3100 1.1200 7.420 6548.00000000 6548.00000000 mod011 264.7600 248.0700 1.067 -54558535.01422730 -54558535.01422730 modglob 38.7200 30.0400 1.289 20740508.08630820 20740508.08630820 neos4 168.6800 42.0800 4.009 -4.8603440750589E+10 -4.8603440750589E+10 neos5 165.2900 33.9300 4.872 -4.8603440750589E+10 -4.8603440750589E+10 nw04 49.5300 25.0300 1.979 16862.00000000 16862.00000000 p0033 0.2400 0.0600 4.000 3089.00000000 3089.00000000 p0201 15.9700 7.6800 2.079 7615.00000000 7615.00000000 p0282 4.8200 3.1900 1.511 258411.00000000 258411.00000000 p0548 12.7100 0.5800 21.914 8691.00000000 8691.00000000 pk1 447.1800 129.1600 3.462 11.00000000 11.00000000 pp08acuts 763.5900 40.0900 19.047 7350.00000000 7350.00000000 pp08a 35.7800 75.2400 0.476 7350.00000000 7350.00000000 prod1 123.2600 134.6000 0.916 -56.00000000 -56.00000000 qnet1 8.1900 7.1300 1.149 16029.69268100 16029.69268100 qnet1_o 5.9500 6.2200 0.957 16029.69268100 16029.69268100 ran10x10a 10.4600 3.5300 2.963 1499.00000000 1499.00000000 ran10x10b 4.5800 2.3800 1.924 3073.00000000 3073.00000000 ran10x10c 12.0600 11.3300 1.064 13007.00000000 13007.00000000 ran10x12 9.6200 2.5900 3.714 2714.00000000 2714.00000000 ran10x26 537.9800 112.6900 4.774 4270.00000000 4270.00000000 ran12x12 248.1500 47.1800 5.260 2291.00000000 2291.00000000 ran13x13 534.5600 169.8700 3.147 3252.00000000 3252.00000000 ran17x17 251.3200 26.1100 9.625 1373.00000000 1373.00000000 ran4x64 9.3100 1.9500 4.774 9711.00000000 9711.00000000 ran6x43 4.2400 3.7100 1.143 6330.00000000 6330.00000000 rentacar 11.6400 6.0900 1.911 28882470.94755350 28882470.94755350 rlp2 97.6400 3.9600 24.657 19.00000000 19.00000000 stein27 2.1700 2.9500 0.736 18.00000000 18.00000000 stein45 57.4100 64.5800 0.889 30.00000000 30.00000000 swath1 579.6000 743.8200 0.779 379.07129575 379.07129575 vpm1 1.3800 0.2000 6.900 20.00000000 20.00000000 vpm2 9.6500 8.6600 1.114 13.75000000 13.75000000

 Modelname Time (CBC12) Time (CBC20) Ratio (CBC12/CBC20) Obj (CBC12) Obj (CBC20) neos2 30.9400 1800.5500 0.017 454.86469703 468.53452713 neos3 224.6600 1800.7300 0.125 368.84275100 387.48814776

 Modelname Time (CBC12) Time (CBC20) Ratio (CBC12/CBC20) Status (CBC12) Obj (CBC20) 10teams 1800.3200 35.9300 --- mstat(14) sstat( 2) 924.00000000 bienst1 NA 103.6800 --- mstat(13) sstat(13) 46.75000000 bienst2 NA 762.9600 --- mstat(13) sstat(13) 54.60000000 harp2 1800.8100 1788.4700 --- mstat(14) sstat( 2) -73889532.00000000 neos1 1800.6300 970.2200 --- mstat(14) sstat( 2) 19.00000000 neos6 1801.3700 441.4500 --- mstat(14) sstat( 2) 83.00000000 p2756 NA 2.4300 --- mstat(13) sstat(13) 3124.00000000 qiu 1800.1100 293.6300 --- mstat(14) sstat( 2) -132.87313695 ran12x21 1800.0200 247.7600 --- mstat(14) sstat( 2) 3664.00000000 ran16x16 1800.0400 992.1700 --- mstat(14) sstat( 2) 3823.00000000 ran8x32 1800.0100 43.7500 --- mstat(14) sstat( 2) 5247.00000000 rgn NA 3.5000 --- mstat(13) sstat(13) 82.19999924 bell5 1802.7200 82.9300 --- mstat(14) sstat( 2) 8966406.49152000

 Modelname Time (CBC12) Time (CBC20) Ratio (CBC12/CBC20) Status (CBC12) Obj (CBC20) arki001 1800.7300 1801.4900 --- mstat(14) sstat( 2) 7582515.66574672 bc1 NA 1803.2900 --- mstat(13) sstat(13) 3.33836255 bc 1801.5600 1801.8500 --- mstat(14) sstat( 2) 7.00000000 binkar10_1 1801.6600 1801.6600 --- mstat(14) sstat( 2) 6746.64002300 danoint 1800.4100 1800.9200 --- mstat(14) sstat( 2) 66.37500000 fast0507 1811.0100 1806.2800 --- mstat(14) sstat( 2) 179.00000000 mkc1 1800.6000 1800.4400 --- mstat(14) sstat( 2) -607.20700000 mkc 1800.5000 1802.2200 --- mstat(14) sstat( 2) -534.34200000 ran14x18 1801.8300 1802.8000 --- mstat(14) sstat( 2) 3735.00000000 rout 1801.5800 1802.4900 --- mstat(14) sstat( 2) 1077.56000000 set1ch 1801.4900 1802.4400 --- mstat(14) sstat( 2) 54555.00000000 seymour1 1802.2400 1825.8300 --- mstat(14) sstat( 2) 411.08574808 seymour 1802.0600 1802.5000 --- mstat(14) sstat( 2) 435.00000000 swath2 1800.6400 1801.1400 --- mstat(14) sstat( 2) 387.63980365 swath 1800.6400 1802.1400 --- mstat(14) sstat( 2) 517.86689600 markshare1 1803.9500 1804.5300 --- mstat(14) sstat( 2) 11.00000000 markshare2 1803.0400 1803.2400 --- mstat(14) sstat( 2) 14.00000000 mas74 1800.0400 1803.5200 --- mstat(14) sstat( 2) 11801.18572900 noswot 1800.5900 1758.7600 --- mstat(14) sstat( 2) -41.00000000

 Modelname Time (CBC12) Time (CBC20) Ratio (CBC12/CBC20) Status (CBC12) Status (CBC20) acc-tight-2 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13) acc-tight-3 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13) acc-tight-5 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13) acc-tight-6 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13) dano3_3 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13) dano3_4 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13) dano3_5 NA NA --- mstat(13) sstat(13) mstat(13) sstat(13) dano3mip NA NA --- mstat(13) sstat(13) mstat(13) sstat(13)

 Modelname Time (CBC12) Obj (CBC12) acc-tight-0 36.1500 0.00000000 acc-tight-1 397.4500 0.00000000 acc-tight-4 105.8300 0.00000000 air03 5.0600 340160.00000000 air04 124.9700 56137.00000000 air05 348.7400 26374.00000000 bal8x12 1.0100 471.55000000 bell3a 15.2900 878430.31600000 bk4x3 0.0000 350.00000000 blend2 14.1500 7.59898500 cap6000 57.7900 -2451377.00000000 dcmulti 2.5200 188182.00000000 dsbmip 46.7700 -306.76901203 egout 0.0200 568.10070000 enigma 14.6200 0.00000000 fiber 4.4900 405935.18000000 fixnet6 8.7200 3983.00000000 gen 0.4800 112313.36271800 gesa2 89.8500 25779856.37169790 gesa2_o 500.3600 25779856.37169790 gesa3 5.2900 27991042.64838270 gesa3_o 7.0600 27991042.64838270 gr4x6 0.0200 202.35000000 gt2 0.4700 21166.00000000 irp 87.6500 12159.49283600 khb05250 0.2800 106940226.00000000 l152lav 35.7100 4722.00000000 lseu 2.1400 1120.00000000 mas284 63.5000 91405.72368220 mas76 424.9300 40005.05414200 misc03 9.8400 3360.00000000 misc06 0.8300 12850.86073738 misc07 95.1000 2810.00000000 mitre 8.6200 115155.00000000 mod008 1.2200 307.00000000 mod010 8.3100 6548.00000000 mod011 264.7600 -54558535.01422730 modglob 38.7200 20740508.08630820 neos2 30.9400 454.86469703 neos3 224.6600 368.84275100 neos4 168.6800 -4.8603440750589E+10 neos5 165.2900 -4.8603440750589E+10 nw04 49.5300 16862.00000000 p0033 0.2400 3089.00000000 p0201 15.9700 7615.00000000 p0282 4.8200 258411.00000000 p0548 12.7100 8691.00000000 pk1 447.1800 11.00000000 pp08acuts 763.5900 7350.00000000 pp08a 35.7800 7350.00000000 prod1 123.2600 -56.00000000 qnet1 8.1900 16029.69268100 qnet1_o 5.9500 16029.69268100 ran10x10a 10.4600 1499.00000000 ran10x10b 4.5800 3073.00000000 ran10x10c 12.0600 13007.00000000 ran10x12 9.6200 2714.00000000 ran10x26 537.9800 4270.00000000 ran12x12 248.1500 2291.00000000 ran13x13 534.5600 3252.00000000 ran17x17 251.3200 1373.00000000 ran4x64 9.3100 9711.00000000 ran6x43 4.2400 6330.00000000 rentacar 11.6400 28882470.94755350 rlp2 97.6400 19.00000000 stein27 2.1700 18.00000000 stein45 57.4100 30.00000000 swath1 579.6000 379.07129575 vpm1 1.3800 20.00000000 vpm2 9.6500 13.75000000

 Modelname Time (CBC12) Status (CBC12) 10teams -- mstat(14) sstat( 2) acc-tight-2 -- mstat(13) sstat(13) acc-tight-3 -- mstat(13) sstat(13) acc-tight-5 -- mstat(13) sstat(13) acc-tight-6 -- mstat(13) sstat(13) arki001 -- mstat(14) sstat( 2) bc1 -- mstat(13) sstat(13) bc -- mstat(14) sstat( 2) bienst1 -- mstat(13) sstat(13) bienst2 -- mstat(13) sstat(13) binkar10_1 -- mstat(14) sstat( 2) dano3_3 -- mstat(13) sstat(13) dano3_4 -- mstat(13) sstat(13) dano3_5 -- mstat(13) sstat(13) dano3mip -- mstat(13) sstat(13) danoint -- mstat(14) sstat( 2) fast0507 -- mstat(14) sstat( 2) harp2 -- mstat(14) sstat( 2) mkc1 -- mstat(14) sstat( 2) mkc -- mstat(14) sstat( 2) neos1 -- mstat(14) sstat( 2) neos6 -- mstat(14) sstat( 2) p2756 -- mstat(13) sstat(13) qiu -- mstat(14) sstat( 2) ran12x21 -- mstat(14) sstat( 2) ran14x18 -- mstat(14) sstat( 2) ran16x16 -- mstat(14) sstat( 2) ran8x32 -- mstat(14) sstat( 2) rgn -- mstat(13) sstat(13) rout -- mstat(14) sstat( 2) set1ch -- mstat(14) sstat( 2) seymour1 -- mstat(14) sstat( 2) seymour -- mstat(14) sstat( 2) swath2 -- mstat(14) sstat( 2) swath -- mstat(14) sstat( 2) markshare1 -- mstat(14) sstat( 2) markshare2 -- mstat(14) sstat( 2) mas74 -- mstat(14) sstat( 2) bell5 -- mstat(14) sstat( 2) noswot -- mstat(14) sstat( 2)

 Modelname Time (CBC20) Obj (CBC20) 10teams 35.9300 924.00000000 acc-tight-0 3.8400 0.00000000 acc-tight-1 6.0500 0.00000000 acc-tight-4 8.5600 0.00000000 air03 5.1800 340160.00000000 air04 298.6500 56137.00000000 air05 422.5000 26374.00000000 bal8x12 1.7300 471.55000000 bell3a 3.1600 878430.31600000 bienst1 103.6800 46.75000000 bienst2 762.9600 54.60000000 bk4x3 0.0100 350.00000000 blend2 12.4600 7.59898500 cap6000 12.4000 -2451377.00000000 dcmulti 6.7100 188182.00000000 dsbmip 1.0800 -306.76901203 egout 0.0300 568.10070000 enigma 6.1600 0.00000000 fiber 2.0000 405935.18000000 fixnet6 11.5100 3983.00000000 gen 0.1900 112313.36271800 gesa2 11.2300 25779856.37169790 gesa2_o 42.3500 25779856.37169790 gesa3 11.6000 27991042.64838270 gesa3_o 13.1500 27991042.64838270 gr4x6 0.0300 202.35000000 gt2 0.0500 21166.00000000 harp2 1788.4700 -73889532.00000000 irp 244.0700 12159.49283600 khb05250 0.4600 106940226.00000000 l152lav 23.8300 4722.00000000 lseu 1.7700 1120.00000000 mas284 31.0800 91405.72368220 mas76 241.3000 40005.05414200 misc03 3.3400 3360.00000000 misc06 1.3400 12850.86073738 misc07 108.7200 2810.00000000 mitre 10.1600 115155.00000000 mod008 1.7800 307.00000000 mod010 1.1200 6548.00000000 mod011 248.0700 -54558535.01422730 modglob 30.0400 20740508.08630820 neos1 970.2200 19.00000000 neos4 42.0800 -4.8603440750589E+10 neos5 33.9300 -4.8603440750589E+10 neos6 441.4500 83.00000000 nw04 25.0300 16862.00000000 p0033 0.0600 3089.00000000 p0201 7.6800 7615.00000000 p0282 3.1900 258411.00000000 p0548 0.5800 8691.00000000 p2756 2.4300 3124.00000000 pk1 129.1600 11.00000000 pp08acuts 40.0900 7350.00000000 pp08a 75.2400 7350.00000000 prod1 134.6000 -56.00000000 qiu 293.6300 -132.87313695 qnet1 7.1300 16029.69268100 qnet1_o 6.2200 16029.69268100 ran10x10a 3.5300 1499.00000000 ran10x10b 2.3800 3073.00000000 ran10x10c 11.3300 13007.00000000 ran10x12 2.5900 2714.00000000 ran10x26 112.6900 4270.00000000 ran12x12 47.1800 2291.00000000 ran12x21 247.7600 3664.00000000 ran13x13 169.8700 3252.00000000 ran16x16 992.1700 3823.00000000 ran17x17 26.1100 1373.00000000 ran4x64 1.9500 9711.00000000 ran6x43 3.7100 6330.00000000 ran8x32 43.7500 5247.00000000 rentacar 6.0900 28882470.94755350 rgn 3.5000 82.19999924 rlp2 3.9600 19.00000000 stein27 2.9500 18.00000000 stein45 64.5800 30.00000000 swath1 743.8200 379.07129575 vpm1 0.2000 20.00000000 vpm2 8.6600 13.75000000 bell5 82.9300 8966406.49152000

 Modelname Time (CBC20) Obj (CBC20) arki001 1801.4900 7582515.66574672 bc1 1803.2900 3.33836255 bc 1801.8500 7.00000000 binkar10_1 1801.6600 6746.64002300 danoint 1800.9200 66.37500000 fast0507 1806.2800 179.00000000 mkc1 1800.4400 -607.20700000 mkc 1802.2200 -534.34200000 neos2 1800.5500 468.53452713 neos3 1800.7300 387.48814776 ran14x18 1802.8000 3735.00000000 rout 1802.4900 1077.56000000 set1ch 1802.4400 54555.00000000 seymour1 1825.8300 411.08574808 seymour 1802.5000 435.00000000 swath2 1801.1400 387.63980365 swath 1802.1400 517.86689600 markshare1 1804.5300 11.00000000 markshare2 1803.2400 14.00000000 mas74 1803.5200 11801.18572900 noswot 1758.7600 -41.00000000

 Modelname Time (CBC20) Status (CBC20) acc-tight-2 -- mstat(13) sstat(13) acc-tight-3 -- mstat(13) sstat(13) acc-tight-5 -- mstat(13) sstat(13) acc-tight-6 -- mstat(13) sstat(13) dano3_3 -- mstat(13) sstat(13) dano3_4 -- mstat(13) sstat(13) dano3_5 -- mstat(13) sstat(13) dano3mip -- mstat(13) sstat(13)