Solver Square Comparison: Considers all models.

 Date / Time: 08/25/08 16:26:12

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC20 is represented on the left (rows) and solver CBC22 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : 22.7.trc Tracefile 2 : 22.9.trc Solvers used : CBC20 CBC22 Modeltype(s) MIP

 CBC22: optimal CBC22: feasible CBC22: infeasible CBC22: unbounded CBC22: fail CBC22: no data total CBC20 CBC20: optimal 80 1 - - - - 81 CBC20: feasible 7 14 - - - - 21 CBC20: infeasible - - - - - - - CBC20: unbounded - - - - - - - CBC20: fail 7 1 - - - - 8 CBC20: no data - - - - - - - total CBC22 94 16 - - - - 110

Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (CBC20) Time (CBC22) Ratio (CBC20/CBC22) Obj (CBC20) Obj (CBC22) 10teams 35.9300 12.3600 2.907 924.00000000 924.00000000 acc-tight-0 3.8400 29.9400 0.128 0.00000000 0.00000000 acc-tight-1 6.0500 79.2000 0.076 0.00000000 0.00000000 acc-tight-4 8.5600 3.0400 2.816 0.00000000 0.00000000 air03 5.1800 3.1400 1.650 340160.00000000 340160.00000000 air04 298.6500 152.4700 1.959 56137.00000000 56137.00000000 air05 422.5000 64.2500 6.576 26374.00000000 26374.00000000 bal8x12 1.7300 2.5600 0.676 471.55000000 471.55000000 bell3a 3.1600 3.2100 0.984 878430.31600000 878430.31600000 bell5 82.9300 3.1000 26.752 8966406.49152000 8966406.49152000 bienst1 103.6800 255.5900 0.406 46.75000000 46.75000000 bienst2 762.9600 895.5800 0.852 54.60000000 54.60000000 bk4x3 0.0100 0.0200 --- 350.00000000 350.00000000 blend2 12.4600 11.5600 1.078 7.59898500 7.59898500 cap6000 12.4000 63.4000 0.196 -2451377.00000000 -2451377.00000000 dcmulti 6.7100 3.7700 1.780 188182.00000000 188182.00000000 dsbmip 1.0800 5.6600 0.191 -306.76901203 -306.76901203 egout 0.0300 0.0400 --- 568.10070000 568.10070000 enigma 6.1600 1.0800 5.704 0.00000000 0.00000000 fiber 2.0000 5.1100 0.391 405935.18000000 405935.18000000 fixnet6 11.5100 5.1300 2.244 3983.00000000 3983.00000000 gen 0.1900 0.1900 1.000 112313.36271800 112313.36271800 gesa2 11.2300 10.0300 1.120 25779856.37169790 25779856.37169790 gesa2_o 42.3500 49.4700 0.856 25779856.37169790 25779856.37169790 gesa3 11.6000 9.3700 1.238 27991042.64838270 27991042.64838270 gesa3_o 13.1500 18.1200 0.726 27991042.64838270 27991042.64838270 gr4x6 0.0300 0.0200 --- 202.35000000 202.35000000 gt2 0.0500 0.7600 0.066 21166.00000000 21166.00000000 irp 244.0700 40.5900 6.013 12159.49283600 12159.49283600 khb05250 0.4600 0.8200 0.561 106940226.00000000 106940226.00000000 l152lav 23.8300 5.7800 4.123 4722.00000000 4722.00000000 lseu 1.7700 1.6200 1.093 1120.00000000 1120.00000000 mas284 31.0800 50.2800 0.618 91405.72368220 91405.72368220 mas76 241.3000 329.0000 0.733 40005.05414200 40005.05414200 misc03 3.3400 4.0800 0.819 3360.00000000 3360.00000000 misc06 1.3400 0.7900 1.696 12850.86073738 12850.86073738 misc07 108.7200 95.8400 1.134 2810.00000000 2810.00000000 mitre 10.1600 7.1600 1.419 115155.00000000 115155.00000000 mod008 1.7800 1.0900 1.633 307.00000000 307.00000000 mod010 1.1200 0.7300 1.534 6548.00000000 6548.00000000 mod011 248.0700 202.1700 1.227 -54558535.01422730 -54558535.01422730 modglob 30.0400 10.6000 2.834 20740508.08630820 20740508.08630820 neos1 970.2200 71.0400 13.657 19.00000000 19.00000000 neos4 42.0800 15.5600 2.704 -4.8603440750589E+10 -4.8603440750590E+10 neos5 33.9300 5.9200 5.731 -4.8603440750589E+10 -4.8275503702380E+10 neos6 441.4500 821.0000 0.538 83.00000000 83.00000000 nw04 25.0300 34.6500 0.722 16862.00000000 16862.00000000 p0033 0.0600 0.0400 1.500 3089.00000000 3089.00000000 p0201 7.6800 19.6500 0.391 7615.00000000 7615.00000000 p0282 3.1900 7.2800 0.438 258411.00000000 258411.00000000 p0548 0.5800 3.1000 0.187 8691.00000000 8691.00000000 p2756 2.4300 9.9900 0.243 3124.00000000 3124.00000000 pk1 129.1600 268.7200 0.481 11.00000000 11.00000000 pp08acuts 40.0900 24.7200 1.622 7350.00000000 7350.00000000 pp08a 75.2400 19.5600 3.847 7350.00000000 7350.00000000 prod1 134.6000 352.6300 0.382 -56.00000000 -56.00000000 qiu 293.6300 680.7600 0.431 -132.87313695 -132.87313695 qnet1 7.1300 5.3400 1.335 16029.69268100 16029.69268100 qnet1_o 6.2200 5.7800 1.076 16029.69268100 16029.69268100 ran10x10a 3.5300 4.4800 0.788 1499.00000000 1499.00000000 ran10x10b 2.3800 2.6500 0.898 3073.00000000 3073.00000000 ran10x10c 11.3300 8.6700 1.307 13007.00000000 13007.00000000 ran10x12 2.5900 2.8700 0.902 2714.00000000 2714.00000000 ran10x26 112.6900 44.3500 2.541 4270.00000000 4270.00000000 ran12x12 47.1800 53.6000 0.880 2291.00000000 2291.00000000 ran12x21 247.7600 239.4700 1.035 3664.00000000 3664.00000000 ran13x13 169.8700 87.5100 1.941 3252.00000000 3252.00000000 ran16x16 992.1700 1260.4700 0.787 3823.00000000 3823.00000000 ran17x17 26.1100 20.6500 1.264 1373.00000000 1373.00000000 ran4x64 1.9500 3.2900 0.593 9711.00000000 9711.00000000 ran6x43 3.7100 3.2600 1.138 6330.00000000 6330.00000000 ran8x32 43.7500 26.0800 1.678 5247.00000000 5247.00000000 rentacar 6.0900 5.8300 1.045 28882470.94755350 28882470.94755340 rgn 3.5000 4.1600 0.841 82.19999924 82.19999924 rlp2 3.9600 5.5900 0.708 19.00000000 19.00000000 stein27 2.9500 2.3800 1.239 18.00000000 18.00000000 stein45 64.5800 65.1400 0.991 30.00000000 30.00000000 swath1 743.8200 158.5600 4.691 379.07129575 379.07129575 vpm1 0.2000 0.1300 1.538 20.00000000 20.00000000 vpm2 8.6600 6.8500 1.264 13.75000000 13.75000000

 Modelname Time (CBC20) Time (CBC22) Ratio (CBC20/CBC22) Obj (CBC20) Obj (CBC22) harp2 1788.4700 1801.7200 0.993 -73889532.00000000 -73899798.00000000

 Modelname Time (CBC20) Time (CBC22) Ratio (CBC20/CBC22) Obj (CBC20) Obj (CBC22) binkar10_1 1801.6600 919.4400 1.960 6746.64002300 6742.20002400 neos2 1800.5500 9.6700 186.200 468.53452713 454.86469703 neos3 1800.7300 26.4200 68.158 387.48814776 368.84275100 rout 1802.4900 1008.8000 1.787 1077.56000000 1077.56000000 set1ch 1802.4400 1028.0800 1.753 54555.00000000 54537.75000000 swath2 1801.1400 549.0100 3.281 387.63980365 385.19969295 bc1 1803.2900 1669.4800 1.080 3.33836255 3.33836255

 Modelname Time (CBC20) Time (CBC22) Ratio (CBC20/CBC22) Obj (CBC20) Obj (CBC22) arki001 1801.4900 1801.3600 1.000 7582515.66574672 7581085.55691561 danoint 1800.9200 1801.2600 1.000 66.37500000 65.66666667 fast0507 1806.2800 1804.0600 1.001 179.00000000 176.00000000 mkc1 1800.4400 1798.2600 1.001 -607.20700000 -607.20700000 mkc 1802.2200 1800.9700 1.001 -534.34200000 -550.19200000 noswot 1758.7600 1805.7100 0.974 -41.00000000 -41.00000000 ran14x18 1802.8000 1804.1600 0.999 3735.00000000 3736.00000000 seymour1 1825.8300 1822.1200 1.002 411.08574808 410.76370139 seymour 1802.5000 1802.6600 1.000 435.00000000 428.00000000 swath 1802.1400 1801.7000 1.000 517.86689600 507.68450300 markshare1 1804.5300 1802.8500 1.001 11.00000000 7.00000000 markshare2 1803.2400 1802.5000 1.000 14.00000000 17.00000000 mas74 1803.5200 1802.8600 1.000 11801.18572900 11801.18572900 bc 1801.8500 1804.1300 0.999 7.00000000 7.00000000

 Modelname Time (CBC20) Time (CBC22) Ratio (CBC20/CBC22) Status (CBC20) Obj (CBC22) acc-tight-2 NA 393.1600 --- mstat(13) sstat(13) 0.00000000 acc-tight-3 NA 498.6900 --- mstat(13) sstat(13) 0.00000000 acc-tight-5 NA 248.3400 --- mstat(13) sstat(13) 0.00000000 acc-tight-6 NA 1139.0300 --- mstat(13) sstat(13) 0.00000000 dano3_3 NA 244.6300 --- mstat(13) sstat(13) 576.34463303 dano3_4 NA 181.8400 --- mstat(13) sstat(13) 576.43522471 dano3_5 NA 647.0300 --- mstat(13) sstat(13) 576.92491596

 Modelname Time (CBC20) Time (CBC22) Ratio (CBC20/CBC22) Status (CBC20) Obj (CBC22) dano3mip NA 1839.1900 --- mstat(13) sstat(13) 771.54545455

 Modelname Time (CBC20) Obj (CBC20) 10teams 35.9300 924.00000000 acc-tight-0 3.8400 0.00000000 acc-tight-1 6.0500 0.00000000 acc-tight-4 8.5600 0.00000000 air03 5.1800 340160.00000000 air04 298.6500 56137.00000000 air05 422.5000 26374.00000000 bal8x12 1.7300 471.55000000 bell3a 3.1600 878430.31600000 bell5 82.9300 8966406.49152000 bienst1 103.6800 46.75000000 bienst2 762.9600 54.60000000 bk4x3 0.0100 350.00000000 blend2 12.4600 7.59898500 cap6000 12.4000 -2451377.00000000 dcmulti 6.7100 188182.00000000 dsbmip 1.0800 -306.76901203 egout 0.0300 568.10070000 enigma 6.1600 0.00000000 fiber 2.0000 405935.18000000 fixnet6 11.5100 3983.00000000 gen 0.1900 112313.36271800 gesa2 11.2300 25779856.37169790 gesa2_o 42.3500 25779856.37169790 gesa3 11.6000 27991042.64838270 gesa3_o 13.1500 27991042.64838270 gr4x6 0.0300 202.35000000 gt2 0.0500 21166.00000000 irp 244.0700 12159.49283600 khb05250 0.4600 106940226.00000000 l152lav 23.8300 4722.00000000 lseu 1.7700 1120.00000000 mas284 31.0800 91405.72368220 mas76 241.3000 40005.05414200 misc03 3.3400 3360.00000000 misc06 1.3400 12850.86073738 misc07 108.7200 2810.00000000 mitre 10.1600 115155.00000000 mod008 1.7800 307.00000000 mod010 1.1200 6548.00000000 mod011 248.0700 -54558535.01422730 modglob 30.0400 20740508.08630820 neos1 970.2200 19.00000000 neos4 42.0800 -4.8603440750589E+10 neos5 33.9300 -4.8603440750589E+10 neos6 441.4500 83.00000000 nw04 25.0300 16862.00000000 p0033 0.0600 3089.00000000 p0201 7.6800 7615.00000000 p0282 3.1900 258411.00000000 p0548 0.5800 8691.00000000 p2756 2.4300 3124.00000000 pk1 129.1600 11.00000000 pp08acuts 40.0900 7350.00000000 pp08a 75.2400 7350.00000000 prod1 134.6000 -56.00000000 qiu 293.6300 -132.87313695 qnet1 7.1300 16029.69268100 qnet1_o 6.2200 16029.69268100 ran10x10a 3.5300 1499.00000000 ran10x10b 2.3800 3073.00000000 ran10x10c 11.3300 13007.00000000 ran10x12 2.5900 2714.00000000 ran10x26 112.6900 4270.00000000 ran12x12 47.1800 2291.00000000 ran12x21 247.7600 3664.00000000 ran13x13 169.8700 3252.00000000 ran16x16 992.1700 3823.00000000 ran17x17 26.1100 1373.00000000 ran4x64 1.9500 9711.00000000 ran6x43 3.7100 6330.00000000 ran8x32 43.7500 5247.00000000 rentacar 6.0900 28882470.94755350 rgn 3.5000 82.19999924 rlp2 3.9600 19.00000000 stein27 2.9500 18.00000000 stein45 64.5800 30.00000000 swath1 743.8200 379.07129575 vpm1 0.2000 20.00000000 vpm2 8.6600 13.75000000 harp2 1788.4700 -73889532.00000000

 Modelname Time (CBC20) Obj (CBC20) arki001 1801.4900 7582515.66574672 binkar10_1 1801.6600 6746.64002300 danoint 1800.9200 66.37500000 fast0507 1806.2800 179.00000000 mkc1 1800.4400 -607.20700000 mkc 1802.2200 -534.34200000 neos2 1800.5500 468.53452713 neos3 1800.7300 387.48814776 noswot 1758.7600 -41.00000000 ran14x18 1802.8000 3735.00000000 rout 1802.4900 1077.56000000 set1ch 1802.4400 54555.00000000 seymour1 1825.8300 411.08574808 seymour 1802.5000 435.00000000 swath2 1801.1400 387.63980365 swath 1802.1400 517.86689600 markshare1 1804.5300 11.00000000 markshare2 1803.2400 14.00000000 mas74 1803.5200 11801.18572900 bc 1801.8500 7.00000000 bc1 1803.2900 3.33836255

 Modelname Time (CBC20) Status (CBC20) acc-tight-2 -- mstat(13) sstat(13) acc-tight-3 -- mstat(13) sstat(13) acc-tight-5 -- mstat(13) sstat(13) acc-tight-6 -- mstat(13) sstat(13) dano3_3 -- mstat(13) sstat(13) dano3_4 -- mstat(13) sstat(13) dano3_5 -- mstat(13) sstat(13) dano3mip -- mstat(13) sstat(13)

 Modelname Time (CBC22) Obj (CBC22) 10teams 12.3600 924.00000000 acc-tight-0 29.9400 0.00000000 acc-tight-1 79.2000 0.00000000 acc-tight-2 393.1600 0.00000000 acc-tight-3 498.6900 0.00000000 acc-tight-4 3.0400 0.00000000 acc-tight-5 248.3400 0.00000000 acc-tight-6 1139.0300 0.00000000 air03 3.1400 340160.00000000 air04 152.4700 56137.00000000 air05 64.2500 26374.00000000 bal8x12 2.5600 471.55000000 bell3a 3.2100 878430.31600000 bell5 3.1000 8966406.49152000 bienst1 255.5900 46.75000000 bienst2 895.5800 54.60000000 binkar10_1 919.4400 6742.20002400 bk4x3 0.0200 350.00000000 blend2 11.5600 7.59898500 cap6000 63.4000 -2451377.00000000 dano3_3 244.6300 576.34463303 dano3_4 181.8400 576.43522471 dano3_5 647.0300 576.92491596 dcmulti 3.7700 188182.00000000 dsbmip 5.6600 -306.76901203 egout 0.0400 568.10070000 enigma 1.0800 0.00000000 fiber 5.1100 405935.18000000 fixnet6 5.1300 3983.00000000 gen 0.1900 112313.36271800 gesa2 10.0300 25779856.37169790 gesa2_o 49.4700 25779856.37169790 gesa3 9.3700 27991042.64838270 gesa3_o 18.1200 27991042.64838270 gr4x6 0.0200 202.35000000 gt2 0.7600 21166.00000000 irp 40.5900 12159.49283600 khb05250 0.8200 106940226.00000000 l152lav 5.7800 4722.00000000 lseu 1.6200 1120.00000000 mas284 50.2800 91405.72368220 mas76 329.0000 40005.05414200 misc03 4.0800 3360.00000000 misc06 0.7900 12850.86073738 misc07 95.8400 2810.00000000 mitre 7.1600 115155.00000000 mod008 1.0900 307.00000000 mod010 0.7300 6548.00000000 mod011 202.1700 -54558535.01422730 modglob 10.6000 20740508.08630820 neos1 71.0400 19.00000000 neos2 9.6700 454.86469703 neos3 26.4200 368.84275100 neos4 15.5600 -4.8603440750590E+10 neos5 5.9200 -4.8275503702380E+10 neos6 821.0000 83.00000000 nw04 34.6500 16862.00000000 p0033 0.0400 3089.00000000 p0201 19.6500 7615.00000000 p0282 7.2800 258411.00000000 p0548 3.1000 8691.00000000 p2756 9.9900 3124.00000000 pk1 268.7200 11.00000000 pp08acuts 24.7200 7350.00000000 pp08a 19.5600 7350.00000000 prod1 352.6300 -56.00000000 qiu 680.7600 -132.87313695 qnet1 5.3400 16029.69268100 qnet1_o 5.7800 16029.69268100 ran10x10a 4.4800 1499.00000000 ran10x10b 2.6500 3073.00000000 ran10x10c 8.6700 13007.00000000 ran10x12 2.8700 2714.00000000 ran10x26 44.3500 4270.00000000 ran12x12 53.6000 2291.00000000 ran12x21 239.4700 3664.00000000 ran13x13 87.5100 3252.00000000 ran16x16 1260.4700 3823.00000000 ran17x17 20.6500 1373.00000000 ran4x64 3.2900 9711.00000000 ran6x43 3.2600 6330.00000000 ran8x32 26.0800 5247.00000000 rentacar 5.8300 28882470.94755340 rgn 4.1600 82.19999924 rlp2 5.5900 19.00000000 rout 1008.8000 1077.56000000 set1ch 1028.0800 54537.75000000 stein27 2.3800 18.00000000 stein45 65.1400 30.00000000 swath1 158.5600 379.07129575 swath2 549.0100 385.19969295 vpm1 0.1300 20.00000000 vpm2 6.8500 13.75000000 bc1 1669.4800 3.33836255

 Modelname Time (CBC22) Obj (CBC22) arki001 1801.3600 7581085.55691561 dano3mip 1839.1900 771.54545455 danoint 1801.2600 65.66666667 fast0507 1804.0600 176.00000000 mkc1 1798.2600 -607.20700000 mkc 1800.9700 -550.19200000 noswot 1805.7100 -41.00000000 ran14x18 1804.1600 3736.00000000 seymour1 1822.1200 410.76370139 seymour 1802.6600 428.00000000 swath 1801.7000 507.68450300 markshare1 1802.8500 7.00000000 markshare2 1802.5000 17.00000000 mas74 1802.8600 11801.18572900 bc 1804.1300 7.00000000 harp2 1801.7200 -73899798.00000000