## Solver Square Comparison: Considers all models.

 Date / Time: 09/29/08 16:04:43

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver BONMIN is represented on the left (rows) and solver SBB on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : BONMIN-1.trc.canall Tracefile 2 : SBB-1.trc.canall Solvers used : BONMIN SBB Modeltype(s) MINLP

 SBB: optimal SBB: feasible SBB: infeasible SBB: unbounded SBB: fail SBB: no data total BONMIN BONMIN: optimal - - - - - - - BONMIN: feasible - 103 6 - - - 109 BONMIN: infeasible - 8 2 - - - 10 BONMIN: unbounded - - - - - - - BONMIN: fail - 5 - - 7 - 12 BONMIN: no data - - - - - - - total SBB - 116 8 - 7 - 131

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (BONMIN) Time (SBB) Ratio (BONMIN/SBB) Obj (BONMIN) Obj (SBB) alan 0.2800 0.2080 1.346 2.92500000 2.92500000 batch 7.2400 0.4870 14.867 300301.81804043 285506.50815158 batchdes 0.5500 0.2320 2.371 167427.65711470 167427.65711470 cecil_13 1027.2700 5.4140 189.743 -115641.59251453 -115544.83985511 contvar 81.7400 10.2790 7.952 809755.52817632 809149.82722947 csched1a 0.6600 0.2930 2.253 -30430.17681721 -30279.74711113 csched2a 38.0900 4.3700 8.716 -164729.22211337 -163862.78203283 du-opt5 5.2900 21.3160 0.248 8.07365758 8.07365758 du-opt 7.0600 1.7230 4.098 3.57591364 3.55699635 eg_all_s 24.4300 13.1550 1.857 7.92018223 7.92018223 eg_disc_s 9.2600 11.1490 0.831 5.76053962 5.76053962 eg_disc2_s 10.7200 5.2860 2.028 5.64210058 5.93637221 eg_int_s 10.5500 19.3250 0.546 7.88724302 6.45310316 eniplac 3600.5800 18.6120 193.455 -132117.08301999 -130344.36990401 enpro48pb 42.4100 4.6670 9.087 187277.25942202 187277.25942201 enpro56pb 179.5400 33.0950 5.425 263428.30097263 263428.30097265 ex1222 0.0800 0.2370 0.338 1.07654308 1.07654308 ex1223 0.3400 0.2150 1.581 4.57958240 4.57958240 ex1223a 0.1300 0.1630 0.798 4.57958240 4.57958240 ex1223b 0.2600 0.2150 1.209 4.57958240 4.57958240 ex1224 0.3000 0.2290 1.310 -0.94347050 -0.94347050 ex1225 0.3600 0.2000 1.800 31.00000000 31.00000000 ex1233 9.9200 1.3710 7.236 155010.67127822 155010.67128049 ex1243 6.4400 0.3600 17.889 83402.50641028 83402.50641026 ex1244 33.9400 0.4780 71.004 82042.90521976 82042.90521975 ex1252 6.0800 2.4880 2.444 128893.74101353 128893.74101350 ex1252a 884.4200 1.3950 633.993 128893.74101284 128893.74101350 ex1263 191.4100 21.5240 8.893 19.60000000 19.60000000 ex1263a 555.0300 6.6890 82.977 20.00000000 20.00000000 ex1264 861.8500 7.8670 109.553 8.60000000 8.60000000 ex1264a 27.8100 12.7950 2.174 8.60000000 8.60000000 ex1265 235.9000 5.9840 39.422 10.60000000 10.30000000 ex1265a 23.7800 0.3330 71.411 10.30000000 15.10000000 ex1266 892.0100 11.4230 78.089 16.30000000 16.30000000 ex1266a 26.3200 1.1210 23.479 16.30000000 16.30000000 ex3pb 0.9100 0.5400 1.685 68.00974405 68.00974405 ex4 9.8500 3.4150 2.884 -8.06413616 -8.06413616 fac1 0.7000 0.2300 3.043 160912612.35017600 160912612.35016900 fac2 3.9500 0.6750 5.852 331837498.17676300 331837498.17676900 fac3 4.3200 0.5570 7.756 31982309.84799740 31982309.84800000 fuel 0.2800 0.1880 1.489 8566.11896169 8566.11896169 fo7 3600.4300 6719.6300 0.536 22.87929378 30.03641833 gastrans 4.5500 1.2390 3.672 89.08584000 89.08584000 gear 1.7000 3.3260 0.511 0.00000241 0.00000000 gear2 2.9200 75.2620 0.039 0.00000933 0.00000000 gear3 1.8200 3.3710 0.540 0.00000238 0.00000000 gear4 612.8300 190.3330 3.220 1.64342847 1.64342847 hda 3637.3400 3.9890 911.843 -5964.53408408 -5762.65148616 gkocis 0.4100 0.2480 1.653 -1.92309874 -1.92309874 lop97icx 3601.1300 6131.7190 0.587 4153.10008640 4126.26060320 m3 3.2500 1.1120 2.923 37.80000000 37.80000000 m6 3600.4400 2884.9770 1.248 114.34842656 82.25687691 m7 3600.3400 5959.9000 0.604 106.75687691 123.96437781 meanvarx 0.6900 0.2120 3.255 14.36923211 14.49698300 hmittelman 27.0400 1.0540 25.655 13.00000000 13.00000000 nous1 2.0800 0.2080 10.000 1.56707200 1.56707200 nous2 1.9200 0.1610 11.925 0.62596741 0.62596741 nuclearva 78.3800 0.3910 200.460 -1.00837622 -1.00948507 nvs01 0.3400 0.3110 1.093 12.46966882 12.46966882 nvs02 1.6100 0.3430 4.694 5.96418452 5.96418452 nvs03 0.1900 0.2040 0.931 16.00000000 16.00000000 nvs04 0.2600 0.1740 1.494 0.72000000 0.72000000 nvs05 1.7600 0.1900 9.263 5.47093411 5.47093411 nvs06 0.1000 0.1750 0.571 1.77031250 1.77031250 nvs07 0.1600 0.1980 0.808 4.00000000 4.00000000 nvs08 0.1400 0.1800 0.778 23.44972735 23.44972735 nvs10 0.1100 0.1480 0.743 -310.80000000 -310.80000000 o7 3600.5700 6631.9400 0.543 144.48441229 181.46472807 oaer 0.2200 0.1750 1.257 -1.92309850 -1.92309854 oil2 63.4500 0.5040 125.893 -0.73326001 -0.73326001 ortez 17.0800 0.4840 35.289 -9532.03905335 -9532.03905335 parallel 3.1500 0.6770 4.653 924.29555074 924.29555066 prob02 0.0800 0.7280 0.110 112235.00000000 112235.00000000 prob03 0.0900 0.1750 0.514 10.00000000 10.00000000 procsel 0.4100 0.3480 1.178 -1.92309874 -1.92309874 ravempb 12.2800 1.4190 8.654 269590.21931547 269590.21931531 risk2bpb 14.0800 0.5240 26.870 -55.87613939 -55.73616850 sep1 0.3000 0.2340 1.282 -510.08098435 -510.08098435 space25 3601.9700 113.6170 31.703 723.38730541 484.32864420 space25a 256.1400 10.4610 24.485 484.32864420 484.32864420 spectra2 10.0000 1.6700 5.988 13.97830588 13.97830588 spring 2.5100 0.3870 6.486 0.84624567 0.84624567 st_e14 0.3300 0.2140 1.542 4.57958240 4.57958240 st_e29 0.2900 0.2280 1.272 -0.94347050 -0.94347050 st_e32 1.1800 0.4070 2.899 -1.43040728 -1.43040728 st_miqp1 0.2400 0.2000 1.200 281.00000000 281.00000000 st_miqp4 0.2700 0.1340 2.015 -4574.00000000 -4574.00000000 st_test5 0.9600 0.3790 2.533 -110.00000000 -110.00000000 st_test6 0.9600 0.4920 1.951 471.00000000 471.00000000 st_test8 0.3100 0.1410 2.199 -29605.00000000 -29605.00000000 st_testgr1 0.5000 0.3260 1.534 -12.78595000 -12.72810000 st_testgr3 2.4600 0.3160 7.785 -20.50550000 -20.46880000 st_testph4 0.1600 0.3650 0.438 -80.50000000 -80.50000000 stockcycle 143.0300 591.1400 0.242 119948.68833303 119948.68833333 synheat 8.8100 3.0810 2.859 154997.33486604 154997.33486599 synthes1 0.3500 0.1670 2.096 6.00975891 6.00975891 synthes2 0.7500 0.2650 2.830 73.03531253 73.03531253 synthes3 0.9200 0.4320 2.130 68.00974052 68.00974052 tln6 3600.4200 8582.6700 0.419 15.60000000 15.70000000 tloss 14.2200 1.0170 13.982 16.30000000 16.30000000 util 18.3300 0.2870 63.868 1009.28668460 999.89730763 water4 3600.4500 76.9750 46.774 914.42457737 913.15706796 waterx 108.6000 46.9720 2.312 909.02786265 938.86284906

 Modelname Time (BONMIN) Time (SBB) Ratio (BONMIN/SBB) Obj (BONMIN) Status (SBB) st_e13 0.0400 0.3660 --- 2.00000000 mstat( 5) sstat( 1) st_e15 0.0100 0.1190 --- 7.66718007 mstat( 5) sstat( 1) st_e31 40.3100 0.1350 --- -2.00000000 mstat( 5) sstat( 1) st_e36 0.4500 0.2690 --- -246.00000000 mstat(10) sstat( 1) super3t 3614.4500 0.6160 --- -0.67510414 mstat( 5) sstat( 1) tltr 16.9300 0.2380 --- 48.06666667 mstat(10) sstat( 1)

 Modelname Time (BONMIN) Time (SBB) Ratio (BONMIN/SBB) Status (BONMIN) Obj (SBB) 4stufen NA 2.9490 --- mstat(19) sstat( 1) 116372.13880337 beuster NA 71.9220 --- mstat(19) sstat( 1) 117074.96620329 elf NA 0.9030 --- mstat(19) sstat( 1) 0.43466667 gasnet NA 0.2340 --- mstat(19) sstat( 1) 7045326.89261437 minlphix NA 0.4470 --- mstat(19) sstat( 1) 316.69269544 pump NA 0.1920 --- mstat(19) sstat( 1) 134263.58532517 qapw NA 1.8410 --- mstat(19) sstat( 1) 388870.00000000 st_miqp2 NA 0.2720 --- mstat(19) sstat( 1) 2.00000000

 Modelname Time (BONMIN) Time (SBB) Ratio (BONMIN/SBB) Status (BONMIN) Status (SBB) feedtray2 NA 0.1840 --- mstat(19) sstat( 1) mstat( 5) sstat( 1) st_e40 NA 0.1170 --- mstat(19) sstat( 1) mstat( 5) sstat( 1)

 Modelname Time (BONMIN) Time (SBB) Ratio (BONMIN/SBB) Status (BONMIN) Obj (SBB) johnall NA 1.9880 --- mstat(13) sstat(13) -224.73016162 mbtd NA 3621.3750 --- mstat(14) sstat( 3) 5.66666000 pb351535 NA 1584.6850 --- mstat(14) sstat( 3) 4485288.00000000 qap NA 5.7090 --- mstat(14) sstat( 3) 395738.00000000 tln7 NA 8762.7440 --- mstat(14) sstat( 3) 23.50000000

 Modelname Time (BONMIN) Time (SBB) Ratio (BONMIN/SBB) Status (BONMIN) Status (SBB) pb302035 NA 3932.2400 --- mstat(13) sstat(13) mstat(14) sstat( 3) pb302095 NA 3886.8390 --- mstat(14) sstat( 3) mstat(14) sstat( 3) pb351595 NA 3862.9990 --- mstat(14) sstat( 3) mstat(14) sstat( 3) tln12 NA 8804.7890 --- mstat(14) sstat( 3) mstat(14) sstat( 8) tls12 NA 11222.8460 --- mstat(14) sstat( 3) mstat(14) sstat( 8) tls6 NA 10020.9100 --- mstat(14) sstat( 3) mstat(14) sstat( 8) tls7 NA 5234.9090 --- mstat(14) sstat( 3) mstat(13) sstat(13)

 Modelname Time (BONMIN) Obj (BONMIN) alan 0.2800 2.92500000 batch 7.2400 300301.81804043 batchdes 0.5500 167427.65711470 cecil_13 1027.2700 -115641.59251453 contvar 81.7400 809755.52817632 csched1a 0.6600 -30430.17681721 csched2a 38.0900 -164729.22211337 du-opt5 5.2900 8.07365758 du-opt 7.0600 3.57591364 eg_all_s 24.4300 7.92018223 eg_disc_s 9.2600 5.76053962 eg_disc2_s 10.7200 5.64210058 eg_int_s 10.5500 7.88724302 eniplac 3600.5800 -132117.08301999 enpro48pb 42.4100 187277.25942202 enpro56pb 179.5400 263428.30097263 ex1221 0.0200 7.66718007 ex1222 0.0800 1.07654308 ex1223 0.3400 4.57958240 ex1223a 0.1300 4.57958240 ex1223b 0.2600 4.57958240 ex1224 0.3000 -0.94347050 ex1225 0.3600 31.00000000 ex1226 0.0400 -17.00000000 ex1233 9.9200 155010.67127822 ex1243 6.4400 83402.50641028 ex1244 33.9400 82042.90521976 ex1252 6.0800 128893.74101353 ex1252a 884.4200 128893.74101284 ex1263 191.4100 19.60000000 ex1263a 555.0300 20.00000000 ex1264 861.8500 8.60000000 ex1264a 27.8100 8.60000000 ex1265 235.9000 10.60000000 ex1265a 23.7800 10.30000000 ex1266 892.0100 16.30000000 ex1266a 26.3200 16.30000000 ex3pb 0.9100 68.00974405 ex4 9.8500 -8.06413616 fac1 0.7000 160912612.35017600 fac2 3.9500 331837498.17676300 fac3 4.3200 31982309.84799740 feedtray 0.3600 -13.40599772 fuel 0.2800 8566.11896169 fo7 3600.4300 22.87929378 gastrans 4.5500 89.08584000 gbd 0.1500 2.20000000 gear 1.7000 0.00000241 gear2 2.9200 0.00000933 gear3 1.8200 0.00000238 gear4 612.8300 1.64342847 hda 3637.3400 -5964.53408408 gkocis 0.4100 -1.92309874 lop97icx 3601.1300 4153.10008640 m3 3.2500 37.80000000 m6 3600.4400 114.34842656 m7 3600.3400 106.75687691 meanvarx 0.6900 14.36923211 hmittelman 27.0400 13.00000000 nous1 2.0800 1.56707200 nous2 1.9200 0.62596741 nuclearva 78.3800 -1.00837622 nvs01 0.3400 12.46966882 nvs02 1.6100 5.96418452 nvs03 0.1900 16.00000000 nvs04 0.2600 0.72000000 nvs05 1.7600 5.47093411 nvs06 0.1000 1.77031250 nvs07 0.1600 4.00000000 nvs08 0.1400 23.44972735 nvs09 0.0200 -43.13433692 nvs10 0.1100 -310.80000000 o7 3600.5700 144.48441229 oaer 0.2200 -1.92309850 oil2 63.4500 -0.73326001 ortez 17.0800 -9532.03905335 parallel 3.1500 924.29555074 prob02 0.0800 112235.00000000 prob03 0.0900 10.00000000 procsel 0.4100 -1.92309874 ravempb 12.2800 269590.21931547 risk2bpb 14.0800 -55.87613939 sep1 0.3000 -510.08098435 space25 3601.9700 723.38730541 space25a 256.1400 484.32864420 spectra2 10.0000 13.97830588 spring 2.5100 0.84624567 st_e13 0.0400 2.00000000 st_e14 0.3300 4.57958240 st_e15 0.0100 7.66718007 st_e27 0.0300 2.00000000 st_e29 0.2900 -0.94347050 st_e31 40.3100 -2.00000000 st_e32 1.1800 -1.43040728 st_e35 6.1700 68413.18848784 st_e36 0.4500 -246.00000000 st_e38 0.0600 7197.72714852 st_miqp1 0.2400 281.00000000 st_miqp3 0.0400 -6.00000000 st_miqp4 0.2700 -4574.00000000 st_miqp5 0.0900 -333.88888889 st_test5 0.9600 -110.00000000 st_test6 0.9600 471.00000000 st_test8 0.3100 -29605.00000000 st_testgr1 0.5000 -12.78595000 st_testgr3 2.4600 -20.50550000 st_testph4 0.1600 -80.50000000 stockcycle 143.0300 119948.68833303 super3t 3614.4500 -0.67510414 synheat 8.8100 154997.33486604 synthes1 0.3500 6.00975891 synthes2 0.7500 73.03531253 synthes3 0.9200 68.00974052 tln6 3600.4200 15.60000000 tloss 14.2200 16.30000000 tltr 16.9300 48.06666667 util 18.3300 1009.28668460 water4 3600.4500 914.42457737 waterx 108.6000 909.02786265

 Modelname Time (BONMIN) Status (BONMIN) 4stufen -- mstat(19) sstat( 1) beuster -- mstat(19) sstat( 1) elf -- mstat(19) sstat( 1) feedtray2 -- mstat(19) sstat( 1) gasnet -- mstat(19) sstat( 1) minlphix -- mstat(19) sstat( 1) pump -- mstat(19) sstat( 1) qapw -- mstat(19) sstat( 1) st_e40 -- mstat(19) sstat( 1) st_miqp2 -- mstat(19) sstat( 1)

 Modelname Time (BONMIN) Status (BONMIN) johnall -- mstat(13) sstat(13) mbtd -- mstat(14) sstat( 3) nuclear14a -- mstat(14) sstat( 3) nuclear24a -- mstat(14) sstat( 3) pb302035 -- mstat(13) sstat(13) pb302095 -- mstat(14) sstat( 3) pb351535 -- mstat(14) sstat( 3) pb351595 -- mstat(14) sstat( 3) qap -- mstat(14) sstat( 3) tln12 -- mstat(14) sstat( 3) tln7 -- mstat(14) sstat( 3) tls12 -- mstat(14) sstat( 3) tls6 -- mstat(14) sstat( 3) tls7 -- mstat(14) sstat( 3)

 Modelname Time (SBB) Obj (SBB) 4stufen 2.9490 116372.13880337 alan 0.2080 2.92500000 batch 0.4870 285506.50815158 batchdes 0.2320 167427.65711470 beuster 71.9220 117074.96620329 cecil_13 5.4140 -115544.83985511 contvar 10.2790 809149.82722947 csched1a 0.2930 -30279.74711113 csched2a 4.3700 -163862.78203283 du-opt5 21.3160 8.07365758 du-opt 1.7230 3.55699635 eg_all_s 13.1550 7.92018223 eg_disc_s 11.1490 5.76053962 eg_disc2_s 5.2860 5.93637221 eg_int_s 19.3250 6.45310316 elf 0.9030 0.43466667 eniplac 18.6120 -130344.36990401 enpro48pb 4.6670 187277.25942201 enpro56pb 33.0950 263428.30097265 ex1222 0.2370 1.07654308 ex1223 0.2150 4.57958240 ex1223a 0.1630 4.57958240 ex1223b 0.2150 4.57958240 ex1224 0.2290 -0.94347050 ex1225 0.2000 31.00000000 ex1233 1.3710 155010.67128049 ex1243 0.3600 83402.50641026 ex1244 0.4780 82042.90521975 ex1252 2.4880 128893.74101350 ex1252a 1.3950 128893.74101350 ex1263 21.5240 19.60000000 ex1263a 6.6890 20.00000000 ex1264 7.8670 8.60000000 ex1264a 12.7950 8.60000000 ex1265 5.9840 10.30000000 ex1265a 0.3330 15.10000000 ex1266 11.4230 16.30000000 ex1266a 1.1210 16.30000000 ex3pb 0.5400 68.00974405 ex4 3.4150 -8.06413616 fac1 0.2300 160912612.35016900 fac2 0.6750 331837498.17676900 fac3 0.5570 31982309.84800000 fuel 0.1880 8566.11896169 fo7 6719.6300 30.03641833 gasnet 0.2340 7045326.89261437 gastrans 1.2390 89.08584000 gear 3.3260 0.00000000 gear2 75.2620 0.00000000 gear3 3.3710 0.00000000 gear4 190.3330 1.64342847 hda 3.9890 -5762.65148616 johnall 1.9880 -224.73016162 gkocis 0.2480 -1.92309874 lop97icx 6131.7190 4126.26060320 m3 1.1120 37.80000000 m6 2884.9770 82.25687691 m7 5959.9000 123.96437781 mbtd 3621.3750 5.66666000 meanvarx 0.2120 14.49698300 minlphix 0.4470 316.69269544 hmittelman 1.0540 13.00000000 nous1 0.2080 1.56707200 nous2 0.1610 0.62596741 nuclearva 0.3910 -1.00948507 nvs01 0.3110 12.46966882 nvs02 0.3430 5.96418452 nvs03 0.2040 16.00000000 nvs04 0.1740 0.72000000 nvs05 0.1900 5.47093411 nvs06 0.1750 1.77031250 nvs07 0.1980 4.00000000 nvs08 0.1800 23.44972735 nvs10 0.1480 -310.80000000 o7 6631.9400 181.46472807 oaer 0.1750 -1.92309854 oil2 0.5040 -0.73326001 ortez 0.4840 -9532.03905335 parallel 0.6770 924.29555066 pb351535 1584.6850 4485288.00000000 prob02 0.7280 112235.00000000 prob03 0.1750 10.00000000 procsel 0.3480 -1.92309874 pump 0.1920 134263.58532517 qap 5.7090 395738.00000000 qapw 1.8410 388870.00000000 ravempb 1.4190 269590.21931531 risk2bpb 0.5240 -55.73616850 sep1 0.2340 -510.08098435 space25 113.6170 484.32864420 space25a 10.4610 484.32864420 spectra2 1.6700 13.97830588 spring 0.3870 0.84624567 st_e14 0.2140 4.57958240 st_e29 0.2280 -0.94347050 st_e32 0.4070 -1.43040728 st_miqp1 0.2000 281.00000000 st_miqp2 0.2720 2.00000000 st_miqp4 0.1340 -4574.00000000 st_test5 0.3790 -110.00000000 st_test6 0.4920 471.00000000 st_test8 0.1410 -29605.00000000 st_testgr1 0.3260 -12.72810000 st_testgr3 0.3160 -20.46880000 st_testph4 0.3650 -80.50000000 stockcycle 591.1400 119948.68833333 synheat 3.0810 154997.33486599 synthes1 0.1670 6.00975891 synthes2 0.2650 73.03531253 synthes3 0.4320 68.00974052 tln6 8582.6700 15.70000000 tln7 8762.7440 23.50000000 tloss 1.0170 16.30000000 util 0.2870 999.89730763 water4 76.9750 913.15706796 waterx 46.9720 938.86284906

 Modelname Time (SBB) Status (SBB) feedtray2 -- mstat( 5) sstat( 1) st_e13 -- mstat( 5) sstat( 1) st_e15 -- mstat( 5) sstat( 1) st_e31 -- mstat( 5) sstat( 1) st_e36 -- mstat(10) sstat( 1) st_e40 -- mstat( 5) sstat( 1) super3t -- mstat( 5) sstat( 1) tltr -- mstat(10) sstat( 1)

 Modelname Time (SBB) Status (SBB) pb302035 -- mstat(14) sstat( 3) pb302095 -- mstat(14) sstat( 3) pb351595 -- mstat(14) sstat( 3) tln12 -- mstat(14) sstat( 8) tls12 -- mstat(14) sstat( 8) tls6 -- mstat(14) sstat( 8) tls7 -- mstat(13) sstat(13)