## Solver Square Comparison: Considers all models.

 Date / Time: 09/29/08 16:20:24

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver BARON2 is represented on the left (rows) and solver BONMINOA on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : BARON-2.trc.convex Tracefile 2 : BONMIN-6.trc.convex Solvers used : BARON2 BONMINOA Modeltype(s) MINLP

 BONMINOA: optimal BONMINOA: feasible BONMINOA: infeasible BONMINOA: unbounded BONMINOA: fail BONMINOA: no data total BARON2 BARON2: optimal - 3 - - - - 3 BARON2: feasible - 32 - - 2 - 34 BARON2: infeasible - - - - - - - BARON2: unbounded - - - - - - - BARON2: fail - - - - 1 - 1 BARON2: no data - - - - - - - total BONMINOA - 35 - - 3 - 38

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Obj (BARON2) Obj (BONMINOA) gbd 0.0000 0.0100 --- 2.20000000 2.20000000 nvs03 0.0100 0.0000 --- 16.00000000 16.00000000 st_miqp3 0.0000 0.0100 --- -6.00000000 -6.00000000

 Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Obj (BARON2) Obj (BONMINOA) alan 0.0300 0.2400 0.125 2.92595245 2.92500000 batch 1.2400 2.2100 0.561 285506.50824400 285506.50824410 du-opt5 106.1400 6.5600 16.180 8.07365758 8.07365758 du-opt 62.5000 9.7300 6.423 3.58039065 3.56127566 ex1223 0.0600 0.1200 0.500 4.57958240 4.57958249 ex1223a 0.0100 0.0200 --- 4.57958240 4.57958240 ex1223b 0.0400 0.0700 0.571 4.57958240 4.57958240 fac1 0.0300 0.1200 0.250 160912612.35000000 160912612.35018700 fac3 0.3500 0.5000 0.700 31982309.84800000 31982309.84800050 fo7 3600.0000 1187.0800 3.033 22.11876985 20.72982507 m3 0.0600 0.1300 0.462 37.80000000 37.80000000 m6 110.3400 12.7300 8.668 82.25687691 82.25687691 m7 569.2100 119.7300 4.754 106.75687691 106.75687691 meanvarx 0.1300 0.3100 0.419 14.36923211 14.36923211 nvs10 0.0200 0.0200 --- -310.80000000 -310.80000000 o7 3600.0000 3605.8700 0.998 136.73131828 131.65313814 risk2bpb 2.0900 2.5900 0.807 -55.73616850 -55.87613939 st_e14 0.0600 0.1100 0.545 4.57958240 4.57958249 st_miqp1 0.0100 0.0100 --- 281.00000000 281.00000000 st_miqp4 0.0000 0.0800 0.000 -4574.00000000 -4574.00000000 st_miqp5 0.0100 0.0600 0.167 -333.88888889 -333.88888889 st_test5 0.0200 0.0000 --- -110.00000000 -110.00000000 st_test6 0.0400 0.0100 --- 471.00000000 471.00000000 st_test8 0.0200 0.0000 --- -29605.00000000 -29575.00000000 st_testgr1 0.0200 0.3100 0.065 -12.73920000 -12.76375000 st_testgr3 0.2800 0.0400 7.000 -20.49105000 -20.47750000 st_testph4 0.0100 0.0100 --- -80.50000000 -80.50000000 synthes1 0.0100 0.1600 0.063 6.00975891 6.00975891 synthes2 0.0200 0.1600 0.125 73.03533264 73.03531253 synthes3 0.0600 0.5900 0.102 68.01195780 68.00974052 tls6 3600.0000 3605.3500 0.999 16.40000000 15.90000000 tls7 3600.0000 3605.5800 0.998 17.20000000 16.60000000

 Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Obj (BARON2) Status (BONMINOA) st_miqp2 0.0100 NA --- 2.00000000 mstat(13) sstat(13) stockcycle 12.9600 NA --- 120359.71333300 mstat(13) sstat(13)

 Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Status (BARON2) Status (BONMINOA) tls12 3600.0000 NA --- mstat(13) sstat(13) mstat(14) sstat( 3)

 Modelname Time (BARON2) Obj (BARON2) gbd 0.0000 2.20000000 nvs03 0.0100 16.00000000 st_miqp3 0.0000 -6.00000000

 Modelname Time (BARON2) Obj (BARON2) alan 0.0300 2.92595245 batch 1.2400 285506.50824400 du-opt5 106.1400 8.07365758 du-opt 62.5000 3.58039065 ex1223 0.0600 4.57958240 ex1223a 0.0100 4.57958240 ex1223b 0.0400 4.57958240 fac1 0.0300 160912612.35000000 fac3 0.3500 31982309.84800000 fo7 3600.0000 22.11876985 m3 0.0600 37.80000000 m6 110.3400 82.25687691 m7 569.2100 106.75687691 meanvarx 0.1300 14.36923211 nvs10 0.0200 -310.80000000 o7 3600.0000 136.73131828 risk2bpb 2.0900 -55.73616850 st_e14 0.0600 4.57958240 st_miqp1 0.0100 281.00000000 st_miqp2 0.0100 2.00000000 st_miqp4 0.0000 -4574.00000000 st_miqp5 0.0100 -333.88888889 st_test5 0.0200 -110.00000000 st_test6 0.0400 471.00000000 st_test8 0.0200 -29605.00000000 st_testgr1 0.0200 -12.73920000 st_testgr3 0.2800 -20.49105000 st_testph4 0.0100 -80.50000000 stockcycle 12.9600 120359.71333300 synthes1 0.0100 6.00975891 synthes2 0.0200 73.03533264 synthes3 0.0600 68.01195780 tls6 3600.0000 16.40000000 tls7 3600.0000 17.20000000

 Modelname Time (BARON2) Status (BARON2) tls12 -- mstat(13) sstat(13)

 Modelname Time (BONMINOA) Obj (BONMINOA) alan 0.2400 2.92500000 batch 2.2100 285506.50824410 du-opt5 6.5600 8.07365758 du-opt 9.7300 3.56127566 ex1223 0.1200 4.57958249 ex1223a 0.0200 4.57958240 ex1223b 0.0700 4.57958240 fac1 0.1200 160912612.35018700 fac3 0.5000 31982309.84800050 fo7 1187.0800 20.72982507 gbd 0.0100 2.20000000 m3 0.1300 37.80000000 m6 12.7300 82.25687691 m7 119.7300 106.75687691 meanvarx 0.3100 14.36923211 nvs03 0.0000 16.00000000 nvs10 0.0200 -310.80000000 o7 3605.8700 131.65313814 risk2bpb 2.5900 -55.87613939 st_e14 0.1100 4.57958249 st_miqp1 0.0100 281.00000000 st_miqp3 0.0100 -6.00000000 st_miqp4 0.0800 -4574.00000000 st_miqp5 0.0600 -333.88888889 st_test5 0.0000 -110.00000000 st_test6 0.0100 471.00000000 st_test8 0.0000 -29575.00000000 st_testgr1 0.3100 -12.76375000 st_testgr3 0.0400 -20.47750000 st_testph4 0.0100 -80.50000000 synthes1 0.1600 6.00975891 synthes2 0.1600 73.03531253 synthes3 0.5900 68.00974052 tls6 3605.3500 15.90000000 tls7 3605.5800 16.60000000

 Modelname Time (BONMINOA) Status (BONMINOA) st_miqp2 -- mstat(13) sstat(13) stockcycle -- mstat(13) sstat(13) tls12 -- mstat(14) sstat( 3)

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 0.015. The gap is in this case displayed with a green background

For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the reslim (3600.00 seconds). The shift is 10s for time and 0.0001 for timeratios.

 Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Obj (BARON2) Obj (BONMINOA) ObjEst (BARON2) ObjEst (BONMINOA) Gap (BARON2) Gap (BONMINOA) alan 0.0300 0.2400 0.125 2.92595245 2.92500000 2.89698263 2.92500000 0.0100 0.0000 batch 1.2400 2.2100 0.561 285506.50824400 285506.50824410 282679.71113300 285506.50824416 0.0100 0.0000 du-opt5 106.1400 6.5600 16.180 8.07365758 8.07365758 7.99437871 8.07365758 0.0099 0.0000 du-opt 62.5000 9.7300 6.423 3.58039065 3.56127566 3.55262236 3.55000000 0.0078 0.0032 ex1223 0.0600 0.1200 0.500 4.57958240 4.57958249 4.53424000 4.57958241 0.0100 0.0000 ex1223a 0.0100 0.0200 --- 4.57958240 4.57958240 4.53424000 4.57958240 0.0100 0.0000 ex1223b 0.0400 0.0700 0.571 4.57958240 4.57958240 4.53424000 4.57958240 0.0100 0.0000 fac1 0.0300 0.1200 0.250 160912612.35000000 160912612.35018700 160079450.12500000 160912612.35017000 0.0052 0.0000 fac3 0.3500 0.5000 0.700 31982309.84800000 31982309.84800050 31665653.31490000 31982309.84800000 0.0100 0.0000 fo7 3600.0000 1187.0800 3.033 22.11876985 20.72982507 14.31763600 20.72982507 0.5449 0.0000 gbd 0.0000 0.0100 --- 2.20000000 2.20000000 2.20000000 2.20000000 0.0000 0.0000 m3 0.0600 0.1300 0.462 37.80000000 37.80000000 37.42574257 37.80000000 0.0100 0.0000 m6 110.3400 12.7300 8.668 82.25687691 82.25687691 81.44245239 82.25687691 0.0100 0.0000 m7 569.2100 119.7300 4.754 106.75687691 106.75687691 105.69987813 106.75687691 0.0100 0.0000 meanvarx 0.1300 0.3100 0.419 14.36923211 14.36923211 14.22696249 14.36923212 0.0100 0.0000 nvs03 0.0100 0.0000 --- 16.00000000 16.00000000 16.00000000 16.00000000 0.0000 0.0000 nvs10 0.0200 0.0200 --- -310.80000000 -310.80000000 -313.93939394 -310.80000000 0.0100 0.0000 o7 3600.0000 3605.8700 0.998 136.73131828 131.65313814 81.76346430 104.49266820 0.6723 0.2599 risk2bpb 2.0900 2.5900 0.807 -55.73616850 -55.87613939 -56.29916010 -55.87613885 0.0100 0.0000 st_e14 0.0600 0.1100 0.545 4.57958240 4.57958249 4.53424000 4.57958241 0.0100 0.0000 st_miqp1 0.0100 0.0100 --- 281.00000000 281.00000000 278.21782178 281.00000000 0.0100 0.0000 st_miqp2 0.0100 NA --- 2.00000000 mstat(13) sstat(13) 1.98019802 --- 0.0100 --- st_miqp3 0.0000 0.0100 --- -6.00000000 -6.00000000 -6.00000000 -6.00000000 0.0000 0.0000 st_miqp4 0.0000 0.0800 0.000 -4574.00000000 -4574.00000000 -4620.20202020 -4574.00000000 0.0100 0.0000 st_miqp5 0.0100 0.0600 0.167 -333.88888889 -333.88888889 -337.26150393 -333.88888889 0.0100 0.0000 st_test5 0.0200 0.0000 --- -110.00000000 -110.00000000 -111.11111111 -110.00000000 0.0100 0.0000 st_test6 0.0400 0.0100 --- 471.00000000 471.00000000 466.33663366 471.00000000 0.0100 0.0000 st_test8 0.0200 0.0000 --- -29605.00000000 -29575.00000000 -29904.04040400 +INF 0.0100 NA st_testgr1 0.0200 0.3100 0.065 -12.73920000 -12.76375000 -12.86787879 +INF 0.0100 NA st_testgr3 0.2800 0.0400 7.000 -20.49105000 -20.47750000 -20.69803030 +INF 0.0100 NA st_testph4 0.0100 0.0100 --- -80.50000000 -80.50000000 -81.31313131 -80.50000000 0.0100 0.0000 stockcycle 12.9600 NA --- 120359.71333300 mstat(13) sstat(13) 119168.03300300 --- 0.0100 --- synthes1 0.0100 0.1600 0.063 6.00975891 6.00975891 5.95025634 6.00975891 0.0100 0.0000 synthes2 0.0200 0.1600 0.125 73.03533264 73.03531253 72.31221053 73.03531253 0.0100 0.0000 synthes3 0.0600 0.5900 0.102 68.01195780 68.00974052 67.33857208 68.00974052 0.0100 0.0000 tls12 3600.0000 NA --- mstat(13) sstat(13) mstat(14) sstat( 3) --- --- --- --- tls6 3600.0000 3605.3500 0.999 16.40000000 15.90000000 8.11111111 4.01632928 1.0219 2.9588 tls7 3600.0000 3605.5800 0.998 17.20000000 16.60000000 1.77080649 2.40202263 8.7131 5.9108 mean 22.81 51.91 --- --- --- --- --- --- --- unsolved 13.16% 23.68%