## Solver Square Comparison: Considers all models.

 Date / Time: 09/29/08 16:20:33

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver BONMINOA is represented on the left (rows) and solver DICOPT on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : BONMIN-6.trc.convex Tracefile 2 : DICOPT-1.trc.convex Solvers used : BONMINOA DICOPT Modeltype(s) MINLP

 DICOPT: optimal DICOPT: feasible DICOPT: infeasible DICOPT: unbounded DICOPT: fail DICOPT: no data total BONMINOA BONMINOA: optimal - - - - - - - BONMINOA: feasible - 28 - - 5 - 33 BONMINOA: infeasible - - - - - - - BONMINOA: unbounded - - - - - - - BONMINOA: fail - 2 - - 1 - 3 BONMINOA: no data - - - - - - - total DICOPT - 30 - - 6 - 36

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

 Modelname Time (BONMINOA) Time (DICOPT) Ratio (BONMINOA/DICOPT) Obj (BONMINOA) Obj (DICOPT) alan 0.2400 0.0000 +INF.000 2.92500000 2.92500000 batch 2.2100 0.0200 110.500 285506.50824410 285506.50824405 du-opt5 6.5600 7.0700 0.928 8.07365758 8.07365758 du-opt 9.7300 3600.0100 0.003 3.56127566 3.55915370 ex1223 0.1200 0.0100 12.000 4.57958249 4.57958240 ex1223a 0.0200 0.0000 --- 4.57958240 4.57958240 ex1223b 0.0700 0.0100 7.000 4.57958240 4.57958240 fac1 0.1200 0.0100 12.000 160912612.35018700 160912612.35016900 fac3 0.5000 0.1500 3.333 31982309.84800050 31982309.84800000 fo7 1187.0800 1160.2200 1.023 20.72982507 20.72982507 m3 0.1300 0.0700 1.857 37.80000000 37.80000000 m6 12.7300 1.0500 12.124 82.25687691 82.28551882 m7 119.7300 0.8500 140.859 106.75687691 106.75687691 meanvarx 0.3100 0.0000 +INF.000 14.36923211 14.36923211 nvs03 0.0000 0.0000 --- 16.00000000 16.00000000 nvs10 0.0200 3600.0000 0.000 -310.80000000 -310.80000000 risk2bpb 2.5900 0.0800 32.375 -55.87613939 -55.87613940 st_e14 0.1100 0.0400 2.750 4.57958249 4.57958240 st_miqp1 0.0100 0.0000 --- 281.00000000 281.00000000 st_test5 0.0000 0.0000 --- -110.00000000 -110.00000000 st_test6 0.0100 0.0100 --- 471.00000000 471.00000000 st_test8 0.0000 0.0000 --- -29575.00000000 -29605.00000000 st_testgr1 0.3100 0.6800 0.456 -12.76375000 -12.81160000 st_testgr3 0.0400 0.0100 --- -20.47750000 -20.59000000 st_testph4 0.0100 0.0000 --- -80.50000000 -80.50000000 synthes1 0.1600 0.0000 +INF.000 6.00975891 6.00975891 synthes2 0.1600 0.0100 16.000 73.03531253 73.03531253 synthes3 0.5900 0.0500 11.800 68.00974052 68.00974052

 Modelname Time (BONMINOA) Time (DICOPT) Ratio (BONMINOA/DICOPT) Obj (BONMINOA) Status (DICOPT) o7 3605.8700 3600.0000 --- 131.65313814 mstat( 9) sstat( 3) st_miqp3 0.0100 NA --- -6.00000000 mstat(13) sstat(13) st_miqp4 0.0800 NA --- -4574.00000000 mstat(13) sstat(13) tls6 3605.3500 3600.0100 --- 15.90000000 mstat( 9) sstat( 3) tls7 3605.5800 3600.0000 --- 16.60000000 mstat( 9) sstat( 3)

 Modelname Time (BONMINOA) Time (DICOPT) Ratio (BONMINOA/DICOPT) Status (BONMINOA) Obj (DICOPT) st_miqp2 NA 0.0100 --- mstat(13) sstat(13) 2.00000000 stockcycle NA 2661.7500 --- mstat(13) sstat(13) 137349.47583333

 Modelname Time (BONMINOA) Time (DICOPT) Ratio (BONMINOA/DICOPT) Status (BONMINOA) Status (DICOPT) tls12 NA 3600.0200 --- mstat(14) sstat( 3) mstat( 9) sstat( 3)

 Modelname Time (BONMINOA) Obj (BONMINOA) alan 0.2400 2.92500000 batch 2.2100 285506.50824410 du-opt5 6.5600 8.07365758 du-opt 9.7300 3.56127566 ex1223 0.1200 4.57958249 ex1223a 0.0200 4.57958240 ex1223b 0.0700 4.57958240 fac1 0.1200 160912612.35018700 fac3 0.5000 31982309.84800050 fo7 1187.0800 20.72982507 gbd 0.0100 2.20000000 m3 0.1300 37.80000000 m6 12.7300 82.25687691 m7 119.7300 106.75687691 meanvarx 0.3100 14.36923211 nvs03 0.0000 16.00000000 nvs10 0.0200 -310.80000000 o7 3605.8700 131.65313814 risk2bpb 2.5900 -55.87613939 st_e14 0.1100 4.57958249 st_miqp1 0.0100 281.00000000 st_miqp3 0.0100 -6.00000000 st_miqp4 0.0800 -4574.00000000 st_miqp5 0.0600 -333.88888889 st_test5 0.0000 -110.00000000 st_test6 0.0100 471.00000000 st_test8 0.0000 -29575.00000000 st_testgr1 0.3100 -12.76375000 st_testgr3 0.0400 -20.47750000 st_testph4 0.0100 -80.50000000 synthes1 0.1600 6.00975891 synthes2 0.1600 73.03531253 synthes3 0.5900 68.00974052 tls6 3605.3500 15.90000000 tls7 3605.5800 16.60000000

 Modelname Time (BONMINOA) Status (BONMINOA) st_miqp2 -- mstat(13) sstat(13) stockcycle -- mstat(13) sstat(13) tls12 -- mstat(14) sstat( 3)

 Modelname Time (DICOPT) Obj (DICOPT) alan 0.0000 2.92500000 batch 0.0200 285506.50824405 du-opt5 7.0700 8.07365758 du-opt 3600.0100 3.55915370 ex1223 0.0100 4.57958240 ex1223a 0.0000 4.57958240 ex1223b 0.0100 4.57958240 fac1 0.0100 160912612.35016900 fac3 0.1500 31982309.84800000 fo7 1160.2200 20.72982507 m3 0.0700 37.80000000 m6 1.0500 82.28551882 m7 0.8500 106.75687691 meanvarx 0.0000 14.36923211 nvs03 0.0000 16.00000000 nvs10 3600.0000 -310.80000000 risk2bpb 0.0800 -55.87613940 st_e14 0.0400 4.57958240 st_miqp1 0.0000 281.00000000 st_miqp2 0.0100 2.00000000 st_test5 0.0000 -110.00000000 st_test6 0.0100 471.00000000 st_test8 0.0000 -29605.00000000 st_testgr1 0.6800 -12.81160000 st_testgr3 0.0100 -20.59000000 st_testph4 0.0000 -80.50000000 stockcycle 2661.7500 137349.47583333 synthes1 0.0000 6.00975891 synthes2 0.0100 73.03531253 synthes3 0.0500 68.00974052

 Modelname Time (DICOPT) Status (DICOPT) o7 -- mstat( 9) sstat( 3) st_miqp3 -- mstat(13) sstat(13) st_miqp4 -- mstat(13) sstat(13) tls12 -- mstat( 9) sstat( 3) tls6 -- mstat( 9) sstat( 3) tls7 -- mstat( 9) sstat( 3)

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 0.015. The gap is in this case displayed with a green background

For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the reslim (3600.00 seconds). The shift is 10s for time and 0.0001 for timeratios.

 Modelname Time (BONMINOA) Time (DICOPT) Ratio (BONMINOA/DICOPT) Obj (BONMINOA) Obj (DICOPT) ObjEst (BONMINOA) ObjEst (DICOPT) Gap (BONMINOA) Gap (DICOPT) alan 0.2400 0.0000 +INF.000 2.92500000 2.92500000 2.92500000 +INF 0.0000 NA batch 2.2100 0.0200 110.500 285506.50824410 285506.50824405 285506.50824416 +INF 0.0000 NA du-opt5 6.5600 7.0700 0.928 8.07365758 8.07365758 8.07365758 +INF 0.0000 NA du-opt 9.7300 3600.0100 0.003 3.56127566 3.55915370 3.55000000 +INF 0.0032 NA ex1223 0.1200 0.0100 12.000 4.57958249 4.57958240 4.57958241 +INF 0.0000 NA ex1223a 0.0200 0.0000 --- 4.57958240 4.57958240 4.57958240 +INF 0.0000 NA ex1223b 0.0700 0.0100 7.000 4.57958240 4.57958240 4.57958240 +INF 0.0000 NA fac1 0.1200 0.0100 12.000 160912612.35018700 160912612.35016900 160912612.35017000 +INF 0.0000 NA fac3 0.5000 0.1500 3.333 31982309.84800050 31982309.84800000 31982309.84800000 +INF 0.0000 NA fo7 1187.0800 1160.2200 1.023 20.72982507 20.72982507 20.72982507 +INF 0.0000 NA m3 0.1300 0.0700 1.857 37.80000000 37.80000000 37.80000000 +INF 0.0000 NA m6 12.7300 1.0500 12.124 82.25687691 82.28551882 82.25687691 +INF 0.0000 NA m7 119.7300 0.8500 140.859 106.75687691 106.75687691 106.75687691 +INF 0.0000 NA meanvarx 0.3100 0.0000 +INF.000 14.36923211 14.36923211 14.36923212 +INF 0.0000 NA nvs03 0.0000 0.0000 --- 16.00000000 16.00000000 16.00000000 +INF 0.0000 NA nvs10 0.0200 3600.0000 0.000 -310.80000000 -310.80000000 -310.80000000 +INF 0.0000 NA o7 3605.8700 3600.0000 --- 131.65313814 mstat( 9) sstat( 3) 104.49266820 --- 0.2599 --- risk2bpb 2.5900 0.0800 32.375 -55.87613939 -55.87613940 -55.87613885 +INF 0.0000 NA st_e14 0.1100 0.0400 2.750 4.57958249 4.57958240 4.57958241 +INF 0.0000 NA st_miqp1 0.0100 0.0000 --- 281.00000000 281.00000000 281.00000000 +INF 0.0000 NA st_miqp2 NA 0.0100 --- mstat(13) sstat(13) 2.00000000 --- +INF --- +INF st_miqp3 0.0100 NA --- -6.00000000 mstat(13) sstat(13) -6.00000000 --- 0.0000 --- st_miqp4 0.0800 NA --- -4574.00000000 mstat(13) sstat(13) -4574.00000000 --- 0.0000 --- st_test5 0.0000 0.0000 --- -110.00000000 -110.00000000 -110.00000000 +INF 0.0000 NA st_test6 0.0100 0.0100 --- 471.00000000 471.00000000 471.00000000 +INF 0.0000 NA st_test8 0.0000 0.0000 --- -29575.00000000 -29605.00000000 +INF +INF NA NA st_testgr1 0.3100 0.6800 0.456 -12.76375000 -12.81160000 +INF +INF NA NA st_testgr3 0.0400 0.0100 --- -20.47750000 -20.59000000 +INF +INF NA NA st_testph4 0.0100 0.0000 --- -80.50000000 -80.50000000 -80.50000000 +INF 0.0000 NA stockcycle NA 2661.7500 --- mstat(13) sstat(13) 137349.47583333 --- +INF --- +INF synthes1 0.1600 0.0000 +INF.000 6.00975891 6.00975891 6.00975891 +INF 0.0000 NA synthes2 0.1600 0.0100 16.000 73.03531253 73.03531253 73.03531253 +INF 0.0000 NA synthes3 0.5900 0.0500 11.800 68.00974052 68.00974052 68.00974052 +INF 0.0000 NA tls12 NA 3600.0200 --- mstat(14) sstat( 3) mstat( 9) sstat( 3) --- --- --- --- tls6 3605.3500 3600.0100 --- 15.90000000 mstat( 9) sstat( 3) 4.01632928 --- 2.9588 --- tls7 3605.5800 3600.0000 --- 16.60000000 mstat( 9) sstat( 3) 2.40202263 --- 5.9108 --- mean 58.50 7200.00 --- --- --- --- --- --- --- unsolved 25.00% 100.00%