Solver Square Comparison: Considers all models.

 Date / Time: 09/29/08 16:21:52

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver BONMINBB1 is represented on the left (rows) and solver BONMINBB3 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

 Tracefile 1 : BONMIN-1.trc.convex Tracefile 2 : BONMIN-3.trc.convex Solvers used : BONMINBB1 BONMINBB3 Modeltype(s) MINLP

 BONMINBB3: optimal BONMINBB3: feasible BONMINBB3: infeasible BONMINBB3: unbounded BONMINBB3: fail BONMINBB3: no data total BONMINBB1 BONMINBB1: optimal - - - - - - - BONMINBB1: feasible - 31 - - 3 - 34 BONMINBB1: infeasible - - 1 - - - 1 BONMINBB1: unbounded - - - - - - - BONMINBB1: fail - - - - 3 - 3 BONMINBB1: no data - - - - - - - total BONMINBB3 - 31 1 - 6 - 38

Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 8 or 16 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 10 or 19 1 unbounded 3 or 18 1 fail all other all other

Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

BONMINBB1: feasible -- BONMINBB3: feasible    Back to top

 Modelname Time (BONMINBB1) Time (BONMINBB3) Ratio (BONMINBB1/BONMINBB3) Obj (BONMINBB1) Obj (BONMINBB3) alan 0.2800 0.2800 1.000 2.92500000 2.92500000 batch 7.2400 6.8500 1.057 300301.81804043 285506.50824416 du-opt5 5.2900 7.3500 0.720 8.07365758 8.07365758 du-opt 7.0600 7.1800 0.983 3.57591364 3.57591364 ex1223 0.3400 0.3300 1.030 4.57958240 4.57958240 ex1223a 0.1300 0.1300 1.000 4.57958240 4.57958240 ex1223b 0.2600 0.3200 0.813 4.57958240 4.57958240 fac1 0.7000 0.7000 1.000 160912612.35017600 160912612.35017600 fac3 4.3200 4.7500 0.909 31982309.84799740 31982309.84799740 gbd 0.1500 0.1500 1.000 2.20000000 2.20000000 m3 3.2500 11.1700 0.291 37.80000000 37.80000000 m6 3600.4400 3600.3000 1.000 114.34842656 82.28551882 meanvarx 0.6900 0.6800 1.015 14.36923211 14.36923211 nvs03 0.1900 0.2400 0.792 16.00000000 16.00000000 nvs10 0.1100 0.1000 1.100 -310.80000000 -310.80000000 risk2bpb 14.0800 20.5500 0.685 -55.87613939 -55.87613939 st_e14 0.3300 0.3300 1.000 4.57958240 4.57958240 st_miqp1 0.2400 0.1800 1.333 281.00000000 281.00000000 st_miqp3 0.0400 0.0400 --- -6.00000000 -6.00000000 st_miqp4 0.2700 0.2700 1.000 -4574.00000000 -4574.00000000 st_miqp5 0.0900 0.1200 0.750 -333.88888889 -333.88888889 st_test5 0.9600 2.2200 0.432 -110.00000000 -110.00000000 st_test6 0.9600 3.5300 0.272 471.00000000 471.00000000 st_test8 0.3100 0.2500 1.240 -29605.00000000 -29605.00000000 st_testgr1 0.5000 0.5600 0.893 -12.78595000 -12.78595000 st_testgr3 2.4600 3.8700 0.636 -20.50550000 -20.50550000 st_testph4 0.1600 0.1500 1.067 -80.50000000 -80.50000000 stockcycle 143.0300 158.8300 0.901 119948.68833303 119948.68833303 synthes1 0.3500 0.3100 1.129 6.00975891 6.00975891 synthes2 0.7500 0.7000 1.071 73.03531253 73.03531253 synthes3 0.9200 0.9100 1.011 68.00974052 68.00974052

Back to top

BONMINBB1: feasible -- BONMINBB3: fail    Back to top

 Modelname Time (BONMINBB1) Time (BONMINBB3) Ratio (BONMINBB1/BONMINBB3) Obj (BONMINBB1) Status (BONMINBB3) fo7 3600.4300 NA --- 22.87929378 mstat(14) sstat( 3) m7 3600.3400 NA --- 106.75687691 mstat(14) sstat( 3) o7 3600.5700 NA --- 144.48441229 mstat(14) sstat( 3)

Back to top

BONMINBB1: infeasible -- BONMINBB3: infeasible    Back to top

 Modelname Time (BONMINBB1) Time (BONMINBB3) Ratio (BONMINBB1/BONMINBB3) Status (BONMINBB1) Status (BONMINBB3) st_miqp2 NA NA --- mstat(19) sstat( 1) mstat(19) sstat( 1)

Back to top

BONMINBB1: fail -- BONMINBB3: fail    Back to top

 Modelname Time (BONMINBB1) Time (BONMINBB3) Ratio (BONMINBB1/BONMINBB3) Status (BONMINBB1) Status (BONMINBB3) tls12 NA NA --- mstat(14) sstat( 3) mstat(14) sstat( 3) tls6 NA NA --- mstat(14) sstat( 3) mstat(14) sstat( 3) tls7 NA NA --- mstat(14) sstat( 3) mstat(14) sstat( 3)

Back to top

BONMINBB1: feasible:     Back to top

 Modelname Time (BONMINBB1) Obj (BONMINBB1) alan 0.2800 2.92500000 batch 7.2400 300301.81804043 du-opt5 5.2900 8.07365758 du-opt 7.0600 3.57591364 ex1223 0.3400 4.57958240 ex1223a 0.1300 4.57958240 ex1223b 0.2600 4.57958240 fac1 0.7000 160912612.35017600 fac3 4.3200 31982309.84799740 fo7 3600.4300 22.87929378 gbd 0.1500 2.20000000 m3 3.2500 37.80000000 m6 3600.4400 114.34842656 m7 3600.3400 106.75687691 meanvarx 0.6900 14.36923211 nvs03 0.1900 16.00000000 nvs10 0.1100 -310.80000000 o7 3600.5700 144.48441229 risk2bpb 14.0800 -55.87613939 st_e14 0.3300 4.57958240 st_miqp1 0.2400 281.00000000 st_miqp3 0.0400 -6.00000000 st_miqp4 0.2700 -4574.00000000 st_miqp5 0.0900 -333.88888889 st_test5 0.9600 -110.00000000 st_test6 0.9600 471.00000000 st_test8 0.3100 -29605.00000000 st_testgr1 0.5000 -12.78595000 st_testgr3 2.4600 -20.50550000 st_testph4 0.1600 -80.50000000 stockcycle 143.0300 119948.68833303 synthes1 0.3500 6.00975891 synthes2 0.7500 73.03531253 synthes3 0.9200 68.00974052

Back to top

BONMINBB1: infeasible:     Back to top

 Modelname Time (BONMINBB1) Status (BONMINBB1) st_miqp2 -- mstat(19) sstat( 1)

Back to top

BONMINBB1: fail:     Back to top

 Modelname Time (BONMINBB1) Status (BONMINBB1) tls12 -- mstat(14) sstat( 3) tls6 -- mstat(14) sstat( 3) tls7 -- mstat(14) sstat( 3)

Back to top

BONMINBB3: feasible:     Back to top

 Modelname Time (BONMINBB3) Obj (BONMINBB3) alan 0.2800 2.92500000 batch 6.8500 285506.50824416 du-opt5 7.3500 8.07365758 du-opt 7.1800 3.57591364 ex1223 0.3300 4.57958240 ex1223a 0.1300 4.57958240 ex1223b 0.3200 4.57958240 fac1 0.7000 160912612.35017600 fac3 4.7500 31982309.84799740 gbd 0.1500 2.20000000 m3 11.1700 37.80000000 m6 3600.3000 82.28551882 meanvarx 0.6800 14.36923211 nvs03 0.2400 16.00000000 nvs10 0.1000 -310.80000000 risk2bpb 20.5500 -55.87613939 st_e14 0.3300 4.57958240 st_miqp1 0.1800 281.00000000 st_miqp3 0.0400 -6.00000000 st_miqp4 0.2700 -4574.00000000 st_miqp5 0.1200 -333.88888889 st_test5 2.2200 -110.00000000 st_test6 3.5300 471.00000000 st_test8 0.2500 -29605.00000000 st_testgr1 0.5600 -12.78595000 st_testgr3 3.8700 -20.50550000 st_testph4 0.1500 -80.50000000 stockcycle 158.8300 119948.68833303 synthes1 0.3100 6.00975891 synthes2 0.7000 73.03531253 synthes3 0.9100 68.00974052

Back to top

BONMINBB3: infeasible:     Back to top

 Modelname Time (BONMINBB3) Status (BONMINBB3) st_miqp2 -- mstat(19) sstat( 1)

Back to top

BONMINBB3: fail:     Back to top

 Modelname Time (BONMINBB3) Status (BONMINBB3) fo7 -- mstat(14) sstat( 3) m7 -- mstat(14) sstat( 3) o7 -- mstat(14) sstat( 3) tls12 -- mstat(14) sstat( 3) tls6 -- mstat(14) sstat( 3) tls7 -- mstat(14) sstat( 3)

Back to top

BONMINBB1: all -- BONMINBB3: all :     Back to top

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 0.015. The gap is in this case displayed with a green background

For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the reslim (3600.00 seconds). The shift is 10s for time and 0.0001 for timeratios.

 Modelname Time (BONMINBB1) Time (BONMINBB3) Ratio (BONMINBB1/BONMINBB3) Obj (BONMINBB1) Obj (BONMINBB3) ObjEst (BONMINBB1) ObjEst (BONMINBB3) Gap (BONMINBB1) Gap (BONMINBB3) alan 0.2800 0.2800 1.000 2.92500000 2.92500000 2.92500000 2.92500000 0.0000 0.0000 batch 7.2400 6.8500 1.057 300301.81804043 285506.50824416 +INF 285506.50824416 NA 0.0000 du-opt5 5.2900 7.3500 0.720 8.07365758 8.07365758 8.07365758 8.07365758 0.0000 0.0000 du-opt 7.0600 7.1800 0.983 3.57591364 3.57591364 +INF +INF NA NA ex1223 0.3400 0.3300 1.030 4.57958240 4.57958240 4.57958240 4.57958240 0.0000 0.0000 ex1223a 0.1300 0.1300 1.000 4.57958240 4.57958240 4.57958240 4.57958240 0.0000 0.0000 ex1223b 0.2600 0.3200 0.813 4.57958240 4.57958240 4.57958240 4.57958240 0.0000 0.0000 fac1 0.7000 0.7000 1.000 160912612.35017600 160912612.35017600 160912612.35017600 160912612.35017600 0.0000 0.0000 fac3 4.3200 4.7500 0.909 31982309.84799740 31982309.84799740 31982309.84799740 31982309.84799740 0.0000 0.0000 fo7 3600.4300 NA --- 22.87929378 mstat(14) sstat( 3) 9.80031832 --- 1.3345 --- gbd 0.1500 0.1500 1.000 2.20000000 2.20000000 2.20000000 2.20000000 0.0000 0.0000 m3 3.2500 11.1700 0.291 37.80000000 37.80000000 37.80000000 37.80000000 0.0000 0.0000 m6 3600.4400 3600.3000 1.000 114.34842656 82.28551882 40.04986629 33.84917463 1.8552 1.4309 m7 3600.3400 NA --- 106.75687691 mstat(14) sstat( 3) 67.45584412 --- 0.5826 --- meanvarx 0.6900 0.6800 1.015 14.36923211 14.36923211 14.36923211 14.36923211 0.0000 0.0000 nvs03 0.1900 0.2400 0.792 16.00000000 16.00000000 16.00000000 16.00000000 0.0000 0.0000 nvs10 0.1100 0.1000 1.100 -310.80000000 -310.80000000 -310.80000000 -310.80000000 0.0000 0.0000 o7 3600.5700 NA --- 144.48441229 mstat(14) sstat( 3) 24.58796087 --- 4.8762 --- risk2bpb 14.0800 20.5500 0.685 -55.87613939 -55.87613939 -55.87613939 -55.87613939 0.0000 0.0000 st_e14 0.3300 0.3300 1.000 4.57958240 4.57958240 4.57958240 4.57958240 0.0000 0.0000 st_miqp1 0.2400 0.1800 1.333 281.00000000 281.00000000 281.00000000 281.00000000 0.0000 0.0000 st_miqp2 NA NA --- mstat(19) sstat( 1) mstat(19) sstat( 1) --- --- --- --- st_miqp3 0.0400 0.0400 --- -6.00000000 -6.00000000 -6.00000000 -6.00000000 0.0000 0.0000 st_miqp4 0.2700 0.2700 1.000 -4574.00000000 -4574.00000000 -4574.00000000 -4574.00000000 0.0000 0.0000 st_miqp5 0.0900 0.1200 0.750 -333.88888889 -333.88888889 -333.88888889 -333.88888889 0.0000 0.0000 st_test5 0.9600 2.2200 0.432 -110.00000000 -110.00000000 -110.00000000 -110.00000000 0.0000 0.0000 st_test6 0.9600 3.5300 0.272 471.00000000 471.00000000 471.00000000 471.00000000 0.0000 0.0000 st_test8 0.3100 0.2500 1.240 -29605.00000000 -29605.00000000 -29605.00000000 -29605.00000000 0.0000 0.0000 st_testgr1 0.5000 0.5600 0.893 -12.78595000 -12.78595000 -12.79290000 -12.80000000 0.0005 0.0011 st_testgr3 2.4600 3.8700 0.636 -20.50550000 -20.50550000 -20.50550000 -20.50550000 0.0000 0.0000 st_testph4 0.1600 0.1500 1.067 -80.50000000 -80.50000000 -80.50000000 -80.50000000 0.0000 0.0000 stockcycle 143.0300 158.8300 0.901 119948.68833303 119948.68833303 119948.68833303 119948.68833303 0.0000 0.0000 synthes1 0.3500 0.3100 1.129 6.00975891 6.00975891 6.00975891 6.00975891 0.0000 0.0000 synthes2 0.7500 0.7000 1.071 73.03531253 73.03531253 73.03531253 73.03531253 0.0000 0.0000 synthes3 0.9200 0.9100 1.011 68.00974052 68.00974052 68.00974052 68.00974052 0.0000 0.0000 tls12 NA NA --- mstat(14) sstat( 3) mstat(14) sstat( 3) --- --- --- --- tls6 NA NA --- mstat(14) sstat( 3) mstat(14) sstat( 3) --- --- --- --- tls7 NA NA --- mstat(14) sstat( 3) mstat(14) sstat( 3) --- --- --- --- mean 55.72 48.11 --- --- --- --- --- --- --- unsolved 26.32% 23.68%

Back to top