Solver Square Comparison: Considers all models.

Date / Time: 09/29/08 16:20:24


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver BARON2 is represented on the left (rows) and solver BONMINOA on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :BARON-2.trc.convex
Tracefile 2 :BONMIN-6.trc.convex
Solvers used : BARON2
BONMINOA
Modeltype(s)   MINLP



BONMINOA:
optimal
BONMINOA:
feasible
BONMINOA:
infeasible
BONMINOA:
unbounded
BONMINOA:
fail
BONMINOA:
no data
total BARON2
BARON2:
optimal
- 3 - - - - 3
BARON2:
feasible
- 32 - - 2 - 34
BARON2:
infeasible
- - - - - - -
BARON2:
unbounded
- - - - - - -
BARON2:
fail
- - - - 1 - 1
BARON2:
no data
- - - - - - -
total BONMINOA - 35 - - 3 - 38




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


BARON2: optimal -- BONMINOA: feasible    Back to top

Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Obj (BARON2) Obj (BONMINOA)
gbd 0.0000 0.0100 --- 2.20000000 2.20000000
nvs03 0.0100 0.0000 --- 16.00000000 16.00000000
st_miqp3 0.0000 0.0100 --- -6.00000000 -6.00000000

Back to top





BARON2: feasible -- BONMINOA: feasible    Back to top

Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Obj (BARON2) Obj (BONMINOA)
alan 0.0300 0.2400 0.125 2.92595245 2.92500000
batch 1.2400 2.2100 0.561 285506.50824400 285506.50824410
du-opt5 106.1400 6.5600 16.180 8.07365758 8.07365758
du-opt 62.5000 9.7300 6.423 3.58039065 3.56127566
ex1223 0.0600 0.1200 0.500 4.57958240 4.57958249
ex1223a 0.0100 0.0200 --- 4.57958240 4.57958240
ex1223b 0.0400 0.0700 0.571 4.57958240 4.57958240
fac1 0.0300 0.1200 0.250 160912612.35000000 160912612.35018700
fac3 0.3500 0.5000 0.700 31982309.84800000 31982309.84800050
fo7 3600.0000 1187.0800 3.033 22.11876985 20.72982507
m3 0.0600 0.1300 0.462 37.80000000 37.80000000
m6 110.3400 12.7300 8.668 82.25687691 82.25687691
m7 569.2100 119.7300 4.754 106.75687691 106.75687691
meanvarx 0.1300 0.3100 0.419 14.36923211 14.36923211
nvs10 0.0200 0.0200 --- -310.80000000 -310.80000000
o7 3600.0000 3605.8700 0.998 136.73131828 131.65313814
risk2bpb 2.0900 2.5900 0.807 -55.73616850 -55.87613939
st_e14 0.0600 0.1100 0.545 4.57958240 4.57958249
st_miqp1 0.0100 0.0100 --- 281.00000000 281.00000000
st_miqp4 0.0000 0.0800 0.000 -4574.00000000 -4574.00000000
st_miqp5 0.0100 0.0600 0.167 -333.88888889 -333.88888889
st_test5 0.0200 0.0000 --- -110.00000000 -110.00000000
st_test6 0.0400 0.0100 --- 471.00000000 471.00000000
st_test8 0.0200 0.0000 --- -29605.00000000 -29575.00000000
st_testgr1 0.0200 0.3100 0.065 -12.73920000 -12.76375000
st_testgr3 0.2800 0.0400 7.000 -20.49105000 -20.47750000
st_testph4 0.0100 0.0100 --- -80.50000000 -80.50000000
synthes1 0.0100 0.1600 0.063 6.00975891 6.00975891
synthes2 0.0200 0.1600 0.125 73.03533264 73.03531253
synthes3 0.0600 0.5900 0.102 68.01195780 68.00974052
tls6 3600.0000 3605.3500 0.999 16.40000000 15.90000000
tls7 3600.0000 3605.5800 0.998 17.20000000 16.60000000

Back to top





BARON2: feasible -- BONMINOA: fail    Back to top

Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Obj (BARON2) Status (BONMINOA)
st_miqp2 0.0100 NA --- 2.00000000 mstat(13) sstat(13)
stockcycle 12.9600 NA --- 120359.71333300 mstat(13) sstat(13)

Back to top





BARON2: fail -- BONMINOA: fail    Back to top

Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Status (BARON2) Status (BONMINOA)
tls12 3600.0000 NA --- mstat(13) sstat(13) mstat(14) sstat( 3)

Back to top





BARON2: optimal:     Back to top

Modelname Time (BARON2) Obj (BARON2)
gbd 0.0000 2.20000000
nvs03 0.0100 16.00000000
st_miqp3 0.0000 -6.00000000

Back to top





BARON2: feasible:     Back to top

Modelname Time (BARON2) Obj (BARON2)
alan 0.0300 2.92595245
batch 1.2400 285506.50824400
du-opt5 106.1400 8.07365758
du-opt 62.5000 3.58039065
ex1223 0.0600 4.57958240
ex1223a 0.0100 4.57958240
ex1223b 0.0400 4.57958240
fac1 0.0300 160912612.35000000
fac3 0.3500 31982309.84800000
fo7 3600.0000 22.11876985
m3 0.0600 37.80000000
m6 110.3400 82.25687691
m7 569.2100 106.75687691
meanvarx 0.1300 14.36923211
nvs10 0.0200 -310.80000000
o7 3600.0000 136.73131828
risk2bpb 2.0900 -55.73616850
st_e14 0.0600 4.57958240
st_miqp1 0.0100 281.00000000
st_miqp2 0.0100 2.00000000
st_miqp4 0.0000 -4574.00000000
st_miqp5 0.0100 -333.88888889
st_test5 0.0200 -110.00000000
st_test6 0.0400 471.00000000
st_test8 0.0200 -29605.00000000
st_testgr1 0.0200 -12.73920000
st_testgr3 0.2800 -20.49105000
st_testph4 0.0100 -80.50000000
stockcycle 12.9600 120359.71333300
synthes1 0.0100 6.00975891
synthes2 0.0200 73.03533264
synthes3 0.0600 68.01195780
tls6 3600.0000 16.40000000
tls7 3600.0000 17.20000000

Back to top





BARON2: fail:     Back to top

Modelname Time (BARON2) Status (BARON2)
tls12 -- mstat(13) sstat(13)

Back to top





BONMINOA: feasible:     Back to top

Modelname Time (BONMINOA) Obj (BONMINOA)
alan 0.2400 2.92500000
batch 2.2100 285506.50824410
du-opt5 6.5600 8.07365758
du-opt 9.7300 3.56127566
ex1223 0.1200 4.57958249
ex1223a 0.0200 4.57958240
ex1223b 0.0700 4.57958240
fac1 0.1200 160912612.35018700
fac3 0.5000 31982309.84800050
fo7 1187.0800 20.72982507
gbd 0.0100 2.20000000
m3 0.1300 37.80000000
m6 12.7300 82.25687691
m7 119.7300 106.75687691
meanvarx 0.3100 14.36923211
nvs03 0.0000 16.00000000
nvs10 0.0200 -310.80000000
o7 3605.8700 131.65313814
risk2bpb 2.5900 -55.87613939
st_e14 0.1100 4.57958249
st_miqp1 0.0100 281.00000000
st_miqp3 0.0100 -6.00000000
st_miqp4 0.0800 -4574.00000000
st_miqp5 0.0600 -333.88888889
st_test5 0.0000 -110.00000000
st_test6 0.0100 471.00000000
st_test8 0.0000 -29575.00000000
st_testgr1 0.3100 -12.76375000
st_testgr3 0.0400 -20.47750000
st_testph4 0.0100 -80.50000000
synthes1 0.1600 6.00975891
synthes2 0.1600 73.03531253
synthes3 0.5900 68.00974052
tls6 3605.3500 15.90000000
tls7 3605.5800 16.60000000

Back to top





BONMINOA: fail:     Back to top

Modelname Time (BONMINOA) Status (BONMINOA)
st_miqp2 -- mstat(13) sstat(13)
stockcycle -- mstat(13) sstat(13)
tls12 -- mstat(14) sstat( 3)

Back to top





BARON2: all -- BONMINOA: all :     Back to top

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 0.015. The gap is in this case displayed with a green background

For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the reslim (3600.00 seconds). The shift is 10s for time and 0.0001 for timeratios.

Modelname Time (BARON2) Time (BONMINOA) Ratio (BARON2/BONMINOA) Obj (BARON2) Obj (BONMINOA) ObjEst (BARON2) ObjEst (BONMINOA) Gap (BARON2) Gap (BONMINOA)
alan 0.0300 0.2400 0.125 2.92595245 2.92500000 2.89698263 2.92500000 0.0100 0.0000
batch 1.2400 2.2100 0.561 285506.50824400 285506.50824410 282679.71113300 285506.50824416 0.0100 0.0000
du-opt5 106.1400 6.5600 16.180 8.07365758 8.07365758 7.99437871 8.07365758 0.0099 0.0000
du-opt 62.5000 9.7300 6.423 3.58039065 3.56127566 3.55262236 3.55000000 0.0078 0.0032
ex1223 0.0600 0.1200 0.500 4.57958240 4.57958249 4.53424000 4.57958241 0.0100 0.0000
ex1223a 0.0100 0.0200 --- 4.57958240 4.57958240 4.53424000 4.57958240 0.0100 0.0000
ex1223b 0.0400 0.0700 0.571 4.57958240 4.57958240 4.53424000 4.57958240 0.0100 0.0000
fac1 0.0300 0.1200 0.250 160912612.35000000 160912612.35018700 160079450.12500000 160912612.35017000 0.0052 0.0000
fac3 0.3500 0.5000 0.700 31982309.84800000 31982309.84800050 31665653.31490000 31982309.84800000 0.0100 0.0000
fo7 3600.0000 1187.0800 3.033 22.11876985 20.72982507 14.31763600 20.72982507 0.5449 0.0000
gbd 0.0000 0.0100 --- 2.20000000 2.20000000 2.20000000 2.20000000 0.0000 0.0000
m3 0.0600 0.1300 0.462 37.80000000 37.80000000 37.42574257 37.80000000 0.0100 0.0000
m6 110.3400 12.7300 8.668 82.25687691 82.25687691 81.44245239 82.25687691 0.0100 0.0000
m7 569.2100 119.7300 4.754 106.75687691 106.75687691 105.69987813 106.75687691 0.0100 0.0000
meanvarx 0.1300 0.3100 0.419 14.36923211 14.36923211 14.22696249 14.36923212 0.0100 0.0000
nvs03 0.0100 0.0000 --- 16.00000000 16.00000000 16.00000000 16.00000000 0.0000 0.0000
nvs10 0.0200 0.0200 --- -310.80000000 -310.80000000 -313.93939394 -310.80000000 0.0100 0.0000
o7 3600.0000 3605.8700 0.998 136.73131828 131.65313814 81.76346430 104.49266820 0.6723 0.2599
risk2bpb 2.0900 2.5900 0.807 -55.73616850 -55.87613939 -56.29916010 -55.87613885 0.0100 0.0000
st_e14 0.0600 0.1100 0.545 4.57958240 4.57958249 4.53424000 4.57958241 0.0100 0.0000
st_miqp1 0.0100 0.0100 --- 281.00000000 281.00000000 278.21782178 281.00000000 0.0100 0.0000
st_miqp2 0.0100 NA --- 2.00000000 mstat(13) sstat(13) 1.98019802 --- 0.0100 ---
st_miqp3 0.0000 0.0100 --- -6.00000000 -6.00000000 -6.00000000 -6.00000000 0.0000 0.0000
st_miqp4 0.0000 0.0800 0.000 -4574.00000000 -4574.00000000 -4620.20202020 -4574.00000000 0.0100 0.0000
st_miqp5 0.0100 0.0600 0.167 -333.88888889 -333.88888889 -337.26150393 -333.88888889 0.0100 0.0000
st_test5 0.0200 0.0000 --- -110.00000000 -110.00000000 -111.11111111 -110.00000000 0.0100 0.0000
st_test6 0.0400 0.0100 --- 471.00000000 471.00000000 466.33663366 471.00000000 0.0100 0.0000
st_test8 0.0200 0.0000 --- -29605.00000000 -29575.00000000 -29904.04040400 +INF 0.0100 NA
st_testgr1 0.0200 0.3100 0.065 -12.73920000 -12.76375000 -12.86787879 +INF 0.0100 NA
st_testgr3 0.2800 0.0400 7.000 -20.49105000 -20.47750000 -20.69803030 +INF 0.0100 NA
st_testph4 0.0100 0.0100 --- -80.50000000 -80.50000000 -81.31313131 -80.50000000 0.0100 0.0000
stockcycle 12.9600 NA --- 120359.71333300 mstat(13) sstat(13) 119168.03300300 --- 0.0100 ---
synthes1 0.0100 0.1600 0.063 6.00975891 6.00975891 5.95025634 6.00975891 0.0100 0.0000
synthes2 0.0200 0.1600 0.125 73.03533264 73.03531253 72.31221053 73.03531253 0.0100 0.0000
synthes3 0.0600 0.5900 0.102 68.01195780 68.00974052 67.33857208 68.00974052 0.0100 0.0000
tls12 3600.0000 NA --- mstat(13) sstat(13) mstat(14) sstat( 3) --- --- --- ---
tls6 3600.0000 3605.3500 0.999 16.40000000 15.90000000 8.11111111 4.01632928 1.0219 2.9588
tls7 3600.0000 3605.5800 0.998 17.20000000 16.60000000 1.77080649 2.40202263 8.7131 5.9108
mean 22.81 51.91 --- --- --- --- --- --- ---
unsolved 13.16% 23.68%         

Back to top