Solver Square Comparison: Considers all models.

Date / Time: 09/29/08 16:21:52


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver BONMINBB1 is represented on the left (rows) and solver BONMINHyb on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :BONMIN-1.trc.convex
Tracefile 2 :BONMIN-5.trc.convex
Solvers used : BONMINBB1
BONMINHyb
Modeltype(s)   MINLP



BONMINHyb:
optimal
BONMINHyb:
feasible
BONMINHyb:
infeasible
BONMINHyb:
unbounded
BONMINHyb:
fail
BONMINHyb:
no data
total BONMINBB1
BONMINBB1:
optimal
- - - - - - -
BONMINBB1:
feasible
- 33 - - 1 - 34
BONMINBB1:
infeasible
- - - - 1 - 1
BONMINBB1:
unbounded
- - - - - - -
BONMINBB1:
fail
- 2 - - 1 - 3
BONMINBB1:
no data
- - - - - - -
total BONMINHyb - 35 - - 3 - 38




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


BONMINBB1: feasible -- BONMINHyb: feasible    Back to top

Modelname Time (BONMINBB1) Time (BONMINHyb) Ratio (BONMINBB1/BONMINHyb) Obj (BONMINBB1) Obj (BONMINHyb)
alan 0.2800 0.2700 1.037 2.92500000 2.92500000
batch 7.2400 2.3100 3.134 300301.81804043 285506.50824410
du-opt5 5.2900 4.1700 1.269 8.07365758 8.07365758
du-opt 7.0600 7.0800 0.997 3.57591364 3.57912580
ex1223 0.3400 0.1200 2.833 4.57958240 4.57958249
ex1223a 0.1300 0.0200 6.500 4.57958240 4.57958240
ex1223b 0.2600 0.0800 3.250 4.57958240 4.57958240
fac1 0.7000 0.1200 5.833 160912612.35017600 160912612.35018700
fac3 4.3200 0.5100 8.471 31982309.84799740 31982309.84800050
fo7 3600.4300 1021.7900 3.524 22.87929378 20.72982507
gbd 0.1500 0.0100 15.000 2.20000000 2.20000000
m3 3.2500 0.1400 23.214 37.80000000 37.80000000
m6 3600.4400 17.9600 200.470 114.34842656 82.25687691
m7 3600.3400 124.7100 28.870 106.75687691 106.75687691
meanvarx 0.6900 0.3100 2.226 14.36923211 14.36923211
nvs03 0.1900 0.0000 +INF.000 16.00000000 16.00000000
nvs10 0.1100 0.0200 5.500 -310.80000000 -310.80000000
o7 3600.5700 3605.5100 0.999 144.48441229 131.66032758
risk2bpb 14.0800 2.5800 5.457 -55.87613939 -55.87613939
st_e14 0.3300 0.1800 1.833 4.57958240 4.57958249
st_miqp1 0.2400 0.0000 +INF.000 281.00000000 281.00000000
st_miqp3 0.0400 0.0000 --- -6.00000000 -6.00000000
st_miqp4 0.2700 0.0400 6.750 -4574.00000000 -4574.00000000
st_miqp5 0.0900 0.0700 1.286 -333.88888889 -333.88888889
st_test5 0.9600 0.0100 96.000 -110.00000000 -110.00000000
st_test6 0.9600 0.0100 96.000 471.00000000 471.00000000
st_test8 0.3100 0.0100 31.000 -29605.00000000 -29575.00000000
st_testgr1 0.5000 0.2200 2.273 -12.78595000 -12.79290000
st_testgr3 2.4600 0.0500 49.200 -20.50550000 -20.47750000
st_testph4 0.1600 0.0000 +INF.000 -80.50000000 -80.50000000
synthes1 0.3500 0.1600 2.188 6.00975891 6.00975891
synthes2 0.7500 0.1500 5.000 73.03531253 73.03531253
synthes3 0.9200 0.5900 1.559 68.00974052 68.00974052

Back to top





BONMINBB1: feasible -- BONMINHyb: fail    Back to top

Modelname Time (BONMINBB1) Time (BONMINHyb) Ratio (BONMINBB1/BONMINHyb) Obj (BONMINBB1) Status (BONMINHyb)
stockcycle 143.0300 NA --- 119948.68833303 mstat(13) sstat(13)

Back to top





BONMINBB1: infeasible -- BONMINHyb: fail    Back to top

Modelname Time (BONMINBB1) Time (BONMINHyb) Ratio (BONMINBB1/BONMINHyb) Status (BONMINBB1) Status (BONMINHyb)
st_miqp2 NA NA --- mstat(19) sstat( 1) mstat(13) sstat(13)

Back to top





BONMINBB1: fail -- BONMINHyb: feasible    Back to top

Modelname Time (BONMINBB1) Time (BONMINHyb) Ratio (BONMINBB1/BONMINHyb) Status (BONMINBB1) Obj (BONMINHyb)
tls6 NA 3605.1400 --- mstat(14) sstat( 3) 15.30000000
tls7 NA 3606.7900 --- mstat(14) sstat( 3) 17.40000000

Back to top





BONMINBB1: fail -- BONMINHyb: fail    Back to top

Modelname Time (BONMINBB1) Time (BONMINHyb) Ratio (BONMINBB1/BONMINHyb) Status (BONMINBB1) Status (BONMINHyb)
tls12 NA NA --- mstat(14) sstat( 3) mstat(14) sstat( 3)

Back to top





BONMINBB1: feasible:     Back to top

Modelname Time (BONMINBB1) Obj (BONMINBB1)
alan 0.2800 2.92500000
batch 7.2400 300301.81804043
du-opt5 5.2900 8.07365758
du-opt 7.0600 3.57591364
ex1223 0.3400 4.57958240
ex1223a 0.1300 4.57958240
ex1223b 0.2600 4.57958240
fac1 0.7000 160912612.35017600
fac3 4.3200 31982309.84799740
fo7 3600.4300 22.87929378
gbd 0.1500 2.20000000
m3 3.2500 37.80000000
m6 3600.4400 114.34842656
m7 3600.3400 106.75687691
meanvarx 0.6900 14.36923211
nvs03 0.1900 16.00000000
nvs10 0.1100 -310.80000000
o7 3600.5700 144.48441229
risk2bpb 14.0800 -55.87613939
st_e14 0.3300 4.57958240
st_miqp1 0.2400 281.00000000
st_miqp3 0.0400 -6.00000000
st_miqp4 0.2700 -4574.00000000
st_miqp5 0.0900 -333.88888889
st_test5 0.9600 -110.00000000
st_test6 0.9600 471.00000000
st_test8 0.3100 -29605.00000000
st_testgr1 0.5000 -12.78595000
st_testgr3 2.4600 -20.50550000
st_testph4 0.1600 -80.50000000
stockcycle 143.0300 119948.68833303
synthes1 0.3500 6.00975891
synthes2 0.7500 73.03531253
synthes3 0.9200 68.00974052

Back to top





BONMINBB1: infeasible:     Back to top

Modelname Time (BONMINBB1) Status (BONMINBB1)
st_miqp2 -- mstat(19) sstat( 1)

Back to top





BONMINBB1: fail:     Back to top

Modelname Time (BONMINBB1) Status (BONMINBB1)
tls12 -- mstat(14) sstat( 3)
tls6 -- mstat(14) sstat( 3)
tls7 -- mstat(14) sstat( 3)

Back to top





BONMINHyb: feasible:     Back to top

Modelname Time (BONMINHyb) Obj (BONMINHyb)
alan 0.2700 2.92500000
batch 2.3100 285506.50824410
du-opt5 4.1700 8.07365758
du-opt 7.0800 3.57912580
ex1223 0.1200 4.57958249
ex1223a 0.0200 4.57958240
ex1223b 0.0800 4.57958240
fac1 0.1200 160912612.35018700
fac3 0.5100 31982309.84800050
fo7 1021.7900 20.72982507
gbd 0.0100 2.20000000
m3 0.1400 37.80000000
m6 17.9600 82.25687691
m7 124.7100 106.75687691
meanvarx 0.3100 14.36923211
nvs03 0.0000 16.00000000
nvs10 0.0200 -310.80000000
o7 3605.5100 131.66032758
risk2bpb 2.5800 -55.87613939
st_e14 0.1800 4.57958249
st_miqp1 0.0000 281.00000000
st_miqp3 0.0000 -6.00000000
st_miqp4 0.0400 -4574.00000000
st_miqp5 0.0700 -333.88888889
st_test5 0.0100 -110.00000000
st_test6 0.0100 471.00000000
st_test8 0.0100 -29575.00000000
st_testgr1 0.2200 -12.79290000
st_testgr3 0.0500 -20.47750000
st_testph4 0.0000 -80.50000000
synthes1 0.1600 6.00975891
synthes2 0.1500 73.03531253
synthes3 0.5900 68.00974052
tls6 3605.1400 15.30000000
tls7 3606.7900 17.40000000

Back to top





BONMINHyb: fail:     Back to top

Modelname Time (BONMINHyb) Status (BONMINHyb)
st_miqp2 -- mstat(13) sstat(13)
stockcycle -- mstat(13) sstat(13)
tls12 -- mstat(14) sstat( 3)

Back to top





BONMINBB1: all -- BONMINHyb: all :     Back to top

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 0.015. The gap is in this case displayed with a green background

For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the reslim (3600.00 seconds). The shift is 10s for time and 0.0001 for timeratios.

Modelname Time (BONMINBB1) Time (BONMINHyb) Ratio (BONMINBB1/BONMINHyb) Obj (BONMINBB1) Obj (BONMINHyb) ObjEst (BONMINBB1) ObjEst (BONMINHyb) Gap (BONMINBB1) Gap (BONMINHyb)
alan 0.2800 0.2700 1.037 2.92500000 2.92500000 2.92500000 2.92500000 0.0000 0.0000
batch 7.2400 2.3100 3.134 300301.81804043 285506.50824410 +INF 285506.50824416 NA 0.0000
du-opt5 5.2900 4.1700 1.269 8.07365758 8.07365758 8.07365758 8.07365758 0.0000 0.0000
du-opt 7.0600 7.0800 0.997 3.57591364 3.57912580 +INF +INF NA NA
ex1223 0.3400 0.1200 2.833 4.57958240 4.57958249 4.57958240 4.57958241 0.0000 0.0000
ex1223a 0.1300 0.0200 6.500 4.57958240 4.57958240 4.57958240 4.57958240 0.0000 0.0000
ex1223b 0.2600 0.0800 3.250 4.57958240 4.57958240 4.57958240 4.57958240 0.0000 0.0000
fac1 0.7000 0.1200 5.833 160912612.35017600 160912612.35018700 160912612.35017600 160912612.35017000 0.0000 0.0000
fac3 4.3200 0.5100 8.471 31982309.84799740 31982309.84800050 31982309.84799740 31982309.84800000 0.0000 0.0000
fo7 3600.4300 1021.7900 3.524 22.87929378 20.72982507 9.80031832 20.72982507 1.3345 0.0000
gbd 0.1500 0.0100 15.000 2.20000000 2.20000000 2.20000000 2.20000000 0.0000 0.0000
m3 3.2500 0.1400 23.214 37.80000000 37.80000000 37.80000000 37.80000000 0.0000 0.0000
m6 3600.4400 17.9600 200.470 114.34842656 82.25687691 40.04986629 82.25687691 1.8552 0.0000
m7 3600.3400 124.7100 28.870 106.75687691 106.75687691 67.45584412 106.75687691 0.5826 0.0000
meanvarx 0.6900 0.3100 2.226 14.36923211 14.36923211 14.36923211 14.36923212 0.0000 0.0000
nvs03 0.1900 0.0000 +INF.000 16.00000000 16.00000000 16.00000000 16.00000000 0.0000 0.0000
nvs10 0.1100 0.0200 5.500 -310.80000000 -310.80000000 -310.80000000 -310.80000000 0.0000 0.0000
o7 3600.5700 3605.5100 0.999 144.48441229 131.66032758 24.58796087 99.42544235 4.8762 0.3242
risk2bpb 14.0800 2.5800 5.457 -55.87613939 -55.87613939 -55.87613939 -55.87613885 0.0000 0.0000
st_e14 0.3300 0.1800 1.833 4.57958240 4.57958249 4.57958240 4.57958241 0.0000 0.0000
st_miqp1 0.2400 0.0000 +INF.000 281.00000000 281.00000000 281.00000000 281.00000000 0.0000 0.0000
st_miqp2 NA NA --- mstat(19) sstat( 1) mstat(13) sstat(13) --- --- --- ---
st_miqp3 0.0400 0.0000 --- -6.00000000 -6.00000000 -6.00000000 -6.00000000 0.0000 0.0000
st_miqp4 0.2700 0.0400 6.750 -4574.00000000 -4574.00000000 -4574.00000000 -4574.00000000 0.0000 0.0000
st_miqp5 0.0900 0.0700 1.286 -333.88888889 -333.88888889 -333.88888889 -333.88888889 0.0000 0.0000
st_test5 0.9600 0.0100 96.000 -110.00000000 -110.00000000 -110.00000000 -110.00000000 0.0000 0.0000
st_test6 0.9600 0.0100 96.000 471.00000000 471.00000000 471.00000000 471.00000000 0.0000 0.0000
st_test8 0.3100 0.0100 31.000 -29605.00000000 -29575.00000000 -29605.00000000 +INF 0.0000 NA
st_testgr1 0.5000 0.2200 2.273 -12.78595000 -12.79290000 -12.79290000 -12.79290000 0.0005 0.0000
st_testgr3 2.4600 0.0500 49.200 -20.50550000 -20.47750000 -20.50550000 +INF 0.0000 NA
st_testph4 0.1600 0.0000 +INF.000 -80.50000000 -80.50000000 -80.50000000 -80.50000000 0.0000 0.0000
stockcycle 143.0300 NA --- 119948.68833303 mstat(13) sstat(13) 119948.68833303 --- 0.0000 ---
synthes1 0.3500 0.1600 2.188 6.00975891 6.00975891 6.00975891 6.00975891 0.0000 0.0000
synthes2 0.7500 0.1500 5.000 73.03531253 73.03531253 73.03531253 73.03531253 0.0000 0.0000
synthes3 0.9200 0.5900 1.559 68.00974052 68.00974052 68.00974052 68.00974052 0.0000 0.0000
tls12 NA NA --- mstat(14) sstat( 3) mstat(14) sstat( 3) --- --- --- ---
tls6 NA 3605.1400 --- mstat(14) sstat( 3) 15.30000000 --- 5.27024054 --- 1.9031
tls7 NA 3606.7900 --- mstat(14) sstat( 3) 17.40000000 --- 4.10508993 --- 3.2386
mean 55.72 50.78 --- --- --- --- --- --- ---
unsolved 26.32% 23.68%         

Back to top