Solver Square Comparison: Considers all models.

Date / Time: 09/29/08 16:20:30


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver ALPHAECP is represented on the left (rows) and solver BONMINOA on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :ALPHAECP-1.trc.convex
Tracefile 2 :BONMIN-6.trc.convex
Solvers used : ALPHAECP
BONMINOA
Modeltype(s)   MINLP



BONMINOA:
optimal
BONMINOA:
feasible
BONMINOA:
infeasible
BONMINOA:
unbounded
BONMINOA:
fail
BONMINOA:
no data
total ALPHAECP
ALPHAECP:
optimal
- - - - - - -
ALPHAECP:
feasible
- 34 - - 2 - 36
ALPHAECP:
infeasible
- - - - - - -
ALPHAECP:
unbounded
- - - - - - -
ALPHAECP:
fail
- 1 - - 1 - 2
ALPHAECP:
no data
- - - - - - -
total BONMINOA - 35 - - 3 - 38




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


ALPHAECP: feasible -- BONMINOA: feasible    Back to top

Modelname Time (ALPHAECP) Time (BONMINOA) Ratio (ALPHAECP/BONMINOA) Obj (ALPHAECP) Obj (BONMINOA)
alan 0.0700 0.2400 0.292 2.92500000 2.92500000
batch 4.1000 2.2100 1.855 285506.50824403 285506.50824410
du-opt5 12.8720 6.5600 1.962 8.07365758 8.07365758
du-opt 3.0900 9.7300 0.318 3.55923932 3.56127566
ex1223 0.1600 0.1200 1.333 4.57958240 4.57958249
ex1223a 0.0800 0.0200 4.000 4.57958240 4.57958240
ex1223b 0.1300 0.0700 1.857 4.57958240 4.57958240
fac1 0.1000 0.1200 0.833 160912612.35016900 160912612.35018700
fac3 0.5700 0.5000 1.140 31982309.84799990 31982309.84800050
fo7 356.4500 1187.0800 0.300 20.72982507 20.72982507
gbd 0.0100 0.0100 --- 2.20000000 2.20000000
m3 0.2500 0.1300 1.923 37.80000000 37.80000000
m6 3.5800 12.7300 0.281 82.25687690 82.25687691
m7 11.6400 119.7300 0.097 106.75687690 106.75687691
meanvarx 0.1200 0.3100 0.387 14.36923211 14.36923211
nvs03 0.0100 0.0000 --- 16.00000000 16.00000000
nvs10 0.0400 0.0200 --- -310.80000000 -310.80000000
o7 3456.2900 3605.8700 0.959 131.65313814 131.65313814
st_e14 0.1100 0.1100 1.000 4.57958240 4.57958249
st_miqp1 0.0000 0.0100 --- 281.00000000 281.00000000
st_miqp3 0.0100 0.0100 --- -6.00000000 -6.00000000
st_miqp4 0.0000 0.0800 0.000 -4574.00000000 -4574.00000000
st_miqp5 0.0400 0.0600 0.667 -333.88888889 -333.88888889
st_test5 0.0500 0.0000 +INF.000 -110.00000000 -110.00000000
st_test6 0.0200 0.0100 --- 471.00000000 471.00000000
st_test8 0.0100 0.0000 --- -29605.00000000 -29575.00000000
st_testgr1 0.0800 0.3100 0.258 -12.81160000 -12.76375000
st_testgr3 0.0600 0.0400 1.500 -20.59000000 -20.47750000
st_testph4 0.0100 0.0100 --- -80.50000000 -80.50000000
synthes1 0.0700 0.1600 0.438 6.00975891 6.00975891
synthes2 0.2700 0.1600 1.688 73.03531252 73.03531253
synthes3 0.8500 0.5900 1.441 68.00974052 68.00974052
risk2bpb 1.1000 2.5900 0.425 -55.87613940 -55.87613939
tls6 3600.9000 3605.3500 0.999 38.10000000 15.90000000

Back to top





ALPHAECP: feasible -- BONMINOA: fail    Back to top

Modelname Time (ALPHAECP) Time (BONMINOA) Ratio (ALPHAECP/BONMINOA) Obj (ALPHAECP) Status (BONMINOA)
st_miqp2 0.0400 NA --- 2.00000000 mstat(13) sstat(13)
stockcycle 3600.2400 NA --- 123665.84333333 mstat(13) sstat(13)

Back to top





ALPHAECP: fail -- BONMINOA: feasible    Back to top

Modelname Time (ALPHAECP) Time (BONMINOA) Ratio (ALPHAECP/BONMINOA) Status (ALPHAECP) Obj (BONMINOA)
tls7 3600.5500 3605.5800 --- mstat(14) sstat( 3) 16.60000000

Back to top





ALPHAECP: fail -- BONMINOA: fail    Back to top

Modelname Time (ALPHAECP) Time (BONMINOA) Ratio (ALPHAECP/BONMINOA) Status (ALPHAECP) Status (BONMINOA)
tls12 3600.7300 NA --- mstat(14) sstat( 3) mstat(14) sstat( 3)

Back to top





ALPHAECP: feasible:     Back to top

Modelname Time (ALPHAECP) Obj (ALPHAECP)
alan 0.0700 2.92500000
batch 4.1000 285506.50824403
du-opt5 12.8720 8.07365758
du-opt 3.0900 3.55923932
ex1223 0.1600 4.57958240
ex1223a 0.0800 4.57958240
ex1223b 0.1300 4.57958240
fac1 0.1000 160912612.35016900
fac3 0.5700 31982309.84799990
fo7 356.4500 20.72982507
gbd 0.0100 2.20000000
m3 0.2500 37.80000000
m6 3.5800 82.25687690
m7 11.6400 106.75687690
meanvarx 0.1200 14.36923211
nvs03 0.0100 16.00000000
nvs10 0.0400 -310.80000000
o7 3456.2900 131.65313814
st_e14 0.1100 4.57958240
st_miqp1 0.0000 281.00000000
st_miqp2 0.0400 2.00000000
st_miqp3 0.0100 -6.00000000
st_miqp4 0.0000 -4574.00000000
st_miqp5 0.0400 -333.88888889
st_test5 0.0500 -110.00000000
st_test6 0.0200 471.00000000
st_test8 0.0100 -29605.00000000
st_testgr1 0.0800 -12.81160000
st_testgr3 0.0600 -20.59000000
st_testph4 0.0100 -80.50000000
synthes1 0.0700 6.00975891
synthes2 0.2700 73.03531252
synthes3 0.8500 68.00974052
risk2bpb 1.1000 -55.87613940
stockcycle 3600.2400 123665.84333333
tls6 3600.9000 38.10000000

Back to top





ALPHAECP: fail:     Back to top

Modelname Time (ALPHAECP) Status (ALPHAECP)
tls12 -- mstat(14) sstat( 3)
tls7 -- mstat(14) sstat( 3)

Back to top





BONMINOA: feasible:     Back to top

Modelname Time (BONMINOA) Obj (BONMINOA)
alan 0.2400 2.92500000
batch 2.2100 285506.50824410
du-opt5 6.5600 8.07365758
du-opt 9.7300 3.56127566
ex1223 0.1200 4.57958249
ex1223a 0.0200 4.57958240
ex1223b 0.0700 4.57958240
fac1 0.1200 160912612.35018700
fac3 0.5000 31982309.84800050
fo7 1187.0800 20.72982507
gbd 0.0100 2.20000000
m3 0.1300 37.80000000
m6 12.7300 82.25687691
m7 119.7300 106.75687691
meanvarx 0.3100 14.36923211
nvs03 0.0000 16.00000000
nvs10 0.0200 -310.80000000
o7 3605.8700 131.65313814
st_e14 0.1100 4.57958249
st_miqp1 0.0100 281.00000000
st_miqp3 0.0100 -6.00000000
st_miqp4 0.0800 -4574.00000000
st_miqp5 0.0600 -333.88888889
st_test5 0.0000 -110.00000000
st_test6 0.0100 471.00000000
st_test8 0.0000 -29575.00000000
st_testgr1 0.3100 -12.76375000
st_testgr3 0.0400 -20.47750000
st_testph4 0.0100 -80.50000000
synthes1 0.1600 6.00975891
synthes2 0.1600 73.03531253
synthes3 0.5900 68.00974052
risk2bpb 2.5900 -55.87613939
tls6 3605.3500 15.90000000
tls7 3605.5800 16.60000000

Back to top





BONMINOA: fail:     Back to top

Modelname Time (BONMINOA) Status (BONMINOA)
st_miqp2 -- mstat(13) sstat(13)
stockcycle -- mstat(13) sstat(13)
tls12 -- mstat(14) sstat( 3)

Back to top





ALPHAECP: all -- BONMINOA: all :     Back to top

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 0.015. The gap is in this case displayed with a green background

For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the reslim (3600.00 seconds). The shift is 10s for time and 0.0001 for timeratios.

Modelname Time (ALPHAECP) Time (BONMINOA) Ratio (ALPHAECP/BONMINOA) Obj (ALPHAECP) Obj (BONMINOA) ObjEst (ALPHAECP) ObjEst (BONMINOA) Gap (ALPHAECP) Gap (BONMINOA)
alan 0.0700 0.2400 0.292 2.92500000 2.92500000 +INF 2.92500000 NA 0.0000
batch 4.1000 2.2100 1.855 285506.50824403 285506.50824410 +INF 285506.50824416 NA 0.0000
du-opt5 12.8720 6.5600 1.962 8.07365758 8.07365758 +INF 8.07365758 NA 0.0000
du-opt 3.0900 9.7300 0.318 3.55923932 3.56127566 +INF 3.55000000 NA 0.0032
ex1223 0.1600 0.1200 1.333 4.57958240 4.57958249 +INF 4.57958241 NA 0.0000
ex1223a 0.0800 0.0200 4.000 4.57958240 4.57958240 +INF 4.57958240 NA 0.0000
ex1223b 0.1300 0.0700 1.857 4.57958240 4.57958240 +INF 4.57958240 NA 0.0000
fac1 0.1000 0.1200 0.833 160912612.35016900 160912612.35018700 +INF 160912612.35017000 NA 0.0000
fac3 0.5700 0.5000 1.140 31982309.84799990 31982309.84800050 +INF 31982309.84800000 NA 0.0000
fo7 356.4500 1187.0800 0.300 20.72982507 20.72982507 +INF 20.72982507 NA 0.0000
gbd 0.0100 0.0100 --- 2.20000000 2.20000000 +INF 2.20000000 NA 0.0000
m3 0.2500 0.1300 1.923 37.80000000 37.80000000 +INF 37.80000000 NA 0.0000
m6 3.5800 12.7300 0.281 82.25687690 82.25687691 +INF 82.25687691 NA 0.0000
m7 11.6400 119.7300 0.097 106.75687690 106.75687691 +INF 106.75687691 NA 0.0000
meanvarx 0.1200 0.3100 0.387 14.36923211 14.36923211 +INF 14.36923212 NA 0.0000
nvs03 0.0100 0.0000 --- 16.00000000 16.00000000 +INF 16.00000000 NA 0.0000
nvs10 0.0400 0.0200 --- -310.80000000 -310.80000000 +INF -310.80000000 NA 0.0000
o7 3456.2900 3605.8700 0.959 131.65313814 131.65313814 +INF 104.49266820 NA 0.2599
st_e14 0.1100 0.1100 1.000 4.57958240 4.57958249 +INF 4.57958241 NA 0.0000
st_miqp1 0.0000 0.0100 --- 281.00000000 281.00000000 +INF 281.00000000 NA 0.0000
st_miqp2 0.0400 NA --- 2.00000000 mstat(13) sstat(13) +INF --- +INF ---
st_miqp3 0.0100 0.0100 --- -6.00000000 -6.00000000 +INF -6.00000000 NA 0.0000
st_miqp4 0.0000 0.0800 0.000 -4574.00000000 -4574.00000000 +INF -4574.00000000 NA 0.0000
st_miqp5 0.0400 0.0600 0.667 -333.88888889 -333.88888889 +INF -333.88888889 NA 0.0000
st_test5 0.0500 0.0000 +INF.000 -110.00000000 -110.00000000 +INF -110.00000000 NA 0.0000
st_test6 0.0200 0.0100 --- 471.00000000 471.00000000 +INF 471.00000000 NA 0.0000
st_test8 0.0100 0.0000 --- -29605.00000000 -29575.00000000 +INF +INF NA NA
st_testgr1 0.0800 0.3100 0.258 -12.81160000 -12.76375000 +INF +INF NA NA
st_testgr3 0.0600 0.0400 1.500 -20.59000000 -20.47750000 +INF +INF NA NA
st_testph4 0.0100 0.0100 --- -80.50000000 -80.50000000 +INF -80.50000000 NA 0.0000
synthes1 0.0700 0.1600 0.438 6.00975891 6.00975891 +INF 6.00975891 NA 0.0000
synthes2 0.2700 0.1600 1.688 73.03531252 73.03531253 +INF 73.03531253 NA 0.0000
synthes3 0.8500 0.5900 1.441 68.00974052 68.00974052 +INF 68.00974052 NA 0.0000
risk2bpb 1.1000 2.5900 0.425 -55.87613940 -55.87613939 +INF -55.87613885 NA 0.0000
stockcycle 3600.2400 NA --- 123665.84333333 mstat(13) sstat(13) +INF --- +INF ---
tls12 3600.7300 NA --- mstat(14) sstat( 3) mstat(14) sstat( 3) --- --- --- ---
tls6 3600.9000 3605.3500 0.999 38.10000000 15.90000000 +INF 4.01632928 NA 2.9588
tls7 3600.5500 3605.5800 --- mstat(14) sstat( 3) 16.60000000 --- 2.40202263 --- 5.9108
mean 7200.00 51.91 --- --- --- --- --- --- ---
unsolved 100.00% 23.68%         

Back to top