Solver Square Comparison: Considers all models.

Date / Time: 09/29/08 16:20:22


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver BARON2 is represented on the left (rows) and solver LINDOGLOBAL on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :BARON-2.trc.convex
Tracefile 2 :LINDOGLOBAL-1.trc.convex
Solvers used : BARON2
LINDOGLOBAL
Modeltype(s)   MINLP



LINDOGLOBAL:
optimal
LINDOGLOBAL:
feasible
LINDOGLOBAL:
infeasible
LINDOGLOBAL:
unbounded
LINDOGLOBAL:
fail
LINDOGLOBAL:
no data
total BARON2
BARON2:
optimal
3 - - - - - 3
BARON2:
feasible
20 14 - - - - 34
BARON2:
infeasible
- - - - - - -
BARON2:
unbounded
- - - - - - -
BARON2:
fail
- - - - 1 - 1
BARON2:
no data
- - - - - - -
total LINDOGLOBAL 23 14 - - 1 - 38




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


BARON2: optimal -- LINDOGLOBAL: optimal    Back to top

Modelname Time (BARON2) Time (LINDOGLOBAL) Ratio (BARON2/LINDOGLOBAL) Obj (BARON2) Obj (LINDOGLOBAL)
gbd 0.0000 0.0090 --- 2.20000000 2.20000000
nvs03 0.0100 0.0270 --- 16.00000000 16.00000000
st_miqp3 0.0000 0.0080 --- -6.00000000 -6.00000000

Back to top





BARON2: feasible -- LINDOGLOBAL: optimal    Back to top

Modelname Time (BARON2) Time (LINDOGLOBAL) Ratio (BARON2/LINDOGLOBAL) Obj (BARON2) Obj (LINDOGLOBAL)
alan 0.0300 0.0250 --- 2.92595245 2.92500000
batch 1.2400 2.2470 0.552 285506.50824400 285506.50824681
ex1223 0.0600 0.0970 0.619 4.57958240 4.57958240
ex1223a 0.0100 0.0220 --- 4.57958240 4.57958240
ex1223b 0.0400 0.0730 0.548 4.57958240 4.57958240
fac3 0.3500 53.8090 0.007 31982309.84800000 31982309.84800090
m3 0.0600 1.6960 0.035 37.80000000 37.79999992
risk2bpb 2.0900 2.2250 0.939 -55.73616850 -55.87613939
st_e14 0.0600 0.1490 0.403 4.57958240 4.57958240
st_miqp1 0.0100 0.0310 --- 281.00000000 281.00000000
st_miqp2 0.0100 0.0440 --- 2.00000000 2.00000000
st_miqp5 0.0100 0.0120 --- -333.88888889 -333.88888889
st_test5 0.0200 0.0290 --- -110.00000000 -110.00000000
st_test6 0.0400 0.0370 --- 471.00000000 471.00000000
st_test8 0.0200 0.0290 --- -29605.00000000 -29605.00000000
st_testgr3 0.2800 11.1490 0.025 -20.49105000 -20.59000000
st_testph4 0.0100 0.0110 --- -80.50000000 -80.50000000
synthes1 0.0100 0.0440 --- 6.00975891 6.00975902
synthes2 0.0200 0.5900 0.034 73.03533264 73.03531253
synthes3 0.0600 4.3810 0.014 68.01195780 68.00974052

Back to top





BARON2: feasible -- LINDOGLOBAL: feasible    Back to top

Modelname Time (BARON2) Time (LINDOGLOBAL) Ratio (BARON2/LINDOGLOBAL) Obj (BARON2) Obj (LINDOGLOBAL)
du-opt5 106.1400 2047.5980 0.052 8.07365758 8.07365758
du-opt 62.5000 270.9360 0.231 3.58039065 3.55634006
fac1 0.0300 0.3610 0.083 160912612.35000000 160912612.35017100
fo7 3600.0000 3600.3070 1.000 22.11876985 29.54373631
m6 110.3400 495.2620 0.223 82.25687691 82.25687760
m7 569.2100 3600.4280 0.158 106.75687691 106.75687693
meanvarx 0.1300 0.0820 1.585 14.36923211 14.36923211
nvs10 0.0200 0.0170 --- -310.80000000 -310.80000000
o7 3600.0000 3600.4330 1.000 136.73131828 151.30711666
st_miqp4 0.0000 0.0060 --- -4574.00000000 -4574.00000000
st_testgr1 0.0200 1.4540 0.014 -12.73920000 -12.81160000
stockcycle 12.9600 310.0830 0.042 120359.71333300 120532.62166667
tls6 3600.0000 3600.8170 1.000 16.40000000 20.70000003
tls7 3600.0000 3602.9820 0.999 17.20000000 22.50000000

Back to top





BARON2: fail -- LINDOGLOBAL: fail    Back to top

Modelname Time (BARON2) Time (LINDOGLOBAL) Ratio (BARON2/LINDOGLOBAL) Status (BARON2) Status (LINDOGLOBAL)
tls12 3600.0000 3607.4790 --- mstat(13) sstat(13) mstat(14) sstat( 3)

Back to top





BARON2: optimal:     Back to top

Modelname Time (BARON2) Obj (BARON2)
gbd 0.0000 2.20000000
nvs03 0.0100 16.00000000
st_miqp3 0.0000 -6.00000000

Back to top





BARON2: feasible:     Back to top

Modelname Time (BARON2) Obj (BARON2)
alan 0.0300 2.92595245
batch 1.2400 285506.50824400
du-opt5 106.1400 8.07365758
du-opt 62.5000 3.58039065
ex1223 0.0600 4.57958240
ex1223a 0.0100 4.57958240
ex1223b 0.0400 4.57958240
fac1 0.0300 160912612.35000000
fac3 0.3500 31982309.84800000
fo7 3600.0000 22.11876985
m3 0.0600 37.80000000
m6 110.3400 82.25687691
m7 569.2100 106.75687691
meanvarx 0.1300 14.36923211
nvs10 0.0200 -310.80000000
o7 3600.0000 136.73131828
risk2bpb 2.0900 -55.73616850
st_e14 0.0600 4.57958240
st_miqp1 0.0100 281.00000000
st_miqp2 0.0100 2.00000000
st_miqp4 0.0000 -4574.00000000
st_miqp5 0.0100 -333.88888889
st_test5 0.0200 -110.00000000
st_test6 0.0400 471.00000000
st_test8 0.0200 -29605.00000000
st_testgr1 0.0200 -12.73920000
st_testgr3 0.2800 -20.49105000
st_testph4 0.0100 -80.50000000
stockcycle 12.9600 120359.71333300
synthes1 0.0100 6.00975891
synthes2 0.0200 73.03533264
synthes3 0.0600 68.01195780
tls6 3600.0000 16.40000000
tls7 3600.0000 17.20000000

Back to top





BARON2: fail:     Back to top

Modelname Time (BARON2) Status (BARON2)
tls12 -- mstat(13) sstat(13)

Back to top





LINDOGLOBAL: optimal:     Back to top

Modelname Time (LINDOGLOBAL) Obj (LINDOGLOBAL)
alan 0.0250 2.92500000
batch 2.2470 285506.50824681
ex1223 0.0970 4.57958240
ex1223a 0.0220 4.57958240
ex1223b 0.0730 4.57958240
fac3 53.8090 31982309.84800090
gbd 0.0090 2.20000000
m3 1.6960 37.79999992
nvs03 0.0270 16.00000000
risk2bpb 2.2250 -55.87613939
st_e14 0.1490 4.57958240
st_miqp1 0.0310 281.00000000
st_miqp2 0.0440 2.00000000
st_miqp3 0.0080 -6.00000000
st_miqp5 0.0120 -333.88888889
st_test5 0.0290 -110.00000000
st_test6 0.0370 471.00000000
st_test8 0.0290 -29605.00000000
st_testgr3 11.1490 -20.59000000
st_testph4 0.0110 -80.50000000
synthes1 0.0440 6.00975902
synthes2 0.5900 73.03531253
synthes3 4.3810 68.00974052

Back to top





LINDOGLOBAL: feasible:     Back to top

Modelname Time (LINDOGLOBAL) Obj (LINDOGLOBAL)
du-opt5 2047.5980 8.07365758
du-opt 270.9360 3.55634006
fac1 0.3610 160912612.35017100
fo7 3600.3070 29.54373631
m6 495.2620 82.25687760
m7 3600.4280 106.75687693
meanvarx 0.0820 14.36923211
nvs10 0.0170 -310.80000000
o7 3600.4330 151.30711666
st_miqp4 0.0060 -4574.00000000
st_testgr1 1.4540 -12.81160000
stockcycle 310.0830 120532.62166667
tls6 3600.8170 20.70000003
tls7 3602.9820 22.50000000

Back to top





LINDOGLOBAL: fail:     Back to top

Modelname Time (LINDOGLOBAL) Status (LINDOGLOBAL)
tls12 -- mstat(14) sstat( 3)

Back to top





BARON2: all -- LINDOGLOBAL: all :     Back to top

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 0.015. The gap is in this case displayed with a green background

For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the reslim (3600.00 seconds). The shift is 10s for time and 0.0001 for timeratios.

Modelname Time (BARON2) Time (LINDOGLOBAL) Ratio (BARON2/LINDOGLOBAL) Obj (BARON2) Obj (LINDOGLOBAL) ObjEst (BARON2) ObjEst (LINDOGLOBAL) Gap (BARON2) Gap (LINDOGLOBAL)
alan 0.0300 0.0250 --- 2.92595245 2.92500000 2.89698263 2.92499999 0.0100 0.0000
batch 1.2400 2.2470 0.552 285506.50824400 285506.50824681 282679.71113300 285506.50824681 0.0100 0.0000
du-opt5 106.1400 2047.5980 0.052 8.07365758 8.07365758 7.99437871 8.05410378 0.0099 0.0024
du-opt 62.5000 270.9360 0.231 3.58039065 3.55634006 3.55262236 3.53949327 0.0078 0.0048
ex1223 0.0600 0.0970 0.619 4.57958240 4.57958240 4.53424000 4.57958240 0.0100 0.0000
ex1223a 0.0100 0.0220 --- 4.57958240 4.57958240 4.53424000 4.57958240 0.0100 0.0000
ex1223b 0.0400 0.0730 0.548 4.57958240 4.57958240 4.53424000 4.57958240 0.0100 0.0000
fac1 0.0300 0.3610 0.083 160912612.35000000 160912612.35017100 160079450.12500000 159679950.17353800 0.0052 0.0077
fac3 0.3500 53.8090 0.007 31982309.84800000 31982309.84800090 31665653.31490000 31982309.84480180 0.0100 0.0000
fo7 3600.0000 3600.3070 1.000 22.11876985 29.54373631 14.31763600 2.52595020 0.5449 10.6961
gbd 0.0000 0.0090 --- 2.20000000 2.20000000 2.20000000 2.20000000 0.0000 0.0000
m3 0.0600 1.6960 0.035 37.80000000 37.79999992 37.42574257 37.79999908 0.0100 0.0000
m6 110.3400 495.2620 0.223 82.25687691 82.25687760 81.44245239 82.18997209 0.0100 0.0008
m7 569.2100 3600.4280 0.158 106.75687691 106.75687693 105.69987813 3.42515516 0.0100 30.1685
meanvarx 0.1300 0.0820 1.585 14.36923211 14.36923211 14.22696249 14.29621419 0.0100 0.0051
nvs03 0.0100 0.0270 --- 16.00000000 16.00000000 16.00000000 16.00000000 0.0000 0.0000
nvs10 0.0200 0.0170 --- -310.80000000 -310.80000000 -313.93939394 -313.20000000 0.0100 0.0077
o7 3600.0000 3600.4330 1.000 136.73131828 151.30711666 81.76346430 17.14651811 0.6723 7.8244
risk2bpb 2.0900 2.2250 0.939 -55.73616850 -55.87613939 -56.29916010 -55.87613940 0.0100 0.0000
st_e14 0.0600 0.1490 0.403 4.57958240 4.57958240 4.53424000 4.57958240 0.0100 0.0000
st_miqp1 0.0100 0.0310 --- 281.00000000 281.00000000 278.21782178 281.00000000 0.0100 0.0000
st_miqp2 0.0100 0.0440 --- 2.00000000 2.00000000 1.98019802 2.00000000 0.0100 0.0000
st_miqp3 0.0000 0.0080 --- -6.00000000 -6.00000000 -6.00000000 -6.00000000 0.0000 0.0000
st_miqp4 0.0000 0.0060 --- -4574.00000000 -4574.00000000 -4620.20202020 -4576.50000046 0.0100 0.0005
st_miqp5 0.0100 0.0120 --- -333.88888889 -333.88888889 -337.26150393 -333.88912112 0.0100 0.0000
st_test5 0.0200 0.0290 --- -110.00000000 -110.00000000 -111.11111111 -110.00000000 0.0100 0.0000
st_test6 0.0400 0.0370 --- 471.00000000 471.00000000 466.33663366 471.00000000 0.0100 0.0000
st_test8 0.0200 0.0290 --- -29605.00000000 -29605.00000000 -29904.04040400 -29605.00000296 0.0100 0.0000
st_testgr1 0.0200 1.4540 0.014 -12.73920000 -12.81160000 -12.86787879 -12.81270000 0.0100 0.0001
st_testgr3 0.2800 11.1490 0.025 -20.49105000 -20.59000000 -20.69803030 -20.59000000 0.0100 0.0000
st_testph4 0.0100 0.0110 --- -80.50000000 -80.50000000 -81.31313131 -80.50000000 0.0100 0.0000
stockcycle 12.9600 310.0830 0.042 120359.71333300 120532.62166667 119168.03300300 119931.67998801 0.0100 0.0050
synthes1 0.0100 0.0440 --- 6.00975891 6.00975902 5.95025634 6.00975891 0.0100 0.0000
synthes2 0.0200 0.5900 0.034 73.03533264 73.03531253 72.31221053 73.03531217 0.0100 0.0000
synthes3 0.0600 4.3810 0.014 68.01195780 68.00974052 67.33857208 68.00973640 0.0100 0.0000
tls12 3600.0000 3607.4790 --- mstat(13) sstat(13) mstat(14) sstat( 3) --- --- --- ---
tls6 3600.0000 3600.8170 1.000 16.40000000 20.70000003 8.11111111 1.65238095 1.0219 11.5274
tls7 3600.0000 3602.9820 0.999 17.20000000 22.50000000 1.77080649 0.25960290 8.7131 85.6708
mean 22.81 37.69 --- --- --- --- --- --- ---
unsolved 13.16% 15.79%         

Back to top