Solver Square Comparison: Considers all models.

Results created on 02/25/11 16:06:56 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver BONMIN_bonmin-hyb is represented on the left (rows) and solver DICOPT_dicopt-minlpconvex on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number Filename
Tracefile 1: MINLPconvex.BONMIN.bonmin-hyb.pav
Tracefile 2: MINLPconvex.DICOPT.dicopt-minlpconvex.pav
Solvers used : BONMIN_bonmin-hyb
DICOPT_dicopt-minlpconvex
Modeltype(s)   MINLP

DICOPT_dicopt-minlpconvex:
optimal
DICOPT_dicopt-minlpconvex:
locally optimal
DICOPT_dicopt-minlpconvex:
feasible
DICOPT_dicopt-minlpconvex:
infeasible
DICOPT_dicopt-minlpconvex:
unbounded
DICOPT_dicopt-minlpconvex:
fail
DICOPT_dicopt-minlpconvex:
no data
total BONMIN_bonmin-hyb
BONMIN_bonmin-hyb:
optimal
30 - 4 - - 8 - 42
BONMIN_bonmin-hyb:
locally optimal
- - - - - - - -
BONMIN_bonmin-hyb:
feasible
- - 3 - - 1 - 4
BONMIN_bonmin-hyb:
infeasible
- - - - - - - -
BONMIN_bonmin-hyb:
unbounded
- - - - - - - -
BONMIN_bonmin-hyb:
fail
1 - - - - - - 1
BONMIN_bonmin-hyb:
no data
- - - - - - - -
total DICOPT_dicopt-minlpconvex 31 - 7 - - 9 - 47

Solver return definitions:

Outcome Model Status Solver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other

Solver Resource Times


BONMIN_bonmin-hyb: optimal -- DICOPT_dicopt-minlpconvex: optimal    

Back to top

Modelname Time (BONMIN_bonmin-hyb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-hyb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-hyb) Obj (DICOPT_dicopt-minlpconvex)
BatchS101006M 18.9740 11.7850 1.610 769440.00000000 769440.00000000
BatchS121208M 56.5990 6.5710 8.613 1241130.00000000 1241130.00000000
BatchS151208M 59.9860 11.1520 5.379 1543470.00000000 1543470.00000000
BatchS201210M 182.6540 8.2760 22.070 2295350.00000000 2295350.00000000
clay0303h 6.8460 74.3480 0.092 26669.10000000 26669.10000000
clay0305h 64.7660 454.4820 0.143 8092.50000000 8092.50000000
clay0305m 15.5700 696.0040 0.022 8092.50000000 8092.50000000
FLay04H 35.7110 450.4510 0.079 54.40590000 54.40590000
m6 9.1820 0.4920 18.663 82.25690000 82.25690000
m7 44.2190 0.8910 49.629 106.75700000 106.75700000
RSyn0805H 0.6990 0.1920 3.641 1296.12000000 1296.12000000
RSyn0805M02M 56.3000 3.8910 14.469 2238.40000000 2238.40000000
RSyn0805M03M 90.6620 7.9580 11.393 3068.93000000 3068.93000000
RSyn0810M02M 93.3340 5.2570 17.754 1741.39000000 1741.39000000
RSyn0810M03M 182.2310 12.4010 14.695 2722.45000000 2722.45000000
RSyn0820M 3.9910 0.2560 15.590 1150.30000000 1150.30000000
RSyn0830M04H 18.8840 5.3350 3.540 2529.07000000 2529.07000000
RSyn0830M 5.3450 0.5680 9.410 510.07200000 510.07200000
RSyn0840M 4.0740 0.4160 9.793 325.55500000 325.55500000
SLay06H 43.0890 5.9210 7.277 32757.00000000 32757.00000000
SLay07H 65.0440 22.9680 2.832 64748.80000000 64748.80000000
SLay08H 160.1740 430.5600 0.372 84960.20000000 84960.20000000
SLay09M 35.1580 1743.2000 0.020 107806.00000000 107806.00000000
Syn15M04M 2.4350 0.2200 11.068 4937.48000000 4937.48000000
Syn20M03M 1.5150 0.1520 9.967 2646.95000000 2646.95000000
Syn20M04M 6.0280 0.2140 28.168 3532.74000000 3532.74000000
Syn30M02M 2.1440 0.2620 8.183 399.68300000 399.68300000
Syn40M03H 4.7770 1.1550 4.136 395.14900000 395.14900000
Syn40M 0.5890 0.1550 3.800 67.71330000 67.71330000
sssd-10-4-3 1.5680 2.9150 0.538 152710.00000000 152710.00000000

Back to top


BONMIN_bonmin-hyb: optimal -- DICOPT_dicopt-minlpconvex: feasible    

Back to top

Modelname Time (BONMIN_bonmin-hyb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-hyb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-hyb) Obj (DICOPT_dicopt-minlpconvex)
clay0304h 69.1840 3719.4300 0.019 40262.40000000 59328.70000000
FLay05H 302.4860 3935.9300 0.077 64.49810000 64.49810000
fo7_2 82.4550 3643.2600 0.023 17.74930000 29.15300000
SLay10M 229.2490 3694.7100 0.062 129582.00000000 134056.00000000

Back to top


BONMIN_bonmin-hyb: optimal -- DICOPT_dicopt-minlpconvex: fail    

Back to top

Modelname Time (BONMIN_bonmin-hyb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-hyb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-hyb) Status (DICOPT_dicopt-minlpconvex)
clay0304m 12.3160 2565.5800 --- 40262.40000000 mstat(13)sstat(13)
FLay05M 94.3820 4063.5800 --- 64.49810000 mstat(13)sstat(13)
fo7 133.7430 148.4970 --- 20.72980000 mstat(13)sstat(13)
fo8 1010.1000 605.8660 --- 22.38190000 mstat(13)sstat(13)
o7_2 689.4210 3613.2200 --- 116.94600000 mstat(13)sstat(13)
SLay09H 294.0040 3640.7200 --- 107806.00000000 mstat(13)sstat(13)
sssd-12-5-3 18.5690 10.6230 --- 261143.00000000 mstat( 7)sstat( 1)
sssd-15-6-3 104.8710 132.5540 --- 440711.00000000 mstat( 7)sstat( 1)

Back to top


BONMIN_bonmin-hyb: feasible -- DICOPT_dicopt-minlpconvex: feasible    

Back to top

Modelname Time (BONMIN_bonmin-hyb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-hyb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-hyb) Obj (DICOPT_dicopt-minlpconvex)
FLay06M 3645.6700 3629.3900 1.004 66.93280000 66.93280000
uflquad-30-100 3613.8700 3633.2300 0.995 361.91700000 463.87200000
uflquad-40-80 3649.4600 3634.1200 1.004 1404.99000000 457.97000000

Back to top


BONMIN_bonmin-hyb: feasible -- DICOPT_dicopt-minlpconvex: fail    

Back to top

Modelname Time (BONMIN_bonmin-hyb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-hyb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-hyb) Status (DICOPT_dicopt-minlpconvex)
uflquad-20-150 3607.4200 345.8900 --- 588.81000000 mstat(13)sstat(13)

Back to top


BONMIN_bonmin-hyb: fail -- DICOPT_dicopt-minlpconvex: optimal    

Back to top

Modelname Time (BONMIN_bonmin-hyb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-hyb/DICOPT_dicopt-minlpconvex) Status (BONMIN_bonmin-hyb) Obj (DICOPT_dicopt-minlpconvex)
RSyn0805M04M 64.4320 8.7990 --- mstat( 7)sstat( 1) 7174.22000000

Back to top


BONMIN_bonmin-hyb: optimal:

Back to top

Modelname Time (BONMIN_bonmin-hyb) Obj (BONMIN_bonmin-hyb)
BatchS101006M 18.9740 769440.00000000
BatchS121208M 56.5990 1241130.00000000
BatchS151208M 59.9860 1543470.00000000
BatchS201210M 182.6540 2295350.00000000
clay0303h 6.8460 26669.10000000
clay0304h 69.1840 40262.40000000
clay0304m 12.3160 40262.40000000
clay0305h 64.7660 8092.50000000
clay0305m 15.5700 8092.50000000
FLay04H 35.7110 54.40590000
FLay05H 302.4860 64.49810000
FLay05M 94.3820 64.49810000
fo7_2 82.4550 17.74930000
fo7 133.7430 20.72980000
fo8 1010.1000 22.38190000
m6 9.1820 82.25690000
m7 44.2190 106.75700000
o7_2 689.4210 116.94600000
RSyn0805H 0.6990 1296.12000000
RSyn0805M02M 56.3000 2238.40000000
RSyn0805M03M 90.6620 3068.93000000
RSyn0810M02M 93.3340 1741.39000000
RSyn0810M03M 182.2310 2722.45000000
RSyn0820M 3.9910 1150.30000000
RSyn0830M04H 18.8840 2529.07000000
RSyn0830M 5.3450 510.07200000
RSyn0840M 4.0740 325.55500000
SLay06H 43.0890 32757.00000000
SLay07H 65.0440 64748.80000000
SLay08H 160.1740 84960.20000000
SLay09H 294.0040 107806.00000000
SLay09M 35.1580 107806.00000000
SLay10M 229.2490 129582.00000000
Syn15M04M 2.4350 4937.48000000
Syn20M03M 1.5150 2646.95000000
Syn20M04M 6.0280 3532.74000000
Syn30M02M 2.1440 399.68300000
Syn40M03H 4.7770 395.14900000
Syn40M 0.5890 67.71330000
sssd-10-4-3 1.5680 152710.00000000
sssd-12-5-3 18.5690 261143.00000000
sssd-15-6-3 104.8710 440711.00000000

Back to top


BONMIN_bonmin-hyb: feasible:

Back to top

Modelname Time (BONMIN_bonmin-hyb) Obj (BONMIN_bonmin-hyb)
FLay06M 3645.6700 66.93280000
uflquad-20-150 3607.4200 588.81000000
uflquad-30-100 3613.8700 361.91700000
uflquad-40-80 3649.4600 1404.99000000

Back to top


BONMIN_bonmin-hyb: fail:

Back to top

Modelname Time (BONMIN_bonmin-hyb) Status (BONMIN_bonmin-hyb)
RSyn0805M04M -- mstat( 7) sstat( 1)

Back to top


DICOPT_dicopt-minlpconvex: optimal:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Obj (DICOPT_dicopt-minlpconvex)
BatchS101006M 11.7850 769440.00000000
BatchS121208M 6.5710 1241130.00000000
BatchS151208M 11.1520 1543470.00000000
BatchS201210M 8.2760 2295350.00000000
clay0303h 74.3480 26669.10000000
clay0305h 454.4820 8092.50000000
clay0305m 696.0040 8092.50000000
FLay04H 450.4510 54.40590000
m6 0.4920 82.25690000
m7 0.8910 106.75700000
RSyn0805H 0.1920 1296.12000000
RSyn0805M02M 3.8910 2238.40000000
RSyn0805M03M 7.9580 3068.93000000
RSyn0805M04M 8.7990 7174.22000000
RSyn0810M02M 5.2570 1741.39000000
RSyn0810M03M 12.4010 2722.45000000
RSyn0820M 0.2560 1150.30000000
RSyn0830M04H 5.3350 2529.07000000
RSyn0830M 0.5680 510.07200000
RSyn0840M 0.4160 325.55500000
SLay06H 5.9210 32757.00000000
SLay07H 22.9680 64748.80000000
SLay08H 430.5600 84960.20000000
SLay09M 1743.2000 107806.00000000
Syn15M04M 0.2200 4937.48000000
Syn20M03M 0.1520 2646.95000000
Syn20M04M 0.2140 3532.74000000
Syn30M02M 0.2620 399.68300000
Syn40M03H 1.1550 395.14900000
Syn40M 0.1550 67.71330000
sssd-10-4-3 2.9150 152710.00000000

Back to top

DICOPT_dicopt-minlpconvex: feasible:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Obj (DICOPT_dicopt-minlpconvex)
clay0304h 3719.4300 59328.70000000
FLay05H 3935.9300 64.49810000
FLay06M 3629.3900 66.93280000
fo7_2 3643.2600 29.15300000
SLay10M 3694.7100 134056.00000000
uflquad-30-100 3633.2300 463.87200000
uflquad-40-80 3634.1200 457.97000000

Back to top

DICOPT_dicopt-minlpconvex: fail:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Status (DICOPT_dicopt-minlpconvex)
clay0304m -- mstat(13)sstat(13)
FLay05M -- mstat(13)sstat(13)
fo7 -- mstat(13)sstat(13)
fo8 -- mstat(13)sstat(13)
o7_2 -- mstat(13)sstat(13)
SLay09H -- mstat(13)sstat(13)
sssd-12-5-3 -- mstat( 7)sstat( 1)
sssd-15-6-3 -- mstat( 7)sstat( 1)
uflquad-20-150 -- mstat(13)sstat(13)

Back to top

BONMIN_bonmin-hyb: all -- DICOPT_dicopt-minlpconvex: all

Back to top

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (4063.58 seconds). The shift is 10s.

Modelname Time (BONMIN_bonmin-hyb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-hyb/ DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-hyb) Obj (DICOPT_dicopt-minlpconvex) ObjEst (BONMIN_bonmin-hyb) ObjEst (DICOPT_dicopt-minlpconvex) Gap (BONMIN_bonmin-hyb) Gap (DICOPT_dicopt-minlpconvex)
BatchS101006M 18.9740 11.7850 1.610 769440.00000000 769440.00000000 769440.00000000 769440.00000000 0.0000 0.0000
BatchS121208M 56.5990 6.5710 8.613 1241130.00000000 1241130.00000000 1241130.00000000 1241130.00000000 0.0000 0.0000
BatchS151208M 59.9860 11.1520 5.379 1543470.00000000 1543470.00000000 1543470.00000000 1543470.00000000 0.0000 0.0000
BatchS201210M 182.6540 8.2760 22.070 2295350.00000000 2295350.00000000 2295350.00000000 2295350.00000000 0.0000 0.0000
clay0303h 6.8460 74.3480 0.092 26669.10000000 26669.10000000 26669.10000000 26669.10000000 0.0000 0.0000
clay0304h 69.1840 3719.4300 0.019 40262.40000000 59328.70000000 40262.40000000 -1.0000000000000E+20 0.0000 1.0000
clay0304m 12.3160 2565.5800 --- 40262.40000000 mstat(13) sstat(13) 40262.40000000 --- 0.0000 ---
clay0305h 64.7660 454.4820 0.143 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
clay0305m 15.5700 696.0040 0.022 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
FLay04H 35.7110 450.4510 0.079 54.40590000 54.40590000 54.40590000 54.40590000 0.0000 0.0000
FLay05H 302.4860 3935.9300 0.077 64.49810000 64.49810000 64.49810000 -1.0000000000000E+20 0.0000 1.0000
FLay05M 94.3820 4063.5800 --- 64.49810000 mstat(13) sstat(13) 64.49810000 --- 0.0000 ---
FLay06M 3645.6700 3629.3900 1.004 66.93280000 66.93280000 64.48520000 -1.0000000000000E+20 0.0380 1.0000
fo7_2 82.4550 3643.2600 0.023 17.74930000 29.15300000 17.74930000 -1.0000000000000E+20 0.0000 1.0000
fo7 133.7430 148.4970 --- 20.72980000 mstat(13) sstat(13) 20.72980000 --- 0.0000 ---
fo8 1010.1000 605.8660 --- 22.38190000 mstat(13) sstat(13) 22.38190000 --- 0.0000 ---
m6 9.1820 0.4920 18.663 82.25690000 82.25690000 82.25690000 82.25690000 0.0000 0.0000
m7 44.2190 0.8910 49.629 106.75700000 106.75700000 106.75700000 106.75700000 0.0000 0.0000
o7_2 689.4210 3613.2200 --- 116.94600000 mstat(13) sstat(13) 116.94600000 --- 0.0000 ---
RSyn0805H (max) 0.6990 0.1920 3.641 1296.12000000 1296.12000000 1296.12000000 1296.12000000 0.0000 0.0000
RSyn0805M02M (max) 56.3000 3.8910 14.469 2238.40000000 2238.40000000 2238.40000000 2238.40000000 0.0000 0.0000
RSyn0805M03M (max) 90.6620 7.9580 11.393 3068.93000000 3068.93000000 3068.93000000 3068.93000000 0.0000 0.0000
RSyn0805M04M (max) 64.4320 8.7990 --- mstat( 7) sstat(1) 7174.22000000 --- 7174.22000000 --- 0.0000
RSyn0810M02M (max) 93.3340 5.2570 17.754 1741.39000000 1741.39000000 1741.39000000 1741.39000000 0.0000 0.0000
RSyn0810M03M (max) 182.2310 12.4010 14.695 2722.45000000 2722.45000000 2722.45000000 2722.45000000 0.0000 0.0000
RSyn0820M (max) 3.9910 0.2560 15.590 1150.30000000 1150.30000000 1150.30000000 1150.30000000 0.0000 0.0000
RSyn0830M04H (max) 18.8840 5.3350 3.540 2529.07000000 2529.07000000 2529.07000000 2529.07000000 0.0000 0.0000
RSyn0830M (max) 5.3450 0.5680 9.410 510.07200000 510.07200000 510.07200000 510.07200000 0.0000 0.0000
RSyn0840M (max) 4.0740 0.4160 9.793 325.55500000 325.55500000 325.55500000 325.55500000 0.0000 0.0000
SLay06H 43.0890 5.9210 7.277 32757.00000000 32757.00000000 32757.00000000 32757.00000000 0.0000 0.0000
SLay07H 65.0440 22.9680 2.832 64748.80000000 64748.80000000 64748.80000000 64748.80000000 0.0000 0.0000
SLay08H 160.1740 430.5600 0.372 84960.20000000 84960.20000000 84960.20000000 84960.20000000 0.0000 0.0000
SLay09H 294.0040 3640.7200 --- 107806.00000000 mstat(13) sstat(13) 107806.00000000 --- 0.0000 ---
SLay09M 35.1580 1743.2000 0.020 107806.00000000 107806.00000000 107806.00000000 107806.00000000 0.0000 0.0000
SLay10M 229.2490 3694.7100 0.062 129582.00000000 134056.00000000 129582.00000000 -1.0000000000000E+20 0.0000 1.0000
Syn15M04M (max) 2.4350 0.2200 11.068 4937.48000000 4937.48000000 4937.48000000 4937.48000000 0.0000 0.0000
Syn20M03M (max) 1.5150 0.1520 9.967 2646.95000000 2646.95000000 2646.95000000 2646.95000000 0.0000 0.0000
Syn20M04M (max) 6.0280 0.2140 28.168 3532.74000000 3532.74000000 3532.74000000 3532.74000000 0.0000 0.0000
Syn30M02M (max) 2.1440 0.2620 8.183 399.68300000 399.68300000 399.68300000 399.68300000 0.0000 0.0000
Syn40M03H (max) 4.7770 1.1550 4.136 395.14900000 395.14900000 395.14900000 395.14900000 0.0000 0.0000
Syn40M (max) 0.5890 0.1550 3.800 67.71330000 67.71330000 67.71330000 67.71330000 0.0000 0.0000
sssd-10-4-3 1.5680 2.9150 0.538 152710.00000000 152710.00000000 152710.00000000 152710.00000000 0.0000 0.0000
sssd-12-5-3 18.5690 10.6230 --- 261143.00000000 mstat( 7) sstat(1) 261143.00000000 --- 0.0000 ---
sssd-15-6-3 104.8710 132.5540 --- 440711.00000000 mstat( 7) sstat(1) 440711.00000000 --- 0.0000 ---
uflquad-20-150 3607.4200 345.8900 --- 588.81000000 mstat(13) sstat(13) 250.95000000 --- 1.3463 ---
uflquad-30-100 3613.8700 3633.2300 0.995 361.91700000 463.87200000 161.84600000 -1.0000000000000E+20 1.2362 1.0000
uflquad-40-80 3649.4600 3634.1200 1.004 1404.99000000 457.97000000 103.07000000 -1.0000000000000E+20 12.6314 1.0000
Shifted Geometric Mean
(Solved)
72.39 140.38              
% Unsolved 10.64% 34.04%         

Back to top