Solver Square Comparison: Considers all models.

Results created on 02/25/11 16:06:55 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver BONMIN_bonmin-bb is represented on the left (rows) and solver DICOPT_dicopt-minlpconvex on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number Filename
Tracefile 1: MINLPconvex.BONMIN.bonmin-bb.pav
Tracefile 2: MINLPconvex.DICOPT.dicopt-minlpconvex.pav
Solvers used : BONMIN_bonmin-bb
DICOPT_dicopt-minlpconvex
Modeltype(s)   MINLP

DICOPT_dicopt-minlpconvex:
optimal
DICOPT_dicopt-minlpconvex:
locally optimal
DICOPT_dicopt-minlpconvex:
feasible
DICOPT_dicopt-minlpconvex:
infeasible
DICOPT_dicopt-minlpconvex:
unbounded
DICOPT_dicopt-minlpconvex:
fail
DICOPT_dicopt-minlpconvex:
no data
total BONMIN_bonmin-bb
BONMIN_bonmin-bb:
optimal
18 - 4 - - 6 - 28
BONMIN_bonmin-bb:
locally optimal
- - - - - - - -
BONMIN_bonmin-bb:
feasible
12 - 3 - - 3 - 18
BONMIN_bonmin-bb:
infeasible
- - - - - - - -
BONMIN_bonmin-bb:
unbounded
- - - - - - - -
BONMIN_bonmin-bb:
fail
1 - - - - - - 1
BONMIN_bonmin-bb:
no data
- - - - - - - -
total DICOPT_dicopt-minlpconvex 31 - 7 - - 9 - 47

Solver return definitions:

Outcome Model Status Solver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other

Solver Resource Times


BONMIN_bonmin-bb: optimal -- DICOPT_dicopt-minlpconvex: optimal    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-bb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-bb) Obj (DICOPT_dicopt-minlpconvex)
BatchS101006M 22.7760 11.7850 1.933 769440.00000000 769440.00000000
BatchS121208M 44.9290 6.5710 6.837 1241130.00000000 1241130.00000000
BatchS151208M 138.4870 11.1520 12.418 1543470.00000000 1543470.00000000
BatchS201210M 181.7730 8.2760 21.964 2295350.00000000 2295350.00000000
clay0303h 28.7740 74.3480 0.387 26669.10000000 26669.10000000
clay0305m 900.8890 696.0040 1.294 8092.50000000 8092.50000000
FLay04H 48.0610 450.4510 0.107 54.40590000 54.40590000
m6 494.4440 0.4920 1004.967 82.25690000 82.25690000
RSyn0805H 3.1030 0.1920 16.161 1296.12000000 1296.12000000
RSyn0830M04H 337.7570 5.3350 63.310 2529.07000000 2529.07000000
SLay06H 4.1570 5.9210 0.702 32757.00000000 32757.00000000
SLay07H 68.4250 22.9680 2.979 64748.80000000 64748.80000000
SLay08H 71.0830 430.5600 0.165 84960.20000000 84960.20000000
SLay09M 8.6660 1743.2000 0.005 107806.00000000 107806.00000000
Syn15M04M 260.6110 0.2200 1184.595 4937.48000000 4937.48000000
Syn40M03H 22.1460 1.1550 19.174 395.14900000 395.14900000
Syn40M 1153.7900 0.1550 7443.806 67.71330000 67.71330000
sssd-10-4-3 14.2500 2.9150 4.889 152710.00000000 152710.00000000

Back to top


BONMIN_bonmin-bb: optimal -- DICOPT_dicopt-minlpconvex: feasible    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-bb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-bb) Obj (DICOPT_dicopt-minlpconvex)
clay0304h 197.5510 3719.4300 0.053 40262.40000000 59328.70000000
FLay05H 2894.0300 3935.9300 0.735 64.49810000 64.49810000
SLay10M 100.3260 3694.7100 0.027 129580.00000000 134056.00000000
uflquad-30-100 540.4610 3633.2300 0.149 361.91700000 463.87200000

Back to top


BONMIN_bonmin-bb: optimal -- DICOPT_dicopt-minlpconvex: fail    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-bb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-bb) Status (DICOPT_dicopt-minlpconvex)
clay0304m 87.6430 2565.5800 --- 40262.40000000 mstat(13)sstat(13)
FLay05M 549.2450 4063.5800 --- 64.49810000 mstat(13)sstat(13)
SLay09H 85.6580 3640.7200 --- 107806.00000000 mstat(13)sstat(13)
sssd-12-5-3 61.0080 10.6230 --- 261143.00000000 mstat( 7)sstat( 1)
sssd-15-6-3 273.2360 132.5540 --- 440711.00000000 mstat( 7)sstat( 1)
uflquad-20-150 371.6570 345.8900 --- 550.11200000 mstat(13)sstat(13)

Back to top


BONMIN_bonmin-bb: feasible -- DICOPT_dicopt-minlpconvex: optimal    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-bb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-bb) Obj (DICOPT_dicopt-minlpconvex)
clay0305h 3616.8200 454.4820 7.958 8102.00000000 8092.50000000
m7 3643.9700 0.8910 4089.753 130.75700000 106.75700000
RSyn0805M02M 3654.7200 3.8910 939.275 2238.06000000 2238.40000000
RSyn0805M03M 3641.6500 7.9580 457.609 3068.83000000 3068.93000000
RSyn0805M04M 3622.5600 8.7990 411.701 7171.22000000 7174.22000000
RSyn0810M02M 3659.7600 5.2570 696.169 1723.03000000 1741.39000000
RSyn0810M03M 3660.7800 12.4010 295.200 2695.73000000 2722.45000000
RSyn0820M 3661.9600 0.2560 14304.531 1150.30000000 1150.30000000
RSyn0830M 3624.1000 0.5680 6380.458 509.93700000 510.07200000
RSyn0840M 3659.7300 0.4160 8797.428 318.55500000 325.55500000
Syn20M04M 3654.3400 0.2140 17076.355 3517.74000000 3532.74000000
Syn30M02M 3664.5900 0.2620 13986.985 381.68300000 399.68300000

Back to top


BONMIN_bonmin-bb: feasible -- DICOPT_dicopt-minlpconvex: feasible    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-bb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-bb) Obj (DICOPT_dicopt-minlpconvex)
FLay06M 3650.6700 3629.3900 1.006 66.93280000 66.93280000
fo7_2 3658.2500 3643.2600 1.004 18.52120000 29.15300000
uflquad-40-80 3620.7600 3634.1200 0.996 348.14600000 457.97000000

Back to top


BONMIN_bonmin-bb: feasible -- DICOPT_dicopt-minlpconvex: fail    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-bb/DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-bb) Status (DICOPT_dicopt-minlpconvex)
fo7 3662.9400 148.4970 --- 24.99370000 mstat(13)sstat(13)
fo8 3659.7200 605.8660 --- 32.36270000 mstat(13)sstat(13)
o7_2 3660.6100 3613.2200 --- 134.01600000 mstat(13)sstat(13)

Back to top


BONMIN_bonmin-bb: fail -- DICOPT_dicopt-minlpconvex: optimal    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-bb/DICOPT_dicopt-minlpconvex) Status (BONMIN_bonmin-bb) Obj (DICOPT_dicopt-minlpconvex)
Syn20M03M 3646.6500 0.1520 --- mstat( 7)sstat( 1) 2646.95000000

Back to top


BONMIN_bonmin-bb: optimal:

Back to top

Modelname Time (BONMIN_bonmin-bb) Obj (BONMIN_bonmin-bb)
BatchS101006M 22.7760 769440.00000000
BatchS121208M 44.9290 1241130.00000000
BatchS151208M 138.4870 1543470.00000000
BatchS201210M 181.7730 2295350.00000000
clay0303h 28.7740 26669.10000000
clay0304h 197.5510 40262.40000000
clay0304m 87.6430 40262.40000000
clay0305m 900.8890 8092.50000000
FLay04H 48.0610 54.40590000
FLay05H 2894.0300 64.49810000
FLay05M 549.2450 64.49810000
m6 494.4440 82.25690000
RSyn0805H 3.1030 1296.12000000
RSyn0830M04H 337.7570 2529.07000000
SLay06H 4.1570 32757.00000000
SLay07H 68.4250 64748.80000000
SLay08H 71.0830 84960.20000000
SLay09H 85.6580 107806.00000000
SLay09M 8.6660 107806.00000000
SLay10M 100.3260 129580.00000000
Syn15M04M 260.6110 4937.48000000
Syn40M03H 22.1460 395.14900000
Syn40M 1153.7900 67.71330000
sssd-10-4-3 14.2500 152710.00000000
sssd-12-5-3 61.0080 261143.00000000
sssd-15-6-3 273.2360 440711.00000000
uflquad-20-150 371.6570 550.11200000
uflquad-30-100 540.4610 361.91700000

Back to top


BONMIN_bonmin-bb: feasible:

Back to top

Modelname Time (BONMIN_bonmin-bb) Obj (BONMIN_bonmin-bb)
clay0305h 3616.8200 8102.00000000
FLay06M 3650.6700 66.93280000
fo7_2 3658.2500 18.52120000
fo7 3662.9400 24.99370000
fo8 3659.7200 32.36270000
m7 3643.9700 130.75700000
o7_2 3660.6100 134.01600000
RSyn0805M02M 3654.7200 2238.06000000
RSyn0805M03M 3641.6500 3068.83000000
RSyn0805M04M 3622.5600 7171.22000000
RSyn0810M02M 3659.7600 1723.03000000
RSyn0810M03M 3660.7800 2695.73000000
RSyn0820M 3661.9600 1150.30000000
RSyn0830M 3624.1000 509.93700000
RSyn0840M 3659.7300 318.55500000
Syn20M04M 3654.3400 3517.74000000
Syn30M02M 3664.5900 381.68300000
uflquad-40-80 3620.7600 348.14600000

Back to top


BONMIN_bonmin-bb: fail:

Back to top

Modelname Time (BONMIN_bonmin-bb) Status (BONMIN_bonmin-bb)
Syn20M03M -- mstat( 7) sstat( 1)

Back to top


DICOPT_dicopt-minlpconvex: optimal:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Obj (DICOPT_dicopt-minlpconvex)
BatchS101006M 11.7850 769440.00000000
BatchS121208M 6.5710 1241130.00000000
BatchS151208M 11.1520 1543470.00000000
BatchS201210M 8.2760 2295350.00000000
clay0303h 74.3480 26669.10000000
clay0305h 454.4820 8092.50000000
clay0305m 696.0040 8092.50000000
FLay04H 450.4510 54.40590000
m6 0.4920 82.25690000
m7 0.8910 106.75700000
RSyn0805H 0.1920 1296.12000000
RSyn0805M02M 3.8910 2238.40000000
RSyn0805M03M 7.9580 3068.93000000
RSyn0805M04M 8.7990 7174.22000000
RSyn0810M02M 5.2570 1741.39000000
RSyn0810M03M 12.4010 2722.45000000
RSyn0820M 0.2560 1150.30000000
RSyn0830M04H 5.3350 2529.07000000
RSyn0830M 0.5680 510.07200000
RSyn0840M 0.4160 325.55500000
SLay06H 5.9210 32757.00000000
SLay07H 22.9680 64748.80000000
SLay08H 430.5600 84960.20000000
SLay09M 1743.2000 107806.00000000
Syn15M04M 0.2200 4937.48000000
Syn20M03M 0.1520 2646.95000000
Syn20M04M 0.2140 3532.74000000
Syn30M02M 0.2620 399.68300000
Syn40M03H 1.1550 395.14900000
Syn40M 0.1550 67.71330000
sssd-10-4-3 2.9150 152710.00000000

Back to top

DICOPT_dicopt-minlpconvex: feasible:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Obj (DICOPT_dicopt-minlpconvex)
clay0304h 3719.4300 59328.70000000
FLay05H 3935.9300 64.49810000
FLay06M 3629.3900 66.93280000
fo7_2 3643.2600 29.15300000
SLay10M 3694.7100 134056.00000000
uflquad-30-100 3633.2300 463.87200000
uflquad-40-80 3634.1200 457.97000000

Back to top

DICOPT_dicopt-minlpconvex: fail:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Status (DICOPT_dicopt-minlpconvex)
clay0304m -- mstat(13)sstat(13)
FLay05M -- mstat(13)sstat(13)
fo7 -- mstat(13)sstat(13)
fo8 -- mstat(13)sstat(13)
o7_2 -- mstat(13)sstat(13)
SLay09H -- mstat(13)sstat(13)
sssd-12-5-3 -- mstat( 7)sstat( 1)
sssd-15-6-3 -- mstat( 7)sstat( 1)
uflquad-20-150 -- mstat(13)sstat(13)

Back to top

BONMIN_bonmin-bb: all -- DICOPT_dicopt-minlpconvex: all

Back to top

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (4063.58 seconds). The shift is 10s.

Modelname Time (BONMIN_bonmin-bb) Time (DICOPT_dicopt-minlpconvex) Ratio (BONMIN_bonmin-bb/ DICOPT_dicopt-minlpconvex) Obj (BONMIN_bonmin-bb) Obj (DICOPT_dicopt-minlpconvex) ObjEst (BONMIN_bonmin-bb) ObjEst (DICOPT_dicopt-minlpconvex) Gap (BONMIN_bonmin-bb) Gap (DICOPT_dicopt-minlpconvex)
BatchS101006M 22.7760 11.7850 1.933 769440.00000000 769440.00000000 769440.00000000 769440.00000000 0.0000 0.0000
BatchS121208M 44.9290 6.5710 6.837 1241130.00000000 1241130.00000000 1241130.00000000 1241130.00000000 0.0000 0.0000
BatchS151208M 138.4870 11.1520 12.418 1543470.00000000 1543470.00000000 1543470.00000000 1543470.00000000 0.0000 0.0000
BatchS201210M 181.7730 8.2760 21.964 2295350.00000000 2295350.00000000 2295350.00000000 2295350.00000000 0.0000 0.0000
clay0303h 28.7740 74.3480 0.387 26669.10000000 26669.10000000 26669.10000000 26669.10000000 0.0000 0.0000
clay0304h 197.5510 3719.4300 0.053 40262.40000000 59328.70000000 40262.40000000 -1.0000000000000E+20 0.0000 1.0000
clay0304m 87.6430 2565.5800 --- 40262.40000000 mstat(13) sstat(13) 40262.40000000 --- 0.0000 ---
clay0305h 3616.8200 454.4820 7.958 8102.00000000 8092.50000000 7950.00000000 8092.50000000 0.0191 0.0000
clay0305m 900.8890 696.0040 1.294 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
FLay04H 48.0610 450.4510 0.107 54.40590000 54.40590000 54.40590000 54.40590000 0.0000 0.0000
FLay05H 2894.0300 3935.9300 0.735 64.49810000 64.49810000 64.49810000 -1.0000000000000E+20 0.0000 1.0000
FLay05M 549.2450 4063.5800 --- 64.49810000 mstat(13) sstat(13) 64.49810000 --- 0.0000 ---
FLay06M 3650.6700 3629.3900 1.006 66.93280000 66.93280000 64.49810000 -1.0000000000000E+20 0.0377 1.0000
fo7_2 3658.2500 3643.2600 1.004 18.52120000 29.15300000 8.95940000 -1.0000000000000E+20 1.0672 1.0000
fo7 3662.9400 148.4970 --- 24.99370000 mstat(13) sstat(13) 8.47036000 --- 1.9507 ---
fo8 3659.7200 605.8660 --- 32.36270000 mstat(13) sstat(13) 9.13875000 --- 2.5413 ---
m6 494.4440 0.4920 1004.967 82.25690000 82.25690000 82.25690000 82.25690000 0.0000 0.0000
m7 3643.9700 0.8910 4089.753 130.75700000 106.75700000 44.90410000 106.75700000 1.9119 0.0000
o7_2 3660.6100 3613.2200 --- 134.01600000 mstat(13) sstat(13) 29.82670000 --- 3.4932 ---
RSyn0805H (max) 3.1030 0.1920 16.161 1296.12000000 1296.12000000 1296.12000000 1296.12000000 0.0000 0.0000
RSyn0805M02M (max) 3654.7200 3.8910 939.275 2238.06000000 2238.40000000 2310.14000000 2238.40000000 0.0312 0.0000
RSyn0805M03M (max) 3641.6500 7.9580 457.609 3068.83000000 3068.93000000 3293.88000000 3068.93000000 0.0683 0.0000
RSyn0805M04M (max) 3622.5600 8.7990 411.701 7171.22000000 7174.22000000 7651.92000000 7174.22000000 0.0628 0.0000
RSyn0810M02M (max) 3659.7600 5.2570 696.169 1723.03000000 1741.39000000 3051.60000000 1741.39000000 0.4354 0.0000
RSyn0810M03M (max) 3660.7800 12.4010 295.200 2695.73000000 2722.45000000 4040.11000000 2722.45000000 0.3328 0.0000
RSyn0820M (max) 3661.9600 0.2560 14304.531 1150.30000000 1150.30000000 1264.78000000 1150.30000000 0.0905 0.0000
RSyn0830M04H (max) 337.7570 5.3350 63.310 2529.07000000 2529.07000000 2529.07000000 2529.07000000 0.0000 0.0000
RSyn0830M (max) 3624.1000 0.5680 6380.458 509.93700000 510.07200000 641.69000000 510.07200000 0.2053 0.0000
RSyn0840M (max) 3659.7300 0.4160 8797.428 318.55500000 325.55500000 777.04800000 325.55500000 0.5900 0.0000
SLay06H 4.1570 5.9210 0.702 32757.00000000 32757.00000000 32757.00000000 32757.00000000 0.0000 0.0000
SLay07H 68.4250 22.9680 2.979 64748.80000000 64748.80000000 64748.80000000 64748.80000000 0.0000 0.0000
SLay08H 71.0830 430.5600 0.165 84960.20000000 84960.20000000 84960.20000000 84960.20000000 0.0000 0.0000
SLay09H 85.6580 3640.7200 --- 107806.00000000 mstat(13) sstat(13) 107806.00000000 --- 0.0000 ---
SLay09M 8.6660 1743.2000 0.005 107806.00000000 107806.00000000 107806.00000000 107806.00000000 0.0000 0.0000
SLay10M 100.3260 3694.7100 0.027 129580.00000000 134056.00000000 129580.00000000 -1.0000000000000E+20 0.0000 1.0000
Syn15M04M (max) 260.6110 0.2200 1184.595 4937.48000000 4937.48000000 4937.48000000 4937.48000000 0.0000 0.0000
Syn20M03M (max) 3646.6500 0.1520 --- mstat( 7) sstat(1) 2646.95000000 --- 2646.95000000 --- 0.0000
Syn20M04M (max) 3654.3400 0.2140 17076.355 3517.74000000 3532.74000000 4524.25000000 3532.74000000 0.2225 0.0000
Syn30M02M (max) 3664.5900 0.2620 13986.985 381.68300000 399.68300000 642.30300000 399.68300000 0.4058 0.0000
Syn40M03H (max) 22.1460 1.1550 19.174 395.14900000 395.14900000 395.14900000 395.14900000 0.0000 0.0000
Syn40M (max) 1153.7900 0.1550 7443.806 67.71330000 67.71330000 67.71330000 67.71330000 0.0000 0.0000
sssd-10-4-3 14.2500 2.9150 4.889 152710.00000000 152710.00000000 152710.00000000 152710.00000000 0.0000 0.0000
sssd-12-5-3 61.0080 10.6230 --- 261143.00000000 mstat( 7) sstat(1) 261143.00000000 --- 0.0000 ---
sssd-15-6-3 273.2360 132.5540 --- 440711.00000000 mstat( 7) sstat(1) 440711.00000000 --- 0.0000 ---
uflquad-20-150 371.6570 345.8900 --- 550.11200000 mstat(13) sstat(13) 550.11200000 --- 0.0000 ---
uflquad-30-100 540.4610 3633.2300 0.149 361.91700000 463.87200000 361.91700000 -1.0000000000000E+20 0.0000 1.0000
uflquad-40-80 3620.7600 3634.1200 0.996 348.14600000 457.97000000 311.97000000 -1.0000000000000E+20 0.1160 1.0000
Shifted Geometric Mean
(Solved)
512.62 140.38              
% Unsolved 40.43% 34.04%         

Back to top