Solver Square Comparison: Considers all models.

Results created on 02/25/11 16:06:54 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver ALPHAECP_alphaecp-minlpconvex is represented on the left (rows) and solver SBB_sbb on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number Filename
Tracefile 1: MINLPconvex.ALPHAECP.alphaecp-minlpconvex.pav
Tracefile 2: MINLPconvex.SBB.sbb.pav
Solvers used : ALPHAECP_alphaecp-minlpconvex
SBB_sbb
Modeltype(s)   MINLP

SBB_sbb:
optimal
SBB_sbb:
locally optimal
SBB_sbb:
feasible
SBB_sbb:
infeasible
SBB_sbb:
unbounded
SBB_sbb:
fail
SBB_sbb:
no data
total ALPHAECP_alphaecp-minlpconvex
ALPHAECP_alphaecp-minlpconvex:
optimal
16 - 20 - - 1 - 37
ALPHAECP_alphaecp-minlpconvex:
locally optimal
- - - - - - - -
ALPHAECP_alphaecp-minlpconvex:
feasible
2 - 7 - - - - 9
ALPHAECP_alphaecp-minlpconvex:
infeasible
- - - - - - - -
ALPHAECP_alphaecp-minlpconvex:
unbounded
- - - - - - - -
ALPHAECP_alphaecp-minlpconvex:
fail
- - 1 - - - - 1
ALPHAECP_alphaecp-minlpconvex:
no data
- - - - - - - -
total SBB_sbb 18 - 28 - - 1 - 47

Solver return definitions:

Outcome Model Status Solver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other

Solver Resource Times


ALPHAECP_alphaecp-minlpconvex: optimal -- SBB_sbb: optimal    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (SBB_sbb) Ratio (ALPHAECP_alphaecp-minlpconvex/SBB_sbb) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (SBB_sbb)
BatchS121208M 414.9960 68.2430 6.081 1241130.00000000 1241130.00000000
BatchS151208M 358.0080 139.6830 2.563 1543470.00000000 1543470.00000000
BatchS201210M 137.4990 709.1870 0.194 2295350.00000000 2295350.00000000
clay0303h 5.4760 16.6380 0.329 26669.10000000 26669.10000000
clay0304h 18.8560 933.8160 0.020 40262.40000000 40262.40000000
clay0304m 10.3940 225.6290 0.046 40262.40000000 40262.40000000
clay0305h 53.9050 3550.4500 0.015 8092.50000000 8092.50000000
clay0305m 17.3060 552.9520 0.031 8092.50000000 8092.50000000
FLay04H 96.0070 52.2630 1.837 54.40590000 54.40590000
FLay05M 3305.1000 3387.5600 0.976 64.49810000 64.49810000
m6 1.5500 1484.5600 0.001 82.25690000 82.25690000
RSyn0805H 0.8410 5.7320 0.147 1296.12000000 1296.12000000
RSyn0830M04H 21.8760 1424.3400 0.015 2529.07000000 2529.07000000
SLay06H 318.8590 688.7320 0.463 32757.00000000 32757.00000000
Syn15M04M 3.6060 265.6830 0.014 4937.48000000 4937.48000000
Syn40M03H 10.5050 23.0620 0.456 395.14900000 395.14900000

Back to top


ALPHAECP_alphaecp-minlpconvex: optimal -- SBB_sbb: feasible    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (SBB_sbb) Ratio (ALPHAECP_alphaecp-minlpconvex/SBB_sbb) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (SBB_sbb)
fo7_2 41.5380 3661.1600 0.011 17.74930000 26.55040000
fo7 206.4110 3662.8000 0.056 20.72980000 40.08400000
fo8 1480.9900 3660.6900 0.405 22.38190000 34.34010000
m7 4.3460 3616.7400 0.001 106.75700000 130.46000000
o7_2 569.6560 3660.9100 0.156 116.94600000 127.97300000
RSyn0805M02M 10.0430 3655.0400 0.003 2238.40000000 2156.97000000
RSyn0805M03M 12.7890 3660.9700 0.003 3068.93000000 2705.00000000
RSyn0805M04M 17.8910 3660.4700 0.005 7174.22000000 7134.08000000
RSyn0810M02M 13.2200 3660.8600 0.004 1741.39000000 1606.68000000
RSyn0810M03M 13.8260 3660.8000 0.004 2722.45000000 2246.79000000
RSyn0820M 2.1400 3661.0000 0.001 1150.30000000 1119.45000000
RSyn0830M 3.0010 3615.9400 0.001 510.07200000 431.20600000
RSyn0840M 2.2910 3664.5900 0.001 325.55500000 98.19980000
SLay07H 3416.9100 3631.6700 0.941 64748.80000000 65114.60000000
Syn20M03M 3.5180 3614.4100 0.001 2646.95000000 2616.95000000
Syn20M04M 4.5620 3660.6700 0.001 3532.74000000 3417.10000000
Syn30M02M 3.7390 3660.8000 0.001 399.68300000 356.81300000
Syn40M 2.3590 3637.5900 0.001 67.71330000 66.80010000
sssd-10-4-3 2.9870 3661.2800 0.001 152710.00000000 228267.00000000
sssd-15-6-3 104.9700 3662.2800 0.029 440748.00000000 537007.00000000

Back to top


ALPHAECP_alphaecp-minlpconvex: optimal -- SBB_sbb: fail    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (SBB_sbb) Ratio (ALPHAECP_alphaecp-minlpconvex/SBB_sbb) Obj (ALPHAECP_alphaecp-minlpconvex) Status (SBB_sbb)
BatchS101006M 86.9510 0.3680 --- 769440.00000000 mstat(13)sstat(13)

Back to top


ALPHAECP_alphaecp-minlpconvex: feasible -- SBB_sbb: optimal    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (SBB_sbb) Ratio (ALPHAECP_alphaecp-minlpconvex/SBB_sbb) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (SBB_sbb)
SLay09M 3666.3900 555.7400 6.597 107806.00000000 107806.00000000
SLay10M 3657.1700 846.2270 4.322 129810.00000000 129580.00000000

Back to top


ALPHAECP_alphaecp-minlpconvex: feasible -- SBB_sbb: feasible    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (SBB_sbb) Ratio (ALPHAECP_alphaecp-minlpconvex/SBB_sbb) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (SBB_sbb)
FLay05H 3615.7000 3654.6500 0.989 64.49810000 64.49810000
FLay06M 3615.6500 3634.5800 0.995 66.93280000 66.93280000
SLay08H 3621.8700 3660.9200 0.989 84960.20000000 86656.80000000
SLay09H 3663.8900 3661.1500 1.001 107806.00000000 127524.00000000
uflquad-20-150 3651.8800 3641.4800 1.003 630.18200000 714.49600000
uflquad-30-100 3634.2800 3622.3600 1.003 415.04000000 440.18700000
uflquad-40-80 3666.3400 3658.5300 1.002 386.67200000 402.71600000

Back to top


ALPHAECP_alphaecp-minlpconvex: fail -- SBB_sbb: feasible    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (SBB_sbb) Ratio (ALPHAECP_alphaecp-minlpconvex/SBB_sbb) Status (ALPHAECP_alphaecp-minlpconvex) Obj (SBB_sbb)
sssd-12-5-3 7.4980 3661.2200 --- mstat( 7)sstat( 1) 315015.00000000

Back to top


ALPHAECP_alphaecp-minlpconvex: optimal:

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Obj (ALPHAECP_alphaecp-minlpconvex)
BatchS101006M 86.9510 769440.00000000
BatchS121208M 414.9960 1241130.00000000
BatchS151208M 358.0080 1543470.00000000
BatchS201210M 137.4990 2295350.00000000
clay0303h 5.4760 26669.10000000
clay0304h 18.8560 40262.40000000
clay0304m 10.3940 40262.40000000
clay0305h 53.9050 8092.50000000
clay0305m 17.3060 8092.50000000
FLay04H 96.0070 54.40590000
FLay05M 3305.1000 64.49810000
fo7_2 41.5380 17.74930000
fo7 206.4110 20.72980000
fo8 1480.9900 22.38190000
m6 1.5500 82.25690000
m7 4.3460 106.75700000
o7_2 569.6560 116.94600000
RSyn0805H 0.8410 1296.12000000
RSyn0805M02M 10.0430 2238.40000000
RSyn0805M03M 12.7890 3068.93000000
RSyn0805M04M 17.8910 7174.22000000
RSyn0810M02M 13.2200 1741.39000000
RSyn0810M03M 13.8260 2722.45000000
RSyn0820M 2.1400 1150.30000000
RSyn0830M04H 21.8760 2529.07000000
RSyn0830M 3.0010 510.07200000
RSyn0840M 2.2910 325.55500000
SLay06H 318.8590 32757.00000000
SLay07H 3416.9100 64748.80000000
Syn15M04M 3.6060 4937.48000000
Syn20M03M 3.5180 2646.95000000
Syn20M04M 4.5620 3532.74000000
Syn30M02M 3.7390 399.68300000
Syn40M03H 10.5050 395.14900000
Syn40M 2.3590 67.71330000
sssd-10-4-3 2.9870 152710.00000000
sssd-15-6-3 104.9700 440748.00000000

Back to top


ALPHAECP_alphaecp-minlpconvex: feasible:

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Obj (ALPHAECP_alphaecp-minlpconvex)
FLay05H 3615.7000 64.49810000
FLay06M 3615.6500 66.93280000
SLay08H 3621.8700 84960.20000000
SLay09H 3663.8900 107806.00000000
SLay09M 3666.3900 107806.00000000
SLay10M 3657.1700 129810.00000000
uflquad-20-150 3651.8800 630.18200000
uflquad-30-100 3634.2800 415.04000000
uflquad-40-80 3666.3400 386.67200000

Back to top


ALPHAECP_alphaecp-minlpconvex: fail:

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Status (ALPHAECP_alphaecp-minlpconvex)
sssd-12-5-3 -- mstat( 7) sstat( 1)

Back to top


SBB_sbb: optimal:

Back to top

Modelname Time (SBB_sbb) Obj (SBB_sbb)
BatchS121208M 68.2430 1241130.00000000
BatchS151208M 139.6830 1543470.00000000
BatchS201210M 709.1870 2295350.00000000
clay0303h 16.6380 26669.10000000
clay0304h 933.8160 40262.40000000
clay0304m 225.6290 40262.40000000
clay0305h 3550.4500 8092.50000000
clay0305m 552.9520 8092.50000000
FLay04H 52.2630 54.40590000
FLay05M 3387.5600 64.49810000
m6 1484.5600 82.25690000
RSyn0805H 5.7320 1296.12000000
RSyn0830M04H 1424.3400 2529.07000000
SLay06H 688.7320 32757.00000000
SLay09M 555.7400 107806.00000000
SLay10M 846.2270 129580.00000000
Syn15M04M 265.6830 4937.48000000
Syn40M03H 23.0620 395.14900000

Back to top

SBB_sbb: feasible:

Back to top

Modelname Time (SBB_sbb) Obj (SBB_sbb)
FLay05H 3654.6500 64.49810000
FLay06M 3634.5800 66.93280000
fo7_2 3661.1600 26.55040000
fo7 3662.8000 40.08400000
fo8 3660.6900 34.34010000
m7 3616.7400 130.46000000
o7_2 3660.9100 127.97300000
RSyn0805M02M 3655.0400 2156.97000000
RSyn0805M03M 3660.9700 2705.00000000
RSyn0805M04M 3660.4700 7134.08000000
RSyn0810M02M 3660.8600 1606.68000000
RSyn0810M03M 3660.8000 2246.79000000
RSyn0820M 3661.0000 1119.45000000
RSyn0830M 3615.9400 431.20600000
RSyn0840M 3664.5900 98.19980000
SLay07H 3631.6700 65114.60000000
SLay08H 3660.9200 86656.80000000
SLay09H 3661.1500 127524.00000000
Syn20M03M 3614.4100 2616.95000000
Syn20M04M 3660.6700 3417.10000000
Syn30M02M 3660.8000 356.81300000
Syn40M 3637.5900 66.80010000
sssd-10-4-3 3661.2800 228267.00000000
sssd-12-5-3 3661.2200 315015.00000000
sssd-15-6-3 3662.2800 537007.00000000
uflquad-20-150 3641.4800 714.49600000
uflquad-30-100 3622.3600 440.18700000
uflquad-40-80 3658.5300 402.71600000

Back to top

SBB_sbb: fail:

Back to top

Modelname Time (SBB_sbb) Status (SBB_sbb)
BatchS101006M -- mstat(13)sstat(13)

Back to top

ALPHAECP_alphaecp-minlpconvex: all -- SBB_sbb: all

Back to top

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (3666.39 seconds). The shift is 10s.

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (SBB_sbb) Ratio (ALPHAECP_alphaecp-minlpconvex/ SBB_sbb) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (SBB_sbb) ObjEst (ALPHAECP_alphaecp-minlpconvex) ObjEst (SBB_sbb) Gap (ALPHAECP_alphaecp-minlpconvex) Gap (SBB_sbb)
BatchS101006M 86.9510 0.3680 --- 769440.00000000 mstat(13) sstat(13) 769440.00000000 --- 0.0000 ---
BatchS121208M 414.9960 68.2430 6.081 1241130.00000000 1241130.00000000 1241130.00000000 1241130.00000000 0.0000 0.0000
BatchS151208M 358.0080 139.6830 2.563 1543470.00000000 1543470.00000000 1543470.00000000 1543470.00000000 0.0000 0.0000
BatchS201210M 137.4990 709.1870 0.194 2295350.00000000 2295350.00000000 2295350.00000000 2295350.00000000 0.0000 0.0000
clay0303h 5.4760 16.6380 0.329 26669.10000000 26669.10000000 26669.10000000 26669.10000000 0.0000 0.0000
clay0304h 18.8560 933.8160 0.020 40262.40000000 40262.40000000 40262.40000000 40262.40000000 0.0000 0.0000
clay0304m 10.3940 225.6290 0.046 40262.40000000 40262.40000000 40262.40000000 40262.40000000 0.0000 0.0000
clay0305h 53.9050 3550.4500 0.015 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
clay0305m 17.3060 552.9520 0.031 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
FLay04H 96.0070 52.2630 1.837 54.40590000 54.40590000 54.40590000 54.40590000 0.0000 0.0000
FLay05H 3615.7000 3654.6500 0.989 64.49810000 64.49810000 -1.0000000000000E+20 61.55330000 1.0000 0.0478
FLay05M 3305.1000 3387.5600 0.976 64.49810000 64.49810000 64.49810000 64.49810000 0.0000 0.0000
FLay06M 3615.6500 3634.5800 0.995 66.93280000 66.93280000 -1.0000000000000E+20 51.74640000 1.0000 0.2935
fo7_2 41.5380 3661.1600 0.011 17.74930000 26.55040000 17.74930000 9.17808000 0.0000 1.8928
fo7 206.4110 3662.8000 0.056 20.72980000 40.08400000 20.72980000 9.00519000 0.0000 3.4512
fo8 1480.9900 3660.6900 0.405 22.38190000 34.34010000 22.38190000 6.52503000 0.0000 4.2628
m6 1.5500 1484.5600 0.001 82.25690000 82.25690000 82.25690000 82.25690000 0.0000 0.0000
m7 4.3460 3616.7400 0.001 106.75700000 130.46000000 106.75700000 66.72880000 0.0000 0.9551
o7_2 569.6560 3660.9100 0.156 116.94600000 127.97300000 116.94600000 52.24160000 0.0000 1.4496
RSyn0805H (max) 0.8410 5.7320 0.147 1296.12000000 1296.12000000 1296.12000000 1296.12000000 0.0000 0.0000
RSyn0805M02M (max) 10.0430 3655.0400 0.003 2238.40000000 2156.97000000 2238.40000000 2595.72000000 0.0000 0.1690
RSyn0805M03M (max) 12.7890 3660.9700 0.003 3068.93000000 2705.00000000 3068.93000000 3948.19000000 0.0000 0.3149
RSyn0805M04M (max) 17.8910 3660.4700 0.005 7174.22000000 7134.08000000 7174.22000000 8395.95000000 0.0000 0.1503
RSyn0810M02M (max) 13.2200 3660.8600 0.004 1741.39000000 1606.68000000 1741.39000000 3465.97000000 0.0000 0.5364
RSyn0810M03M (max) 13.8260 3660.8000 0.004 2722.45000000 2246.79000000 2722.45000000 5987.67000000 0.0000 0.6248
RSyn0820M (max) 2.1400 3661.0000 0.001 1150.30000000 1119.45000000 1150.30000000 1511.46000000 0.0000 0.2594
RSyn0830M04H (max) 21.8760 1424.3400 0.015 2529.07000000 2529.07000000 2529.07000000 2529.07000000 0.0000 0.0000
RSyn0830M (max) 3.0010 3615.9400 0.001 510.07200000 431.20600000 510.07200000 1626.72000000 0.0000 0.7349
RSyn0840M (max) 2.2910 3664.5900 0.001 325.55500000 98.19980000 325.55500000 1777.34000000 0.0000 0.9447
SLay06H 318.8590 688.7320 0.463 32757.00000000 32757.00000000 32757.00000000 32757.00000000 0.0000 0.0000
SLay07H 3416.9100 3631.6700 0.941 64748.80000000 65114.60000000 64748.80000000 63428.60000000 0.0000 0.0266
SLay08H 3621.8700 3660.9200 0.989 84960.20000000 86656.80000000 84960.20000000 81700.00000000 0.0000 0.0607
SLay09H 3663.8900 3661.1500 1.001 107806.00000000 127524.00000000 -1.0000000000000E+20 103127.00000000 1.0000 0.2366
SLay09M 3666.3900 555.7400 6.597 107806.00000000 107806.00000000 -1.0000000000000E+20 107806.00000000 1.0000 0.0000
SLay10M 3657.1700 846.2270 4.322 129810.00000000 129580.00000000 -1.0000000000000E+20 129580.00000000 1.0000 0.0000
Syn15M04M (max) 3.6060 265.6830 0.014 4937.48000000 4937.48000000 4937.48000000 4937.48000000 0.0000 0.0000
Syn20M03M (max) 3.5180 3614.4100 0.001 2646.95000000 2616.95000000 2646.95000000 3505.49000000 0.0000 0.2535
Syn20M04M (max) 4.5620 3660.6700 0.001 3532.74000000 3417.10000000 3532.74000000 5877.34000000 0.0000 0.4186
Syn30M02M (max) 3.7390 3660.8000 0.001 399.68300000 356.81300000 399.68300000 2591.61000000 0.0000 0.8623
Syn40M03H (max) 10.5050 23.0620 0.456 395.14900000 395.14900000 395.14900000 395.14900000 0.0000 0.0000
Syn40M (max) 2.3590 3637.5900 0.001 67.71330000 66.80010000 67.71330000 828.11400000 0.0000 0.9193
sssd-10-4-3 2.9870 3661.2800 0.001 152710.00000000 228267.00000000 152710.00000000 68405.20000000 0.0000 2.3370
sssd-12-5-3 7.4980 3661.2200 --- mstat( 7) sstat(1) 315015.00000000 --- 100731.00000000 --- 2.1273
sssd-15-6-3 104.9700 3662.2800 0.029 440748.00000000 537007.00000000 440748.00000000 155042.00000000 0.0000 2.4636
uflquad-20-150 3651.8800 3641.4800 1.003 630.18200000 714.49600000 -1.0000000000000E+20 377.69800000 1.0000 0.8917
uflquad-30-100 3634.2800 3622.3600 1.003 415.04000000 440.18700000 -1.0000000000000E+20 257.36600000 1.0000 0.7104
uflquad-40-80 3666.3400 3658.5300 1.002 386.67200000 402.71600000 -1.0000000000000E+20 228.10200000 1.0000 0.7655
Shifted Geometric Mean
(Solved)
116.63 1451.09              
% Unsolved 19.15% 61.70%         

Back to top