Solver Square Comparison: Considers all models.

Results created on 02/25/11 16:06:54 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver ALPHAECP_alphaecp-minlpconvex is represented on the left (rows) and solver BONMIN_bonmin-ecp on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number Filename
Tracefile 1: MINLPconvex.ALPHAECP.alphaecp-minlpconvex.pav
Tracefile 2: MINLPconvex.BONMIN.bonmin-ecp.pav
Solvers used : ALPHAECP_alphaecp-minlpconvex
BONMIN_bonmin-ecp
Modeltype(s)   MINLP

BONMIN_bonmin-ecp:
optimal
BONMIN_bonmin-ecp:
locally optimal
BONMIN_bonmin-ecp:
feasible
BONMIN_bonmin-ecp:
infeasible
BONMIN_bonmin-ecp:
unbounded
BONMIN_bonmin-ecp:
fail
BONMIN_bonmin-ecp:
no data
total ALPHAECP_alphaecp-minlpconvex
ALPHAECP_alphaecp-minlpconvex:
optimal
37 - - - - - - 37
ALPHAECP_alphaecp-minlpconvex:
locally optimal
- - - - - - - -
ALPHAECP_alphaecp-minlpconvex:
feasible
5 - 3 - - 1 - 9
ALPHAECP_alphaecp-minlpconvex:
infeasible
- - - - - - - -
ALPHAECP_alphaecp-minlpconvex:
unbounded
- - - - - - - -
ALPHAECP_alphaecp-minlpconvex:
fail
1 - - - - - - 1
ALPHAECP_alphaecp-minlpconvex:
no data
- - - - - - - -
total BONMIN_bonmin-ecp 43 - 3 - - 1 - 47

Solver return definitions:

Outcome Model Status Solver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other

Solver Resource Times


ALPHAECP_alphaecp-minlpconvex: optimal -- BONMIN_bonmin-ecp: optimal    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (BONMIN_bonmin-ecp) Ratio (ALPHAECP_alphaecp-minlpconvex/BONMIN_bonmin-ecp) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (BONMIN_bonmin-ecp)
BatchS101006M 86.9510 21.3340 4.076 769440.00000000 769440.00000000
BatchS121208M 414.9960 38.2670 10.845 1241130.00000000 1241130.00000000
BatchS151208M 358.0080 97.3900 3.676 1543470.00000000 1543470.00000000
BatchS201210M 137.4990 325.7510 0.422 2295350.00000000 2295350.00000000
clay0303h 5.4760 4.5020 1.216 26669.10000000 26669.10000000
clay0304h 18.8560 35.1310 0.537 40262.40000000 40262.40000000
clay0304m 10.3940 8.9910 1.156 40262.40000000 40262.40000000
clay0305h 53.9050 75.8600 0.711 8092.50000000 8092.50000000
clay0305m 17.3060 8.8670 1.952 8092.50000000 8092.50000000
FLay04H 96.0070 6.0250 15.935 54.40590000 54.40590000
FLay05M 3305.1000 65.6850 50.317 64.49810000 64.49810000
fo7_2 41.5380 120.9320 0.343 17.74930000 17.74930000
fo7 206.4110 198.0970 1.042 20.72980000 20.72980000
fo8 1480.9900 640.2760 2.313 22.38190000 22.38190000
m6 1.5500 7.0040 0.221 82.25690000 82.25690000
m7 4.3460 30.9180 0.141 106.75700000 106.75700000
o7_2 569.6560 1445.8500 0.394 116.94600000 116.94600000
RSyn0805H 0.8410 0.2140 3.930 1296.12000000 1296.12000000
RSyn0805M02M 10.0430 33.0650 0.304 2238.40000000 2238.40000000
RSyn0805M03M 12.7890 122.8370 0.104 3068.93000000 3068.93000000
RSyn0805M04M 17.8910 137.0390 0.131 7174.22000000 7174.22000000
RSyn0810M02M 13.2200 37.8070 0.350 1741.39000000 1741.39000000
RSyn0810M03M 13.8260 145.8620 0.095 2722.45000000 2722.45000000
RSyn0820M 2.1400 3.0760 0.696 1150.30000000 1150.30000000
RSyn0830M04H 21.8760 16.5910 1.319 2529.07000000 2529.07000000
RSyn0830M 3.0010 3.3660 0.892 510.07200000 510.07200000
RSyn0840M 2.2910 2.1410 1.070 325.55500000 325.55500000
SLay06H 318.8590 13.8250 23.064 32757.00000000 32757.00000000
SLay07H 3416.9100 34.2010 99.907 64748.80000000 64748.80000000
Syn15M04M 3.6060 3.9740 0.907 4937.48000000 4937.48000000
Syn20M03M 3.5180 2.9390 1.197 2646.95000000 2646.95000000
Syn20M04M 4.5620 9.7760 0.467 3532.74000000 3532.74000000
Syn30M02M 3.7390 3.7850 0.988 399.68300000 399.68300000
Syn40M03H 10.5050 6.5770 1.597 395.14900000 395.14900000
Syn40M 2.3590 0.5750 4.103 67.71330000 67.71330000
sssd-10-4-3 2.9870 10.4260 0.286 152710.00000000 152710.00000000
sssd-15-6-3 104.9700 722.8900 0.145 440748.00000000 440711.00000000

Back to top


ALPHAECP_alphaecp-minlpconvex: feasible -- BONMIN_bonmin-ecp: optimal    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (BONMIN_bonmin-ecp) Ratio (ALPHAECP_alphaecp-minlpconvex/BONMIN_bonmin-ecp) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (BONMIN_bonmin-ecp)
FLay05H 3615.7000 318.1820 11.364 64.49810000 64.49810000
SLay08H 3621.8700 156.7540 23.105 84960.20000000 84960.20000000
SLay09H 3663.8900 249.6040 14.679 107806.00000000 107806.00000000
SLay09M 3666.3900 61.7340 59.390 107806.00000000 107806.00000000
SLay10M 3657.1700 290.0790 12.607 129810.00000000 129582.00000000

Back to top


ALPHAECP_alphaecp-minlpconvex: feasible -- BONMIN_bonmin-ecp: feasible    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (BONMIN_bonmin-ecp) Ratio (ALPHAECP_alphaecp-minlpconvex/BONMIN_bonmin-ecp) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (BONMIN_bonmin-ecp)
FLay06M 3615.6500 3618.6800 0.999 66.93280000 66.93280000
uflquad-30-100 3634.2800 3608.0900 1.007 415.04000000 402.51100000
uflquad-40-80 3666.3400 3660.0900 1.002 386.67200000 471.45900000

Back to top


ALPHAECP_alphaecp-minlpconvex: feasible -- BONMIN_bonmin-ecp: fail    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (BONMIN_bonmin-ecp) Ratio (ALPHAECP_alphaecp-minlpconvex/BONMIN_bonmin-ecp) Obj (ALPHAECP_alphaecp-minlpconvex) Status (BONMIN_bonmin-ecp)
uflquad-20-150 3651.8800 2753.5300 --- 630.18200000 mstat(13)sstat(13)

Back to top


ALPHAECP_alphaecp-minlpconvex: fail -- BONMIN_bonmin-ecp: optimal    

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (BONMIN_bonmin-ecp) Ratio (ALPHAECP_alphaecp-minlpconvex/BONMIN_bonmin-ecp) Status (ALPHAECP_alphaecp-minlpconvex) Obj (BONMIN_bonmin-ecp)
sssd-12-5-3 7.4980 37.9120 --- mstat( 7)sstat( 1) 261143.00000000

Back to top


ALPHAECP_alphaecp-minlpconvex: optimal:

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Obj (ALPHAECP_alphaecp-minlpconvex)
BatchS101006M 86.9510 769440.00000000
BatchS121208M 414.9960 1241130.00000000
BatchS151208M 358.0080 1543470.00000000
BatchS201210M 137.4990 2295350.00000000
clay0303h 5.4760 26669.10000000
clay0304h 18.8560 40262.40000000
clay0304m 10.3940 40262.40000000
clay0305h 53.9050 8092.50000000
clay0305m 17.3060 8092.50000000
FLay04H 96.0070 54.40590000
FLay05M 3305.1000 64.49810000
fo7_2 41.5380 17.74930000
fo7 206.4110 20.72980000
fo8 1480.9900 22.38190000
m6 1.5500 82.25690000
m7 4.3460 106.75700000
o7_2 569.6560 116.94600000
RSyn0805H 0.8410 1296.12000000
RSyn0805M02M 10.0430 2238.40000000
RSyn0805M03M 12.7890 3068.93000000
RSyn0805M04M 17.8910 7174.22000000
RSyn0810M02M 13.2200 1741.39000000
RSyn0810M03M 13.8260 2722.45000000
RSyn0820M 2.1400 1150.30000000
RSyn0830M04H 21.8760 2529.07000000
RSyn0830M 3.0010 510.07200000
RSyn0840M 2.2910 325.55500000
SLay06H 318.8590 32757.00000000
SLay07H 3416.9100 64748.80000000
Syn15M04M 3.6060 4937.48000000
Syn20M03M 3.5180 2646.95000000
Syn20M04M 4.5620 3532.74000000
Syn30M02M 3.7390 399.68300000
Syn40M03H 10.5050 395.14900000
Syn40M 2.3590 67.71330000
sssd-10-4-3 2.9870 152710.00000000
sssd-15-6-3 104.9700 440748.00000000

Back to top


ALPHAECP_alphaecp-minlpconvex: feasible:

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Obj (ALPHAECP_alphaecp-minlpconvex)
FLay05H 3615.7000 64.49810000
FLay06M 3615.6500 66.93280000
SLay08H 3621.8700 84960.20000000
SLay09H 3663.8900 107806.00000000
SLay09M 3666.3900 107806.00000000
SLay10M 3657.1700 129810.00000000
uflquad-20-150 3651.8800 630.18200000
uflquad-30-100 3634.2800 415.04000000
uflquad-40-80 3666.3400 386.67200000

Back to top


ALPHAECP_alphaecp-minlpconvex: fail:

Back to top

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Status (ALPHAECP_alphaecp-minlpconvex)
sssd-12-5-3 -- mstat( 7) sstat( 1)

Back to top


BONMIN_bonmin-ecp: optimal:

Back to top

Modelname Time (BONMIN_bonmin-ecp) Obj (BONMIN_bonmin-ecp)
BatchS101006M 21.3340 769440.00000000
BatchS121208M 38.2670 1241130.00000000
BatchS151208M 97.3900 1543470.00000000
BatchS201210M 325.7510 2295350.00000000
clay0303h 4.5020 26669.10000000
clay0304h 35.1310 40262.40000000
clay0304m 8.9910 40262.40000000
clay0305h 75.8600 8092.50000000
clay0305m 8.8670 8092.50000000
FLay04H 6.0250 54.40590000
FLay05H 318.1820 64.49810000
FLay05M 65.6850 64.49810000
fo7_2 120.9320 17.74930000
fo7 198.0970 20.72980000
fo8 640.2760 22.38190000
m6 7.0040 82.25690000
m7 30.9180 106.75700000
o7_2 1445.8500 116.94600000
RSyn0805H 0.2140 1296.12000000
RSyn0805M02M 33.0650 2238.40000000
RSyn0805M03M 122.8370 3068.93000000
RSyn0805M04M 137.0390 7174.22000000
RSyn0810M02M 37.8070 1741.39000000
RSyn0810M03M 145.8620 2722.45000000
RSyn0820M 3.0760 1150.30000000
RSyn0830M04H 16.5910 2529.07000000
RSyn0830M 3.3660 510.07200000
RSyn0840M 2.1410 325.55500000
SLay06H 13.8250 32757.00000000
SLay07H 34.2010 64748.80000000
SLay08H 156.7540 84960.20000000
SLay09H 249.6040 107806.00000000
SLay09M 61.7340 107806.00000000
SLay10M 290.0790 129582.00000000
Syn15M04M 3.9740 4937.48000000
Syn20M03M 2.9390 2646.95000000
Syn20M04M 9.7760 3532.74000000
Syn30M02M 3.7850 399.68300000
Syn40M03H 6.5770 395.14900000
Syn40M 0.5750 67.71330000
sssd-10-4-3 10.4260 152710.00000000
sssd-12-5-3 37.9120 261143.00000000
sssd-15-6-3 722.8900 440711.00000000

Back to top

BONMIN_bonmin-ecp: feasible:

Back to top

Modelname Time (BONMIN_bonmin-ecp) Obj (BONMIN_bonmin-ecp)
FLay06M 3618.6800 66.93280000
uflquad-30-100 3608.0900 402.51100000
uflquad-40-80 3660.0900 471.45900000

Back to top

BONMIN_bonmin-ecp: fail:

Back to top

Modelname Time (BONMIN_bonmin-ecp) Status (BONMIN_bonmin-ecp)
uflquad-20-150 -- mstat(13)sstat(13)

Back to top

ALPHAECP_alphaecp-minlpconvex: all -- BONMIN_bonmin-ecp: all

Back to top

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (3666.39 seconds). The shift is 10s.

Modelname Time (ALPHAECP_alphaecp-minlpconvex) Time (BONMIN_bonmin-ecp) Ratio (ALPHAECP_alphaecp-minlpconvex/ BONMIN_bonmin-ecp) Obj (ALPHAECP_alphaecp-minlpconvex) Obj (BONMIN_bonmin-ecp) ObjEst (ALPHAECP_alphaecp-minlpconvex) ObjEst (BONMIN_bonmin-ecp) Gap (ALPHAECP_alphaecp-minlpconvex) Gap (BONMIN_bonmin-ecp)
BatchS101006M 86.9510 21.3340 4.076 769440.00000000 769440.00000000 769440.00000000 769440.00000000 0.0000 0.0000
BatchS121208M 414.9960 38.2670 10.845 1241130.00000000 1241130.00000000 1241130.00000000 1241130.00000000 0.0000 0.0000
BatchS151208M 358.0080 97.3900 3.676 1543470.00000000 1543470.00000000 1543470.00000000 1543470.00000000 0.0000 0.0000
BatchS201210M 137.4990 325.7510 0.422 2295350.00000000 2295350.00000000 2295350.00000000 2295350.00000000 0.0000 0.0000
clay0303h 5.4760 4.5020 1.216 26669.10000000 26669.10000000 26669.10000000 26669.10000000 0.0000 0.0000
clay0304h 18.8560 35.1310 0.537 40262.40000000 40262.40000000 40262.40000000 40262.40000000 0.0000 0.0000
clay0304m 10.3940 8.9910 1.156 40262.40000000 40262.40000000 40262.40000000 40262.40000000 0.0000 0.0000
clay0305h 53.9050 75.8600 0.711 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
clay0305m 17.3060 8.8670 1.952 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
FLay04H 96.0070 6.0250 15.935 54.40590000 54.40590000 54.40590000 54.40590000 0.0000 0.0000
FLay05H 3615.7000 318.1820 11.364 64.49810000 64.49810000 -1.0000000000000E+20 64.49810000 1.0000 0.0000
FLay05M 3305.1000 65.6850 50.317 64.49810000 64.49810000 64.49810000 64.49810000 0.0000 0.0000
FLay06M 3615.6500 3618.6800 0.999 66.93280000 66.93280000 -1.0000000000000E+20 64.31940000 1.0000 0.0406
fo7_2 41.5380 120.9320 0.343 17.74930000 17.74930000 17.74930000 17.74930000 0.0000 0.0000
fo7 206.4110 198.0970 1.042 20.72980000 20.72980000 20.72980000 20.72980000 0.0000 0.0000
fo8 1480.9900 640.2760 2.313 22.38190000 22.38190000 22.38190000 22.38190000 0.0000 0.0000
m6 1.5500 7.0040 0.221 82.25690000 82.25690000 82.25690000 82.25690000 0.0000 0.0000
m7 4.3460 30.9180 0.141 106.75700000 106.75700000 106.75700000 106.75700000 0.0000 0.0000
o7_2 569.6560 1445.8500 0.394 116.94600000 116.94600000 116.94600000 116.94600000 0.0000 0.0000
RSyn0805H (max) 0.8410 0.2140 3.930 1296.12000000 1296.12000000 1296.12000000 1296.12000000 0.0000 0.0000
RSyn0805M02M (max) 10.0430 33.0650 0.304 2238.40000000 2238.40000000 2238.40000000 2238.40000000 0.0000 0.0000
RSyn0805M03M (max) 12.7890 122.8370 0.104 3068.93000000 3068.93000000 3068.93000000 3068.93000000 0.0000 0.0000
RSyn0805M04M (max) 17.8910 137.0390 0.131 7174.22000000 7174.22000000 7174.22000000 7174.22000000 0.0000 0.0000
RSyn0810M02M (max) 13.2200 37.8070 0.350 1741.39000000 1741.39000000 1741.39000000 1741.39000000 0.0000 0.0000
RSyn0810M03M (max) 13.8260 145.8620 0.095 2722.45000000 2722.45000000 2722.45000000 2722.45000000 0.0000 0.0000
RSyn0820M (max) 2.1400 3.0760 0.696 1150.30000000 1150.30000000 1150.30000000 1150.30000000 0.0000 0.0000
RSyn0830M04H (max) 21.8760 16.5910 1.319 2529.07000000 2529.07000000 2529.07000000 2529.07000000 0.0000 0.0000
RSyn0830M (max) 3.0010 3.3660 0.892 510.07200000 510.07200000 510.07200000 510.07200000 0.0000 0.0000
RSyn0840M (max) 2.2910 2.1410 1.070 325.55500000 325.55500000 325.55500000 325.55500000 0.0000 0.0000
SLay06H 318.8590 13.8250 23.064 32757.00000000 32757.00000000 32757.00000000 32757.00000000 0.0000 0.0000
SLay07H 3416.9100 34.2010 99.907 64748.80000000 64748.80000000 64748.80000000 64748.80000000 0.0000 0.0000
SLay08H 3621.8700 156.7540 23.105 84960.20000000 84960.20000000 84960.20000000 84960.20000000 0.0000 0.0000
SLay09H 3663.8900 249.6040 14.679 107806.00000000 107806.00000000 -1.0000000000000E+20 107806.00000000 1.0000 0.0000
SLay09M 3666.3900 61.7340 59.390 107806.00000000 107806.00000000 -1.0000000000000E+20 107806.00000000 1.0000 0.0000
SLay10M 3657.1700 290.0790 12.607 129810.00000000 129582.00000000 -1.0000000000000E+20 129582.00000000 1.0000 0.0000
Syn15M04M (max) 3.6060 3.9740 0.907 4937.48000000 4937.48000000 4937.48000000 4937.48000000 0.0000 0.0000
Syn20M03M (max) 3.5180 2.9390 1.197 2646.95000000 2646.95000000 2646.95000000 2646.95000000 0.0000 0.0000
Syn20M04M (max) 4.5620 9.7760 0.467 3532.74000000 3532.74000000 3532.74000000 3532.74000000 0.0000 0.0000
Syn30M02M (max) 3.7390 3.7850 0.988 399.68300000 399.68300000 399.68300000 399.68300000 0.0000 0.0000
Syn40M03H (max) 10.5050 6.5770 1.597 395.14900000 395.14900000 395.14900000 395.14900000 0.0000 0.0000
Syn40M (max) 2.3590 0.5750 4.103 67.71330000 67.71330000 67.71330000 67.71330000 0.0000 0.0000
sssd-10-4-3 2.9870 10.4260 0.286 152710.00000000 152710.00000000 152710.00000000 152710.00000000 0.0000 0.0000
sssd-12-5-3 7.4980 37.9120 --- mstat( 7) sstat(1) 261143.00000000 --- 261143.00000000 --- 0.0000
sssd-15-6-3 104.9700 722.8900 0.145 440748.00000000 440711.00000000 440748.00000000 440711.00000000 0.0000 0.0000
uflquad-20-150 3651.8800 2753.5300 --- 630.18200000 mstat(13) sstat(13) -1.0000000000000E+20 --- 1.0000 ---
uflquad-30-100 3634.2800 3608.0900 1.007 415.04000000 402.51100000 -1.0000000000000E+20 145.03800000 1.0000 1.7752
uflquad-40-80 3666.3400 3660.0900 1.002 386.67200000 471.45900000 -1.0000000000000E+20 103.07000000 1.0000 3.5742
Shifted Geometric Mean
(Solved)
116.63 66.37              
% Unsolved 19.15% 8.51%         

Back to top