Solver Square Comparison: Considers all models.
Results created on 02/25/11 16:11:29 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver
Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.
Solver BONMIN_bonmin-ecp is represented on the left (rows) and solver BONMIN_bonmin-oa on top (columns).
See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.
| Input File Number | Filename |
|---|---|
| Tracefile 1: | MINLPconvex.BONMIN.bonmin-ecp.pav |
| Tracefile 2: | MINLPconvex.BONMIN.bonmin-oa.pav |
| Solvers used : | BONMIN_bonmin-ecp |
| BONMIN_bonmin-oa | |
| Modeltype(s) | MINLP |
| BONMIN_bonmin-oa: optimal |
BONMIN_bonmin-oa: locally optimal |
BONMIN_bonmin-oa: feasible |
BONMIN_bonmin-oa: infeasible |
BONMIN_bonmin-oa: unbounded |
BONMIN_bonmin-oa: fail |
BONMIN_bonmin-oa: no data |
total BONMIN_bonmin-ecp | |
| BONMIN_bonmin-ecp: optimal | 16 | - | 1 | - | - | 26 | - | 43 |
| BONMIN_bonmin-ecp: locally optimal | - | - | - | - | - | - | - | - |
| BONMIN_bonmin-ecp: feasible | - | - | - | - | - | 3 | - | 3 |
| BONMIN_bonmin-ecp: infeasible | - | - | - | - | - | - | - | - |
| BONMIN_bonmin-ecp: unbounded | - | - | - | - | - | - | - | - |
| BONMIN_bonmin-ecp: fail | - | - | - | - | - | 1 | - | 1 |
| BONMIN_bonmin-ecp: no data | - | - | - | - | - | - | - | - |
| total BONMIN_bonmin-oa | 16 | - | 1 | - | - | 30 | - | 47 |
Solver return definitions:
| Outcome | Model Status | Solver Status |
|---|---|---|
| optimal | 1 or 15 | 1 |
| locally optimal | 2 | any |
| feasible | 8 or 16 | 1 or 2 or 3 or 4 or 5 |
| infeasible | 4 or 5 or 10 or 19 | 1 |
| unbounded | 3 or 18 | 1 |
| fail | all other | all other |
Solver Resource Times
- Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
- Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.50E-04. If both solutions are less than 1e-1, we use the absolute difference.
- Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.
BONMIN_bonmin-ecp: optimal -- BONMIN_bonmin-oa: optimal
Back to top
| Modelname | Time (BONMIN_bonmin-ecp) | Time (BONMIN_bonmin-oa) | Ratio (BONMIN_bonmin-ecp/BONMIN_bonmin-oa) | Obj (BONMIN_bonmin-ecp) | Obj (BONMIN_bonmin-oa) |
|---|---|---|---|---|---|
| BatchS101006M | 21.3340 | 738.1540 | 0.029 | 769440.00000000 | 769440.00000000 |
| clay0303h | 4.5020 | 5.2530 | 0.857 | 26669.10000000 | 26669.10000000 |
| clay0304h | 35.1310 | 84.5310 | 0.416 | 40262.40000000 | 40262.40000000 |
| clay0305h | 75.8600 | 222.3060 | 0.341 | 8092.50000000 | 8092.50000000 |
| clay0305m | 8.8670 | 87.2670 | 0.102 | 8092.50000000 | 8092.50000000 |
| FLay04H | 6.0250 | 61.0060 | 0.099 | 54.40590000 | 54.40590000 |
| fo7_2 | 120.9320 | 2825.8600 | 0.043 | 17.74930000 | 17.74930000 |
| m6 | 7.0040 | 23.1960 | 0.302 | 82.25690000 | 82.25690000 |
| m7 | 30.9180 | 390.7020 | 0.079 | 106.75700000 | 106.75700000 |
| RSyn0805H | 0.2140 | 0.2660 | 0.805 | 1296.12000000 | 1296.12000000 |
| RSyn0830M | 3.3660 | 286.2480 | 0.012 | 510.07200000 | 510.07200000 |
| SLay06H | 13.8250 | 762.8520 | 0.018 | 32757.00000000 | 32757.00000000 |
| Syn15M04M | 3.9740 | 8.9530 | 0.444 | 4937.48000000 | 4937.48000000 |
| Syn20M03M | 2.9390 | 10.9000 | 0.270 | 2646.95000000 | 2646.95000000 |
| Syn40M | 0.5750 | 1.5460 | 0.372 | 67.71330000 | 67.71330000 |
| sssd-10-4-3 | 10.4260 | 393.7720 | 0.026 | 152710.00000000 | 152710.00000000 |
BONMIN_bonmin-ecp: optimal -- BONMIN_bonmin-oa: feasible
Back to top
| Modelname | Time (BONMIN_bonmin-ecp) | Time (BONMIN_bonmin-oa) | Ratio (BONMIN_bonmin-ecp/BONMIN_bonmin-oa) | Obj (BONMIN_bonmin-ecp) | Obj (BONMIN_bonmin-oa) |
|---|---|---|---|---|---|
| BatchS201210M | 325.7510 | 3624.7600 | 0.090 | 2295350.00000000 | 2301300.00000000 |
BONMIN_bonmin-ecp: optimal -- BONMIN_bonmin-oa: fail
Back to top
| Modelname | Time (BONMIN_bonmin-ecp) | Time (BONMIN_bonmin-oa) | Ratio (BONMIN_bonmin-ecp/BONMIN_bonmin-oa) | Obj (BONMIN_bonmin-ecp) | Status (BONMIN_bonmin-oa) |
|---|---|---|---|---|---|
| BatchS121208M | 38.2670 | 3634.0900 | --- | 1241130.00000000 | mstat(14)sstat( 3) |
| BatchS151208M | 97.3900 | 3628.4500 | --- | 1543470.00000000 | mstat(14)sstat( 3) |
| clay0304m | 8.9910 | 2.0000 | --- | 40262.40000000 | mstat( 7)sstat( 1) |
| FLay05H | 318.1820 | 3626.8000 | --- | 64.49810000 | mstat(14)sstat( 3) |
| FLay05M | 65.6850 | 3665.8300 | --- | 64.49810000 | mstat(14)sstat( 3) |
| fo7 | 198.0970 | 3685.7700 | --- | 20.72980000 | mstat(13)sstat(13) |
| fo8 | 640.2760 | 3721.4700 | --- | 22.38190000 | mstat(13)sstat(13) |
| o7_2 | 1445.8500 | 3673.3700 | --- | 116.94600000 | mstat(13)sstat(13) |
| RSyn0805M02M | 33.0650 | 196.3370 | --- | 2238.40000000 | mstat( 7)sstat( 1) |
| RSyn0805M03M | 122.8370 | 3703.6000 | --- | 3068.93000000 | mstat(14)sstat( 3) |
| RSyn0805M04M | 137.0390 | 1229.7900 | --- | 7174.22000000 | mstat( 7)sstat( 1) |
| RSyn0810M02M | 37.8070 | 596.9260 | --- | 1741.39000000 | mstat( 7)sstat( 1) |
| RSyn0810M03M | 145.8620 | 3686.5800 | --- | 2722.45000000 | mstat(14)sstat( 3) |
| RSyn0820M | 3.0760 | 157.1810 | --- | 1150.30000000 | mstat( 7)sstat( 1) |
| RSyn0830M04H | 16.5910 | 24.4340 | --- | 2529.07000000 | mstat( 7)sstat( 1) |
| RSyn0840M | 2.1410 | 2.7490 | --- | 325.55500000 | mstat( 7)sstat( 1) |
| SLay07H | 34.2010 | 3627.2700 | --- | 64748.80000000 | mstat(14)sstat( 3) |
| SLay08H | 156.7540 | 3635.4700 | --- | 84960.20000000 | mstat(14)sstat( 3) |
| SLay09H | 249.6040 | 3617.7400 | --- | 107806.00000000 | mstat(14)sstat( 3) |
| SLay09M | 61.7340 | 3686.9500 | --- | 107806.00000000 | mstat(13)sstat(13) |
| SLay10M | 290.0790 | 3677.9800 | --- | 129582.00000000 | mstat(14)sstat( 3) |
| Syn20M04M | 9.7760 | 7.0530 | --- | 3532.74000000 | mstat( 7)sstat( 1) |
| Syn30M02M | 3.7850 | 3.8490 | --- | 399.68300000 | mstat( 7)sstat( 1) |
| Syn40M03H | 6.5770 | 6.3620 | --- | 395.14900000 | mstat( 7)sstat( 1) |
| sssd-12-5-3 | 37.9120 | 3691.4300 | --- | 261143.00000000 | mstat(13)sstat(13) |
| sssd-15-6-3 | 722.8900 | 3721.9300 | --- | 440711.00000000 | mstat(13)sstat(13) |
BONMIN_bonmin-ecp: feasible -- BONMIN_bonmin-oa: fail
Back to top
| Modelname | Time (BONMIN_bonmin-ecp) | Time (BONMIN_bonmin-oa) | Ratio (BONMIN_bonmin-ecp/BONMIN_bonmin-oa) | Obj (BONMIN_bonmin-ecp) | Status (BONMIN_bonmin-oa) |
|---|---|---|---|---|---|
| FLay06M | 3618.6800 | 3644.7400 | --- | 66.93280000 | mstat(14)sstat( 3) |
| uflquad-30-100 | 3608.0900 | 3647.3200 | --- | 402.51100000 | mstat(14)sstat( 3) |
| uflquad-40-80 | 3660.0900 | 3669.3800 | --- | 471.45900000 | mstat(14)sstat( 3) |
BONMIN_bonmin-ecp: fail -- BONMIN_bonmin-oa: fail
Back to top
| Modelname | Time (BONMIN_bonmin-ecp) | Time (BONMIN_bonmin-oa) | Ratio (BONMIN_bonmin-ecp/BONMIN_bonmin-oa) | Status (BONMIN_bonmin-ecp) | Status (BONMIN_bonmin-oa) |
|---|---|---|---|---|---|
| uflquad-20-150 | 2753.5300 | 3655.2000 | --- | mstat(13)sstat(13) | mstat(14)sstat( 3) |
BONMIN_bonmin-ecp: optimal:
| Modelname | Time (BONMIN_bonmin-ecp) | Obj (BONMIN_bonmin-ecp) |
|---|---|---|
| BatchS101006M | 21.3340 | 769440.00000000 |
| BatchS121208M | 38.2670 | 1241130.00000000 |
| BatchS151208M | 97.3900 | 1543470.00000000 |
| BatchS201210M | 325.7510 | 2295350.00000000 |
| clay0303h | 4.5020 | 26669.10000000 |
| clay0304h | 35.1310 | 40262.40000000 |
| clay0304m | 8.9910 | 40262.40000000 |
| clay0305h | 75.8600 | 8092.50000000 |
| clay0305m | 8.8670 | 8092.50000000 |
| FLay04H | 6.0250 | 54.40590000 |
| FLay05H | 318.1820 | 64.49810000 |
| FLay05M | 65.6850 | 64.49810000 |
| fo7_2 | 120.9320 | 17.74930000 |
| fo7 | 198.0970 | 20.72980000 |
| fo8 | 640.2760 | 22.38190000 |
| m6 | 7.0040 | 82.25690000 |
| m7 | 30.9180 | 106.75700000 |
| o7_2 | 1445.8500 | 116.94600000 |
| RSyn0805H | 0.2140 | 1296.12000000 |
| RSyn0805M02M | 33.0650 | 2238.40000000 |
| RSyn0805M03M | 122.8370 | 3068.93000000 |
| RSyn0805M04M | 137.0390 | 7174.22000000 |
| RSyn0810M02M | 37.8070 | 1741.39000000 |
| RSyn0810M03M | 145.8620 | 2722.45000000 |
| RSyn0820M | 3.0760 | 1150.30000000 |
| RSyn0830M04H | 16.5910 | 2529.07000000 |
| RSyn0830M | 3.3660 | 510.07200000 |
| RSyn0840M | 2.1410 | 325.55500000 |
| SLay06H | 13.8250 | 32757.00000000 |
| SLay07H | 34.2010 | 64748.80000000 |
| SLay08H | 156.7540 | 84960.20000000 |
| SLay09H | 249.6040 | 107806.00000000 |
| SLay09M | 61.7340 | 107806.00000000 |
| SLay10M | 290.0790 | 129582.00000000 |
| Syn15M04M | 3.9740 | 4937.48000000 |
| Syn20M03M | 2.9390 | 2646.95000000 |
| Syn20M04M | 9.7760 | 3532.74000000 |
| Syn30M02M | 3.7850 | 399.68300000 |
| Syn40M03H | 6.5770 | 395.14900000 |
| Syn40M | 0.5750 | 67.71330000 |
| sssd-10-4-3 | 10.4260 | 152710.00000000 |
| sssd-12-5-3 | 37.9120 | 261143.00000000 |
| sssd-15-6-3 | 722.8900 | 440711.00000000 |
BONMIN_bonmin-ecp: feasible:
| Modelname | Time (BONMIN_bonmin-ecp) | Obj (BONMIN_bonmin-ecp) |
|---|---|---|
| FLay06M | 3618.6800 | 66.93280000 |
| uflquad-30-100 | 3608.0900 | 402.51100000 |
| uflquad-40-80 | 3660.0900 | 471.45900000 |
BONMIN_bonmin-ecp: fail:
| Modelname | Time (BONMIN_bonmin-ecp) | Status (BONMIN_bonmin-ecp) |
|---|---|---|
| uflquad-20-150 | -- | mstat(13) sstat(13) |
BONMIN_bonmin-oa: optimal:
| Modelname | Time (BONMIN_bonmin-oa) | Obj (BONMIN_bonmin-oa) |
|---|---|---|
| BatchS101006M | 738.1540 | 769440.00000000 |
| clay0303h | 5.2530 | 26669.10000000 |
| clay0304h | 84.5310 | 40262.40000000 |
| clay0305h | 222.3060 | 8092.50000000 |
| clay0305m | 87.2670 | 8092.50000000 |
| FLay04H | 61.0060 | 54.40590000 |
| fo7_2 | 2825.8600 | 17.74930000 |
| m6 | 23.1960 | 82.25690000 |
| m7 | 390.7020 | 106.75700000 |
| RSyn0805H | 0.2660 | 1296.12000000 |
| RSyn0830M | 286.2480 | 510.07200000 |
| SLay06H | 762.8520 | 32757.00000000 |
| Syn15M04M | 8.9530 | 4937.48000000 |
| Syn20M03M | 10.9000 | 2646.95000000 |
| Syn40M | 1.5460 | 67.71330000 |
| sssd-10-4-3 | 393.7720 | 152710.00000000 |
BONMIN_bonmin-oa: feasible:
| Modelname | Time (BONMIN_bonmin-oa) | Obj (BONMIN_bonmin-oa) |
|---|---|---|
| BatchS201210M | 3624.7600 | 2301300.00000000 |
BONMIN_bonmin-oa: fail:
| Modelname | Time (BONMIN_bonmin-oa) | Status (BONMIN_bonmin-oa) |
|---|---|---|
| BatchS121208M | -- | mstat(14)sstat( 3) |
| BatchS151208M | -- | mstat(14)sstat( 3) |
| clay0304m | -- | mstat( 7)sstat( 1) |
| FLay05H | -- | mstat(14)sstat( 3) |
| FLay05M | -- | mstat(14)sstat( 3) |
| FLay06M | -- | mstat(14)sstat( 3) |
| fo7 | -- | mstat(13)sstat(13) |
| fo8 | -- | mstat(13)sstat(13) |
| o7_2 | -- | mstat(13)sstat(13) |
| RSyn0805M02M | -- | mstat( 7)sstat( 1) |
| RSyn0805M03M | -- | mstat(14)sstat( 3) |
| RSyn0805M04M | -- | mstat( 7)sstat( 1) |
| RSyn0810M02M | -- | mstat( 7)sstat( 1) |
| RSyn0810M03M | -- | mstat(14)sstat( 3) |
| RSyn0820M | -- | mstat( 7)sstat( 1) |
| RSyn0830M04H | -- | mstat( 7)sstat( 1) |
| RSyn0840M | -- | mstat( 7)sstat( 1) |
| SLay07H | -- | mstat(14)sstat( 3) |
| SLay08H | -- | mstat(14)sstat( 3) |
| SLay09H | -- | mstat(14)sstat( 3) |
| SLay09M | -- | mstat(13)sstat(13) |
| SLay10M | -- | mstat(14)sstat( 3) |
| Syn20M04M | -- | mstat( 7)sstat( 1) |
| Syn30M02M | -- | mstat( 7)sstat( 1) |
| Syn40M03H | -- | mstat( 7)sstat( 1) |
| sssd-12-5-3 | -- | mstat(13)sstat(13) |
| sssd-15-6-3 | -- | mstat(13)sstat(13) |
| uflquad-20-150 | -- | mstat(14)sstat( 3) |
| uflquad-30-100 | -- | mstat(14)sstat( 3) |
| uflquad-40-80 | -- | mstat(14)sstat( 3) |
BONMIN_bonmin-ecp: all -- BONMIN_bonmin-oa: all
Back to topA "(max)" behind a model names indicates that this model is a maximization model.
Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.
A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (3721.93 seconds). The shift is 10s.
| Modelname | Time (BONMIN_bonmin-ecp) | Time (BONMIN_bonmin-oa) | Ratio (BONMIN_bonmin-ecp/ BONMIN_bonmin-oa) | Obj (BONMIN_bonmin-ecp) | Obj (BONMIN_bonmin-oa) | ObjEst (BONMIN_bonmin-ecp) | ObjEst (BONMIN_bonmin-oa) | Gap (BONMIN_bonmin-ecp) | Gap (BONMIN_bonmin-oa) |
| BatchS101006M | 21.3340 | 738.1540 | 0.029 | 769440.00000000 | 769440.00000000 | 769440.00000000 | 769440.00000000 | 0.0000 | 0.0000 |
| BatchS121208M | 38.2670 | 3634.0900 | --- | 1241130.00000000 | mstat(14) sstat(3) | 1241130.00000000 | --- | 0.0000 | --- |
| BatchS151208M | 97.3900 | 3628.4500 | --- | 1543470.00000000 | mstat(14) sstat(3) | 1543470.00000000 | --- | 0.0000 | --- |
| BatchS201210M | 325.7510 | 3624.7600 | 0.090 | 2295350.00000000 | 2301300.00000000 | 2295350.00000000 | 2255300.00000000 | 0.0000 | 0.0204 |
| clay0303h | 4.5020 | 5.2530 | 0.857 | 26669.10000000 | 26669.10000000 | 26669.10000000 | 26669.10000000 | 0.0000 | 0.0000 |
| clay0304h | 35.1310 | 84.5310 | 0.416 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 0.0000 | 0.0000 |
| clay0304m | 8.9910 | 2.0000 | --- | 40262.40000000 | mstat( 7) sstat(1) | 40262.40000000 | --- | 0.0000 | --- |
| clay0305h | 75.8600 | 222.3060 | 0.341 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
| clay0305m | 8.8670 | 87.2670 | 0.102 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
| FLay04H | 6.0250 | 61.0060 | 0.099 | 54.40590000 | 54.40590000 | 54.40590000 | 54.40590000 | 0.0000 | 0.0000 |
| FLay05H | 318.1820 | 3626.8000 | --- | 64.49810000 | mstat(14) sstat(3) | 64.49810000 | --- | 0.0000 | --- |
| FLay05M | 65.6850 | 3665.8300 | --- | 64.49810000 | mstat(14) sstat(3) | 64.49810000 | --- | 0.0000 | --- |
| FLay06M | 3618.6800 | 3644.7400 | --- | 66.93280000 | mstat(14) sstat(3) | 64.31940000 | --- | 0.0406 | --- |
| fo7_2 | 120.9320 | 2825.8600 | 0.043 | 17.74930000 | 17.74930000 | 17.74930000 | 17.74930000 | 0.0000 | 0.0000 |
| fo7 | 198.0970 | 3685.7700 | --- | 20.72980000 | mstat(13) sstat(13) | 20.72980000 | --- | 0.0000 | --- |
| fo8 | 640.2760 | 3721.4700 | --- | 22.38190000 | mstat(13) sstat(13) | 22.38190000 | --- | 0.0000 | --- |
| m6 | 7.0040 | 23.1960 | 0.302 | 82.25690000 | 82.25690000 | 82.25690000 | 82.25690000 | 0.0000 | 0.0000 |
| m7 | 30.9180 | 390.7020 | 0.079 | 106.75700000 | 106.75700000 | 106.75700000 | 106.75700000 | 0.0000 | 0.0000 |
| o7_2 | 1445.8500 | 3673.3700 | --- | 116.94600000 | mstat(13) sstat(13) | 116.94600000 | --- | 0.0000 | --- |
| RSyn0805H (max) | 0.2140 | 0.2660 | 0.805 | 1296.12000000 | 1296.12000000 | 1296.12000000 | 1296.12000000 | 0.0000 | 0.0000 |
| RSyn0805M02M (max) | 33.0650 | 196.3370 | --- | 2238.40000000 | mstat( 7) sstat(1) | 2238.40000000 | --- | 0.0000 | --- |
| RSyn0805M03M (max) | 122.8370 | 3703.6000 | --- | 3068.93000000 | mstat(14) sstat(3) | 3068.93000000 | --- | 0.0000 | --- |
| RSyn0805M04M (max) | 137.0390 | 1229.7900 | --- | 7174.22000000 | mstat( 7) sstat(1) | 7174.22000000 | --- | 0.0000 | --- |
| RSyn0810M02M (max) | 37.8070 | 596.9260 | --- | 1741.39000000 | mstat( 7) sstat(1) | 1741.39000000 | --- | 0.0000 | --- |
| RSyn0810M03M (max) | 145.8620 | 3686.5800 | --- | 2722.45000000 | mstat(14) sstat(3) | 2722.45000000 | --- | 0.0000 | --- |
| RSyn0820M (max) | 3.0760 | 157.1810 | --- | 1150.30000000 | mstat( 7) sstat(1) | 1150.30000000 | --- | 0.0000 | --- |
| RSyn0830M04H (max) | 16.5910 | 24.4340 | --- | 2529.07000000 | mstat( 7) sstat(1) | 2529.07000000 | --- | 0.0000 | --- |
| RSyn0830M (max) | 3.3660 | 286.2480 | 0.012 | 510.07200000 | 510.07200000 | 510.07200000 | 510.07200000 | 0.0000 | 0.0000 |
| RSyn0840M (max) | 2.1410 | 2.7490 | --- | 325.55500000 | mstat( 7) sstat(1) | 325.55500000 | --- | 0.0000 | --- |
| SLay06H | 13.8250 | 762.8520 | 0.018 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 0.0000 | 0.0000 |
| SLay07H | 34.2010 | 3627.2700 | --- | 64748.80000000 | mstat(14) sstat(3) | 64748.80000000 | --- | 0.0000 | --- |
| SLay08H | 156.7540 | 3635.4700 | --- | 84960.20000000 | mstat(14) sstat(3) | 84960.20000000 | --- | 0.0000 | --- |
| SLay09H | 249.6040 | 3617.7400 | --- | 107806.00000000 | mstat(14) sstat(3) | 107806.00000000 | --- | 0.0000 | --- |
| SLay09M | 61.7340 | 3686.9500 | --- | 107806.00000000 | mstat(13) sstat(13) | 107806.00000000 | --- | 0.0000 | --- |
| SLay10M | 290.0790 | 3677.9800 | --- | 129582.00000000 | mstat(14) sstat(3) | 129582.00000000 | --- | 0.0000 | --- |
| Syn15M04M (max) | 3.9740 | 8.9530 | 0.444 | 4937.48000000 | 4937.48000000 | 4937.48000000 | 4937.48000000 | 0.0000 | 0.0000 |
| Syn20M03M (max) | 2.9390 | 10.9000 | 0.270 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 0.0000 | 0.0000 |
| Syn20M04M (max) | 9.7760 | 7.0530 | --- | 3532.74000000 | mstat( 7) sstat(1) | 3532.74000000 | --- | 0.0000 | --- |
| Syn30M02M (max) | 3.7850 | 3.8490 | --- | 399.68300000 | mstat( 7) sstat(1) | 399.68300000 | --- | 0.0000 | --- |
| Syn40M03H (max) | 6.5770 | 6.3620 | --- | 395.14900000 | mstat( 7) sstat(1) | 395.14900000 | --- | 0.0000 | --- |
| Syn40M (max) | 0.5750 | 1.5460 | 0.372 | 67.71330000 | 67.71330000 | 67.71330000 | 67.71330000 | 0.0000 | 0.0000 |
| sssd-10-4-3 | 10.4260 | 393.7720 | 0.026 | 152710.00000000 | 152710.00000000 | 152710.00000000 | 152710.00000000 | 0.0000 | 0.0000 |
| sssd-12-5-3 | 37.9120 | 3691.4300 | --- | 261143.00000000 | mstat(13) sstat(13) | 261143.00000000 | --- | 0.0000 | --- |
| sssd-15-6-3 | 722.8900 | 3721.9300 | --- | 440711.00000000 | mstat(13) sstat(13) | 440711.00000000 | --- | 0.0000 | --- |
| uflquad-20-150 | 2753.5300 | 3655.2000 | --- | mstat(13) sstat(13) | mstat(14) sstat(3) | --- | --- | --- | --- |
| uflquad-30-100 | 3608.0900 | 3647.3200 | --- | 402.51100000 | mstat(14) sstat(3) | 145.03800000 | --- | 1.7752 | --- |
| uflquad-40-80 | 3660.0900 | 3669.3800 | --- | 471.45900000 | mstat(14) sstat(3) | 103.07000000 | --- | 3.5742 | --- | Shifted Geometric Mean (Solved) |
66.47 | 1102.84 |
| % Unsolved | 8.51% | 65.96% |