Solver Square Comparison: Considers all models.
Results created on 09/14/12 19:33:54 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver
Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.
Solver BONMIN_bonmin-oa is represented on the left (rows) and solver SBB_sbb on top (columns).
See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.
| Input File Number | Filename |
|---|---|
| Tracefile 1: | minlpconvex_bonmin-oa.pav |
| Tracefile 2: | minlpconvex_sbb.pav |
| Solvers used : | BONMIN_bonmin-oa |
| SBB_sbb | |
| Modeltype(s) | MINLP |
| SBB_sbb: optimal |
SBB_sbb: locally optimal |
SBB_sbb: feasible |
SBB_sbb: infeasible |
SBB_sbb: unbounded |
SBB_sbb: fail |
SBB_sbb: no data |
total BONMIN_bonmin-oa | |
| BONMIN_bonmin-oa: optimal | 67 | - | 14 | - | - | 1 | - | 82 |
| BONMIN_bonmin-oa: locally optimal | - | - | - | - | - | - | - | - |
| BONMIN_bonmin-oa: feasible | - | - | - | - | - | - | - | - |
| BONMIN_bonmin-oa: infeasible | - | - | - | - | - | - | - | - |
| BONMIN_bonmin-oa: unbounded | - | - | - | - | - | - | - | - |
| BONMIN_bonmin-oa: fail | 11 | - | 52 | - | - | 10 | - | 73 |
| BONMIN_bonmin-oa: no data | - | - | - | - | - | - | - | - |
| total SBB_sbb | 78 | - | 66 | - | - | 11 | - | 155 |
Solver return definitions:
| Outcome | Model Status | Solver Status |
|---|---|---|
| optimal | 1 or 15 | 1 |
| locally optimal | 2 | any |
| feasible | 8 or 16 | 1 or 2 or 3 or 4 or 5 |
| infeasible | 4 or 5 or 10 or 19 | 1 |
| unbounded | 3 or 18 | 1 |
| fail | all other | all other |
Solver Resource Times
- Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
- Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.50E-04. If both solutions are less than 1e-1, we use the absolute difference.
- Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.
BONMIN_bonmin-oa: optimal -- SBB_sbb: optimal
Back to top
| Modelname | Time (BONMIN_bonmin-oa) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-oa/SBB_sbb) | Obj (BONMIN_bonmin-oa) | Obj (SBB_sbb) |
|---|---|---|---|---|---|
| BatchS101006M | 443.5540 | 81.6070 | 5.435 | 769440.00000000 | 769440.00000000 |
| BatchS121208M | 655.4940 | 99.3970 | 6.595 | 1241130.00000000 | 1241130.00000000 |
| BatchS151208M | 4421.2200 | 123.5030 | 35.798 | 1543470.00000000 | 1543470.00000000 |
| clay0203h | 3.1620 | 3.9370 | 0.803 | 41573.30000000 | 41573.30000000 |
| clay0203m | 2.1970 | 1.8450 | 1.191 | 41573.30000000 | 41573.30000000 |
| clay0204h | 7.6910 | 43.6850 | 0.176 | 6545.00000000 | 6545.00000000 |
| clay0204m | 3.3410 | 10.9330 | 0.306 | 6545.00000000 | 6545.00000000 |
| clay0205h | 1044.7000 | 688.0400 | 1.518 | 8092.50000000 | 8092.50000000 |
| clay0205m | 122.4660 | 231.4940 | 0.529 | 8092.50000000 | 8092.50000000 |
| clay0303h | 5.9620 | 6.9610 | 0.856 | 26669.10000000 | 26669.10000000 |
| clay0304h | 263.1000 | 510.2070 | 0.516 | 40262.40000000 | 40262.40000000 |
| clay0304m | 304.5220 | 94.4630 | 3.224 | 40262.40000000 | 40262.40000000 |
| clay0305h | 3838.3900 | 1521.9900 | 2.522 | 8092.50000000 | 8092.50000000 |
| clay0305m | 258.4510 | 186.2620 | 1.388 | 8092.50000000 | 8092.50000000 |
| FLay03H | 1.9810 | 1.0190 | 1.944 | 48.98980000 | 48.98980000 |
| FLay03M | 0.7030 | 0.6440 | 1.092 | 48.98980000 | 48.98980000 |
| FLay04H | 188.1580 | 25.2120 | 7.463 | 54.40590000 | 54.40590000 |
| FLay04M | 21.4410 | 10.0850 | 2.126 | 54.40590000 | 54.40590000 |
| RSyn0810H | 0.3760 | 2.9460 | 0.128 | 1721.45000000 | 1721.45000000 |
| RSyn0810M02H | 3.1690 | 20.7120 | 0.153 | 1741.39000000 | 1741.39000000 |
| RSyn0810M03H | 16.1540 | 106.6050 | 0.152 | 2722.45000000 | 2722.45000000 |
| RSyn0810M04H | 5.9150 | 30.6420 | 0.193 | 6581.94000000 | 6581.94000000 |
| RSyn0810M | 5.4510 | 788.8410 | 0.007 | 1721.45000000 | 1721.45000000 |
| RSyn0820H | 2.8310 | 4.6940 | 0.603 | 1150.30000000 | 1150.30000000 |
| RSyn0820M02H | 4.7770 | 58.5700 | 0.082 | 1092.09000000 | 1092.09000000 |
| RSyn0820M03H | 40.6240 | 514.5710 | 0.079 | 2028.81000000 | 2028.81000000 |
| RSyn0820M04H | 23.8390 | 427.0530 | 0.056 | 2450.77000000 | 2450.77000000 |
| RSyn0820M | 26.1020 | 7190.5900 | 0.004 | 1150.30000000 | 1150.30000000 |
| RSyn0840H | 0.9380 | 2.1890 | 0.429 | 325.55500000 | 325.55500000 |
| RSyn0840M02H | 2.6350 | 18.9290 | 0.139 | 734.98400000 | 734.98400000 |
| RSyn0840M03H | 16.8210 | 113.8710 | 0.148 | 2742.65000000 | 2742.65000000 |
| RSyn0840M04H | 20.5300 | 740.9130 | 0.028 | 2564.50000000 | 2564.50000000 |
| SLay05H | 17.2600 | 22.2240 | 0.777 | 22664.70000000 | 22664.70000000 |
| SLay05M | 2.3100 | 2.3020 | 1.003 | 22664.70000000 | 22664.70000000 |
| SLay06H | 1071.9600 | 387.8510 | 2.764 | 32757.00000000 | 32757.00000000 |
| SLay06M | 5.9020 | 1.1210 | 5.265 | 32757.00000000 | 32757.00000000 |
| SLay07M | 75.2940 | 13.6680 | 5.509 | 64748.80000000 | 64748.80000000 |
| SLay08M | 4354.4900 | 4.8160 | 904.172 | 84960.20000000 | 84960.20000000 |
| Syn10H | 0.1470 | 0.1120 | 1.313 | 1267.35000000 | 1267.35000000 |
| Syn10M02H | 0.2170 | 0.2850 | 0.761 | 2310.30000000 | 2310.30000000 |
| Syn10M02M | 0.3820 | 3.3410 | 0.114 | 2310.30000000 | 2310.30000000 |
| Syn10M03H | 0.2580 | 0.4480 | 0.576 | 3354.68000000 | 3354.68000000 |
| Syn10M03M | 1.2110 | 13.2780 | 0.091 | 3354.68000000 | 3354.68000000 |
| Syn10M04H | 0.2430 | 0.5910 | 0.411 | 4557.06000000 | 4557.06000000 |
| Syn10M04M | 1.1090 | 58.3070 | 0.019 | 4557.06000000 | 4557.06000000 |
| Syn10M | 0.1230 | 0.2170 | 0.567 | 1267.35000000 | 1267.35000000 |
| Syn20H | 0.2340 | 0.2040 | 1.147 | 924.26300000 | 924.26300000 |
| Syn20M02H | 0.5260 | 0.9990 | 0.527 | 1752.13000000 | 1752.13000000 |
| Syn20M02M | 1.7920 | 819.5300 | 0.002 | 1752.13000000 | 1752.13000000 |
| Syn20M03H | 0.3970 | 1.1720 | 0.339 | 2646.95000000 | 2646.95000000 |
| Syn20M04H | 0.6710 | 1.7440 | 0.385 | 3532.74000000 | 3532.74000000 |
| Syn20M | 0.3360 | 3.3160 | 0.101 | 924.26300000 | 924.26300000 |
| Syn40H | 0.9220 | 0.8680 | 1.062 | 67.71340000 | 67.71340000 |
| Syn40M02H | 1.4350 | 3.8970 | 0.368 | 388.77300000 | 388.77300000 |
| Syn40M03H | 5.6220 | 16.2270 | 0.346 | 395.14900000 | 395.14900000 |
| Syn40M04H | 16.9830 | 60.9210 | 0.279 | 901.75200000 | 901.75200000 |
| sssd-8-4-3 | 24.5310 | 931.0760 | 0.026 | 197181.00000000 | 197181.00000000 |
| uflquad-25-25 | 3815.8500 | 5.7650 | 661.899 | 673.69700000 | 673.69700000 |
| uflquad-25-30 | 3352.3800 | 4.6730 | 717.394 | 669.84000000 | 669.84000000 |
| nd-10 | 448.2020 | 472.2360 | 0.949 | 52.46110000 | 52.46110000 |
| nd-12 | 660.6810 | 2721.8200 | 0.243 | 56.66960000 | 56.66960000 |
| m3 | 0.1970 | 0.4660 | 0.423 | 37.80000000 | 37.80000000 |
| m6 | 19.7720 | 1321.2900 | 0.015 | 82.25690000 | 82.25690000 |
| m7_ar2_1 | 150.4520 | 2283.0700 | 0.066 | 190.23500000 | 190.23500000 |
| m7_ar25_1 | 51.6280 | 4391.6700 | 0.012 | 143.58500000 | 143.58500000 |
| m7_ar4_1 | 864.4930 | 7134.8100 | 0.121 | 106.75700000 | 106.75700000 |
| tls2 | 0.9500 | 4.2320 | 0.224 | 5.30000000 | 5.30000000 |
BONMIN_bonmin-oa: optimal -- SBB_sbb: feasible
Back to top
| Modelname | Time (BONMIN_bonmin-oa) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-oa/SBB_sbb) | Obj (BONMIN_bonmin-oa) | Obj (SBB_sbb) |
|---|---|---|---|---|---|
| RSyn0810M02M | 1576.3700 | 8679.9900 | 0.182 | 1741.39000000 | 1592.16000000 |
| RSyn0840M02M | 4692.2000 | 8159.1100 | 0.575 | 734.98400000 | 191.12600000 |
| RSyn0840M | 71.2250 | 11688.7000 | 0.006 | 325.55500000 | 247.39700000 |
| Syn20M03M | 11.1250 | 7954.4200 | 0.001 | 2646.95000000 | 2646.95000000 |
| Syn20M04M | 8.8990 | 7781.6900 | 0.001 | 3532.74000000 | 3500.74000000 |
| Syn40M02M | 255.9740 | 8804.5400 | 0.029 | 388.77200000 | 344.48700000 |
| Syn40M | 1.7210 | 10415.2000 | 0.000 | 67.71330000 | 67.71330000 |
| sssd-10-4-3 | 295.4730 | 12944.6000 | 0.023 | 152710.00000000 | 159329.00000000 |
| fo7_2 | 2450.5400 | 7403.9100 | 0.331 | 17.74930000 | 17.74930000 |
| fo7_ar2_1 | 7014.3900 | 7545.5400 | 0.930 | 24.83980000 | 34.87130000 |
| fo7_ar5_1 | 3347.9200 | 7340.0900 | 0.456 | 17.74930000 | 19.01200000 |
| m7_ar3_1 | 726.3280 | 7479.4900 | 0.097 | 143.58500000 | 143.58500000 |
| m7_ar5_1 | 1070.7000 | 7336.1600 | 0.146 | 106.46000000 | 106.46000000 |
| m7 | 140.0070 | 7448.1800 | 0.019 | 106.75700000 | 106.75700000 |
BONMIN_bonmin-oa: optimal -- SBB_sbb: fail
Back to top
| Modelname | Time (BONMIN_bonmin-oa) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-oa/SBB_sbb) | Obj (BONMIN_bonmin-oa) | Status (SBB_sbb) |
|---|---|---|---|---|---|
| clay0303m | 5.6360 | 1.7160 | --- | 26669.10000000 | mstat(13)sstat( 1) |
BONMIN_bonmin-oa: fail -- SBB_sbb: optimal
Back to top
| Modelname | Time (BONMIN_bonmin-oa) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-oa/SBB_sbb) | Status (BONMIN_bonmin-oa) | Obj (SBB_sbb) |
|---|---|---|---|---|---|
| BatchS201210M | 7325.7400 | 517.8210 | --- | mstat(14)sstat( 3) | 2295350.00000000 |
| FLay05M | 7392.0500 | 504.3070 | --- | mstat(14)sstat( 3) | 64.49810000 |
| SLay09M | 7497.8700 | 330.1600 | --- | mstat(14)sstat( 3) | 107806.00000000 |
| SLay10M | 7590.3000 | 538.4240 | --- | mstat(14)sstat( 3) | 129580.00000000 |
| uflquad-15-60 | 7313.5200 | 15.8290 | --- | mstat(14)sstat( 3) | 1063.19000000 |
| uflquad-15-80 | 7304.0200 | 37.1940 | --- | mstat(14)sstat( 3) | 1217.99000000 |
| uflquad-20-40 | 7323.5200 | 19.0030 | --- | mstat(14)sstat( 3) | 860.96100000 |
| uflquad-20-50 | 7309.2200 | 1623.3800 | --- | mstat(14)sstat( 3) | 375.91900000 |
| uflquad-25-40 | 7311.1900 | 27.5040 | --- | mstat(14)sstat( 3) | 828.16500000 |
| netmod_kar1 | 7342.0500 | 204.3500 | --- | mstat(14)sstat( 3) | -0.41979000 |
| netmod_kar2 | 7340.4800 | 202.6730 | --- | mstat(14)sstat( 3) | -0.41979000 |
BONMIN_bonmin-oa: fail -- SBB_sbb: feasible
Back to top
| Modelname | Time (BONMIN_bonmin-oa) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-oa/SBB_sbb) | Status (BONMIN_bonmin-oa) | Obj (SBB_sbb) |
|---|---|---|---|---|---|
| FLay06H | 7444.9700 | 7451.7700 | --- | mstat(14)sstat( 3) | 66.93280000 |
| RSyn0810M03M | 7502.6900 | 7569.2100 | --- | mstat(14)sstat( 3) | 2368.77000000 |
| RSyn0810M04M | 7287.3300 | 7495.6000 | --- | mstat(14)sstat( 3) | 5433.33000000 |
| RSyn0820M02M | 7628.2600 | 7627.2200 | --- | mstat(14)sstat( 3) | 669.53700000 |
| RSyn0820M03M | 7489.7400 | 7451.4200 | --- | mstat(14)sstat( 3) | 1439.77000000 |
| RSyn0820M04M | 7390.2200 | 7396.6400 | --- | mstat(14)sstat( 3) | 1563.83000000 |
| RSyn0840M03M | 7529.0700 | 7609.5000 | --- | mstat(14)sstat( 3) | 2241.35000000 |
| RSyn0840M04M | 7386.2300 | 7575.0000 | --- | mstat(14)sstat( 3) | 2301.43000000 |
| SLay07H | 7358.1300 | 7383.1600 | --- | mstat(14)sstat( 3) | 64748.80000000 |
| SLay08H | 7392.2500 | 7413.2200 | --- | mstat(14)sstat( 3) | 85115.00000000 |
| SLay09H | 7457.6700 | 7412.7900 | --- | mstat(14)sstat( 3) | 122507.00000000 |
| SLay10H | 7430.0300 | 7356.2200 | --- | mstat(14)sstat( 3) | 153256.00000000 |
| Syn40M03M | 7316.0000 | 7548.5800 | --- | mstat(14)sstat( 3) | 294.29000000 |
| Syn40M04M | 7366.7500 | 7557.2600 | --- | mstat(14)sstat( 3) | 831.89600000 |
| sssd-12-5-3 | 7644.0900 | 19374.5000 | --- | mstat(14)sstat( 3) | 330320.00000000 |
| sssd-15-6-3 | 7652.2600 | 15779.7000 | --- | mstat(14)sstat( 3) | 513871.00000000 |
| sssd-16-8-3 | 7560.7900 | 13118.5000 | --- | mstat(14)sstat( 3) | 709652.00000000 |
| sssd-18-8-3 | 7563.5400 | 12851.3000 | --- | mstat(14)sstat( 3) | 637320.00000000 |
| sssd-20-9-3 | 7579.0800 | 11853.3000 | --- | mstat(14)sstat( 3) | 510261.00000000 |
| sssd-22-8-3 | 7595.1700 | 12055.5000 | --- | mstat(14)sstat( 3) | 730203.00000000 |
| nd-13 | 7242.2500 | 7251.3700 | --- | mstat(14)sstat( 3) | 65.90790000 |
| nd-15 | 7317.9200 | 7230.4100 | --- | mstat(14)sstat( 3) | 86.92650000 |
| nd-16 | 7310.7200 | 7227.5800 | --- | mstat(14)sstat( 3) | 102.09800000 |
| fo7_ar25_1 | 7344.8200 | 7414.1500 | --- | mstat(14)sstat( 3) | 25.67840000 |
| fo7_ar3_1 | 7348.9900 | 7413.0500 | --- | mstat(14)sstat( 3) | 23.12100000 |
| fo7_ar4_1 | 7356.0500 | 7368.0300 | --- | mstat(14)sstat( 3) | 29.47550000 |
| fo7 | 7533.0200 | 7431.2200 | --- | mstat(14)sstat( 3) | 28.45230000 |
| fo8_ar2_1 | 7337.5900 | 7498.4800 | --- | mstat(14)sstat( 3) | 48.41990000 |
| fo8_ar25_1 | 7368.5500 | 7372.1000 | --- | mstat(14)sstat( 3) | 41.63040000 |
| fo8_ar3_1 | 7385.6400 | 7329.2200 | --- | mstat(14)sstat( 3) | 40.79120000 |
| fo8_ar4_1 | 7376.7900 | 7294.2400 | --- | mstat(14)sstat( 3) | 33.46530000 |
| fo8_ar5_1 | 7363.1100 | 7299.6800 | --- | mstat(14)sstat( 3) | 45.65780000 |
| fo8 | 7461.6700 | 7381.7800 | --- | mstat(14)sstat( 3) | 41.06960000 |
| fo9_ar5_1 | 7366.9600 | 7263.1100 | --- | mstat(14)sstat( 3) | 41.66030000 |
| fo9 | 7389.2400 | 7344.6400 | --- | mstat(14)sstat( 3) | 49.96150000 |
| netmod_dol1 | 7246.7400 | 7214.8800 | --- | mstat(14)sstat( 3) | -0.55139800 |
| no7_ar2_1 | 7416.5100 | 7471.5700 | --- | mstat(14)sstat( 3) | 151.86000000 |
| no7_ar25_1 | 7478.8100 | 7380.7300 | --- | mstat(14)sstat( 3) | 148.78600000 |
| no7_ar3_1 | 7346.9800 | 7374.7100 | --- | mstat(14)sstat( 3) | 134.42700000 |
| no7_ar4_1 | 7509.2500 | 7367.5900 | --- | mstat(14)sstat( 3) | 120.70100000 |
| no7_ar5_1 | 7520.3100 | 7343.6400 | --- | mstat(14)sstat( 3) | 118.38200000 |
| o7_2 | 7491.1900 | 7409.9700 | --- | mstat(14)sstat( 3) | 122.35300000 |
| o7_ar2_1 | 7377.7100 | 7458.1000 | --- | mstat(14)sstat( 3) | 177.94600000 |
| o7_ar25_1 | 7508.8200 | 7424.6000 | --- | mstat(14)sstat( 3) | 180.92200000 |
| o7_ar3_1 | 7447.6000 | 7369.9300 | --- | mstat(14)sstat( 3) | 163.97700000 |
| o7_ar4_1 | 7486.9600 | 7346.2800 | --- | mstat(14)sstat( 3) | 183.00000000 |
| o7_ar5_1 | 7509.7000 | 7350.2000 | --- | mstat(14)sstat( 3) | 129.23900000 |
| o7 | 7602.1300 | 7424.4200 | --- | mstat(14)sstat( 3) | 165.39600000 |
| o8_ar4_1 | 7422.9300 | 7302.2300 | --- | mstat(14)sstat( 3) | 304.80900000 |
| tls4 | 7444.0400 | 15208.6000 | --- | mstat(14)sstat( 3) | 13.70000000 |
| tls5 | 7519.4400 | 10552.2000 | --- | mstat(14)sstat( 3) | 15.60000000 |
| tls6 | 7442.1800 | 9148.5200 | --- | mstat(14)sstat( 3) | 21.40000000 |
BONMIN_bonmin-oa: fail -- SBB_sbb: fail
Back to top
| Modelname | Time (BONMIN_bonmin-oa) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-oa/SBB_sbb) | Status (BONMIN_bonmin-oa) | Status (SBB_sbb) |
|---|---|---|---|---|---|
| FLay05H | 7414.4400 | 2611.9300 | --- | mstat(14)sstat( 3) | mstat(13)sstat( 1) |
| FLay06M | 7509.8000 | 11788.9000 | --- | mstat(14)sstat( 3) | mstat(13)sstat( 1) |
| fo9_ar2_1 | 7319.4100 | 7424.3900 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
| fo9_ar25_1 | 7320.8600 | 7375.1300 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
| fo9_ar3_1 | 7355.2500 | 7292.3500 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
| fo9_ar4_1 | 7367.7300 | 7268.4700 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
| netmod_dol2 | 7226.8800 | 5.3840 | --- | mstat(14)sstat( 3) | mstat(13)sstat(13) |
| o9_ar4_1 | 7408.1400 | 7297.6900 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
| tls12 | 7447.2500 | 7667.1300 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
| tls7 | 7301.9600 | 8474.5600 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
BONMIN_bonmin-oa: optimal:
| Modelname | Time (BONMIN_bonmin-oa) | Obj (BONMIN_bonmin-oa) |
|---|---|---|
| BatchS101006M | 443.5540 | 769440.00000000 |
| BatchS121208M | 655.4940 | 1241130.00000000 |
| BatchS151208M | 4421.2200 | 1543470.00000000 |
| clay0203h | 3.1620 | 41573.30000000 |
| clay0203m | 2.1970 | 41573.30000000 |
| clay0204h | 7.6910 | 6545.00000000 |
| clay0204m | 3.3410 | 6545.00000000 |
| clay0205h | 1044.7000 | 8092.50000000 |
| clay0205m | 122.4660 | 8092.50000000 |
| clay0303h | 5.9620 | 26669.10000000 |
| clay0303m | 5.6360 | 26669.10000000 |
| clay0304h | 263.1000 | 40262.40000000 |
| clay0304m | 304.5220 | 40262.40000000 |
| clay0305h | 3838.3900 | 8092.50000000 |
| clay0305m | 258.4510 | 8092.50000000 |
| FLay03H | 1.9810 | 48.98980000 |
| FLay03M | 0.7030 | 48.98980000 |
| FLay04H | 188.1580 | 54.40590000 |
| FLay04M | 21.4410 | 54.40590000 |
| RSyn0810H | 0.3760 | 1721.45000000 |
| RSyn0810M02H | 3.1690 | 1741.39000000 |
| RSyn0810M02M | 1576.3700 | 1741.39000000 |
| RSyn0810M03H | 16.1540 | 2722.45000000 |
| RSyn0810M04H | 5.9150 | 6581.94000000 |
| RSyn0810M | 5.4510 | 1721.45000000 |
| RSyn0820H | 2.8310 | 1150.30000000 |
| RSyn0820M02H | 4.7770 | 1092.09000000 |
| RSyn0820M03H | 40.6240 | 2028.81000000 |
| RSyn0820M04H | 23.8390 | 2450.77000000 |
| RSyn0820M | 26.1020 | 1150.30000000 |
| RSyn0840H | 0.9380 | 325.55500000 |
| RSyn0840M02H | 2.6350 | 734.98400000 |
| RSyn0840M02M | 4692.2000 | 734.98400000 |
| RSyn0840M03H | 16.8210 | 2742.65000000 |
| RSyn0840M04H | 20.5300 | 2564.50000000 |
| RSyn0840M | 71.2250 | 325.55500000 |
| SLay05H | 17.2600 | 22664.70000000 |
| SLay05M | 2.3100 | 22664.70000000 |
| SLay06H | 1071.9600 | 32757.00000000 |
| SLay06M | 5.9020 | 32757.00000000 |
| SLay07M | 75.2940 | 64748.80000000 |
| SLay08M | 4354.4900 | 84960.20000000 |
| Syn10H | 0.1470 | 1267.35000000 |
| Syn10M02H | 0.2170 | 2310.30000000 |
| Syn10M02M | 0.3820 | 2310.30000000 |
| Syn10M03H | 0.2580 | 3354.68000000 |
| Syn10M03M | 1.2110 | 3354.68000000 |
| Syn10M04H | 0.2430 | 4557.06000000 |
| Syn10M04M | 1.1090 | 4557.06000000 |
| Syn10M | 0.1230 | 1267.35000000 |
| Syn20H | 0.2340 | 924.26300000 |
| Syn20M02H | 0.5260 | 1752.13000000 |
| Syn20M02M | 1.7920 | 1752.13000000 |
| Syn20M03H | 0.3970 | 2646.95000000 |
| Syn20M03M | 11.1250 | 2646.95000000 |
| Syn20M04H | 0.6710 | 3532.74000000 |
| Syn20M04M | 8.8990 | 3532.74000000 |
| Syn20M | 0.3360 | 924.26300000 |
| Syn40H | 0.9220 | 67.71340000 |
| Syn40M02H | 1.4350 | 388.77300000 |
| Syn40M02M | 255.9740 | 388.77200000 |
| Syn40M03H | 5.6220 | 395.14900000 |
| Syn40M04H | 16.9830 | 901.75200000 |
| Syn40M | 1.7210 | 67.71330000 |
| sssd-8-4-3 | 24.5310 | 197181.00000000 |
| sssd-10-4-3 | 295.4730 | 152710.00000000 |
| uflquad-25-25 | 3815.8500 | 673.69700000 |
| uflquad-25-30 | 3352.3800 | 669.84000000 |
| nd-10 | 448.2020 | 52.46110000 |
| nd-12 | 660.6810 | 56.66960000 |
| fo7_2 | 2450.5400 | 17.74930000 |
| fo7_ar2_1 | 7014.3900 | 24.83980000 |
| fo7_ar5_1 | 3347.9200 | 17.74930000 |
| m3 | 0.1970 | 37.80000000 |
| m6 | 19.7720 | 82.25690000 |
| m7_ar2_1 | 150.4520 | 190.23500000 |
| m7_ar25_1 | 51.6280 | 143.58500000 |
| m7_ar3_1 | 726.3280 | 143.58500000 |
| m7_ar4_1 | 864.4930 | 106.75700000 |
| m7_ar5_1 | 1070.7000 | 106.46000000 |
| m7 | 140.0070 | 106.75700000 |
| tls2 | 0.9500 | 5.30000000 |
BONMIN_bonmin-oa: fail:
| Modelname | Time (BONMIN_bonmin-oa) | Status (BONMIN_bonmin-oa) |
|---|---|---|
| BatchS201210M | -- | mstat(14) sstat( 3) |
| FLay05H | -- | mstat(14) sstat( 3) |
| FLay05M | -- | mstat(14) sstat( 3) |
| FLay06H | -- | mstat(14) sstat( 3) |
| FLay06M | -- | mstat(14) sstat( 3) |
| RSyn0810M03M | -- | mstat(14) sstat( 3) |
| RSyn0810M04M | -- | mstat(14) sstat( 3) |
| RSyn0820M02M | -- | mstat(14) sstat( 3) |
| RSyn0820M03M | -- | mstat(14) sstat( 3) |
| RSyn0820M04M | -- | mstat(14) sstat( 3) |
| RSyn0840M03M | -- | mstat(14) sstat( 3) |
| RSyn0840M04M | -- | mstat(14) sstat( 3) |
| SLay07H | -- | mstat(14) sstat( 3) |
| SLay08H | -- | mstat(14) sstat( 3) |
| SLay09H | -- | mstat(14) sstat( 3) |
| SLay09M | -- | mstat(14) sstat( 3) |
| SLay10H | -- | mstat(14) sstat( 3) |
| SLay10M | -- | mstat(14) sstat( 3) |
| Syn40M03M | -- | mstat(14) sstat( 3) |
| Syn40M04M | -- | mstat(14) sstat( 3) |
| sssd-12-5-3 | -- | mstat(14) sstat( 3) |
| sssd-15-6-3 | -- | mstat(14) sstat( 3) |
| sssd-16-8-3 | -- | mstat(14) sstat( 3) |
| sssd-18-8-3 | -- | mstat(14) sstat( 3) |
| sssd-20-9-3 | -- | mstat(14) sstat( 3) |
| sssd-22-8-3 | -- | mstat(14) sstat( 3) |
| uflquad-15-60 | -- | mstat(14) sstat( 3) |
| uflquad-15-80 | -- | mstat(14) sstat( 3) |
| uflquad-20-40 | -- | mstat(14) sstat( 3) |
| uflquad-20-50 | -- | mstat(14) sstat( 3) |
| uflquad-25-40 | -- | mstat(14) sstat( 3) |
| nd-13 | -- | mstat(14) sstat( 3) |
| nd-15 | -- | mstat(14) sstat( 3) |
| nd-16 | -- | mstat(14) sstat( 3) |
| fo7_ar25_1 | -- | mstat(14) sstat( 3) |
| fo7_ar3_1 | -- | mstat(14) sstat( 3) |
| fo7_ar4_1 | -- | mstat(14) sstat( 3) |
| fo7 | -- | mstat(14) sstat( 3) |
| fo8_ar2_1 | -- | mstat(14) sstat( 3) |
| fo8_ar25_1 | -- | mstat(14) sstat( 3) |
| fo8_ar3_1 | -- | mstat(14) sstat( 3) |
| fo8_ar4_1 | -- | mstat(14) sstat( 3) |
| fo8_ar5_1 | -- | mstat(14) sstat( 3) |
| fo8 | -- | mstat(14) sstat( 3) |
| fo9_ar2_1 | -- | mstat(14) sstat( 3) |
| fo9_ar25_1 | -- | mstat(14) sstat( 3) |
| fo9_ar3_1 | -- | mstat(14) sstat( 3) |
| fo9_ar4_1 | -- | mstat(14) sstat( 3) |
| fo9_ar5_1 | -- | mstat(14) sstat( 3) |
| fo9 | -- | mstat(14) sstat( 3) |
| netmod_dol1 | -- | mstat(14) sstat( 3) |
| netmod_dol2 | -- | mstat(14) sstat( 3) |
| netmod_kar1 | -- | mstat(14) sstat( 3) |
| netmod_kar2 | -- | mstat(14) sstat( 3) |
| no7_ar2_1 | -- | mstat(14) sstat( 3) |
| no7_ar25_1 | -- | mstat(14) sstat( 3) |
| no7_ar3_1 | -- | mstat(14) sstat( 3) |
| no7_ar4_1 | -- | mstat(14) sstat( 3) |
| no7_ar5_1 | -- | mstat(14) sstat( 3) |
| o7_2 | -- | mstat(14) sstat( 3) |
| o7_ar2_1 | -- | mstat(14) sstat( 3) |
| o7_ar25_1 | -- | mstat(14) sstat( 3) |
| o7_ar3_1 | -- | mstat(14) sstat( 3) |
| o7_ar4_1 | -- | mstat(14) sstat( 3) |
| o7_ar5_1 | -- | mstat(14) sstat( 3) |
| o7 | -- | mstat(14) sstat( 3) |
| o8_ar4_1 | -- | mstat(14) sstat( 3) |
| o9_ar4_1 | -- | mstat(14) sstat( 3) |
| tls12 | -- | mstat(14) sstat( 3) |
| tls4 | -- | mstat(14) sstat( 3) |
| tls5 | -- | mstat(14) sstat( 3) |
| tls6 | -- | mstat(14) sstat( 3) |
| tls7 | -- | mstat(14) sstat( 3) |
SBB_sbb: optimal:
| Modelname | Time (SBB_sbb) | Obj (SBB_sbb) |
|---|---|---|
| BatchS101006M | 81.6070 | 769440.00000000 |
| BatchS121208M | 99.3970 | 1241130.00000000 |
| BatchS151208M | 123.5030 | 1543470.00000000 |
| BatchS201210M | 517.8210 | 2295350.00000000 |
| clay0203h | 3.9370 | 41573.30000000 |
| clay0203m | 1.8450 | 41573.30000000 |
| clay0204h | 43.6850 | 6545.00000000 |
| clay0204m | 10.9330 | 6545.00000000 |
| clay0205h | 688.0400 | 8092.50000000 |
| clay0205m | 231.4940 | 8092.50000000 |
| clay0303h | 6.9610 | 26669.10000000 |
| clay0304h | 510.2070 | 40262.40000000 |
| clay0304m | 94.4630 | 40262.40000000 |
| clay0305h | 1521.9900 | 8092.50000000 |
| clay0305m | 186.2620 | 8092.50000000 |
| FLay03H | 1.0190 | 48.98980000 |
| FLay03M | 0.6440 | 48.98980000 |
| FLay04H | 25.2120 | 54.40590000 |
| FLay04M | 10.0850 | 54.40590000 |
| FLay05M | 504.3070 | 64.49810000 |
| RSyn0810H | 2.9460 | 1721.45000000 |
| RSyn0810M02H | 20.7120 | 1741.39000000 |
| RSyn0810M03H | 106.6050 | 2722.45000000 |
| RSyn0810M04H | 30.6420 | 6581.94000000 |
| RSyn0810M | 788.8410 | 1721.45000000 |
| RSyn0820H | 4.6940 | 1150.30000000 |
| RSyn0820M02H | 58.5700 | 1092.09000000 |
| RSyn0820M03H | 514.5710 | 2028.81000000 |
| RSyn0820M04H | 427.0530 | 2450.77000000 |
| RSyn0820M | 7190.5900 | 1150.30000000 |
| RSyn0840H | 2.1890 | 325.55500000 |
| RSyn0840M02H | 18.9290 | 734.98400000 |
| RSyn0840M03H | 113.8710 | 2742.65000000 |
| RSyn0840M04H | 740.9130 | 2564.50000000 |
| SLay05H | 22.2240 | 22664.70000000 |
| SLay05M | 2.3020 | 22664.70000000 |
| SLay06H | 387.8510 | 32757.00000000 |
| SLay06M | 1.1210 | 32757.00000000 |
| SLay07M | 13.6680 | 64748.80000000 |
| SLay08M | 4.8160 | 84960.20000000 |
| SLay09M | 330.1600 | 107806.00000000 |
| SLay10M | 538.4240 | 129580.00000000 |
| Syn10H | 0.1120 | 1267.35000000 |
| Syn10M02H | 0.2850 | 2310.30000000 |
| Syn10M02M | 3.3410 | 2310.30000000 |
| Syn10M03H | 0.4480 | 3354.68000000 |
| Syn10M03M | 13.2780 | 3354.68000000 |
| Syn10M04H | 0.5910 | 4557.06000000 |
| Syn10M04M | 58.3070 | 4557.06000000 |
| Syn10M | 0.2170 | 1267.35000000 |
| Syn20H | 0.2040 | 924.26300000 |
| Syn20M02H | 0.9990 | 1752.13000000 |
| Syn20M02M | 819.5300 | 1752.13000000 |
| Syn20M03H | 1.1720 | 2646.95000000 |
| Syn20M04H | 1.7440 | 3532.74000000 |
| Syn20M | 3.3160 | 924.26300000 |
| Syn40H | 0.8680 | 67.71340000 |
| Syn40M02H | 3.8970 | 388.77300000 |
| Syn40M03H | 16.2270 | 395.14900000 |
| Syn40M04H | 60.9210 | 901.75200000 |
| sssd-8-4-3 | 931.0760 | 197181.00000000 |
| uflquad-15-60 | 15.8290 | 1063.19000000 |
| uflquad-15-80 | 37.1940 | 1217.99000000 |
| uflquad-20-40 | 19.0030 | 860.96100000 |
| uflquad-20-50 | 1623.3800 | 375.91900000 |
| uflquad-25-25 | 5.7650 | 673.69700000 |
| uflquad-25-30 | 4.6730 | 669.84000000 |
| uflquad-25-40 | 27.5040 | 828.16500000 |
| nd-10 | 472.2360 | 52.46110000 |
| nd-12 | 2721.8200 | 56.66960000 |
| m3 | 0.4660 | 37.80000000 |
| m6 | 1321.2900 | 82.25690000 |
| m7_ar2_1 | 2283.0700 | 190.23500000 |
| m7_ar25_1 | 4391.6700 | 143.58500000 |
| m7_ar4_1 | 7134.8100 | 106.75700000 |
| netmod_kar1 | 204.3500 | -0.41979000 |
| netmod_kar2 | 202.6730 | -0.41979000 |
| tls2 | 4.2320 | 5.30000000 |
SBB_sbb: feasible:
| Modelname | Time (SBB_sbb) | Obj (SBB_sbb) |
|---|---|---|
| FLay06H | 7451.7700 | 66.93280000 |
| RSyn0810M02M | 8679.9900 | 1592.16000000 |
| RSyn0810M03M | 7569.2100 | 2368.77000000 |
| RSyn0810M04M | 7495.6000 | 5433.33000000 |
| RSyn0820M02M | 7627.2200 | 669.53700000 |
| RSyn0820M03M | 7451.4200 | 1439.77000000 |
| RSyn0820M04M | 7396.6400 | 1563.83000000 |
| RSyn0840M02M | 8159.1100 | 191.12600000 |
| RSyn0840M03M | 7609.5000 | 2241.35000000 |
| RSyn0840M04M | 7575.0000 | 2301.43000000 |
| RSyn0840M | 11688.7000 | 247.39700000 |
| SLay07H | 7383.1600 | 64748.80000000 |
| SLay08H | 7413.2200 | 85115.00000000 |
| SLay09H | 7412.7900 | 122507.00000000 |
| SLay10H | 7356.2200 | 153256.00000000 |
| Syn20M03M | 7954.4200 | 2646.95000000 |
| Syn20M04M | 7781.6900 | 3500.74000000 |
| Syn40M02M | 8804.5400 | 344.48700000 |
| Syn40M03M | 7548.5800 | 294.29000000 |
| Syn40M04M | 7557.2600 | 831.89600000 |
| Syn40M | 10415.2000 | 67.71330000 |
| sssd-10-4-3 | 12944.6000 | 159329.00000000 |
| sssd-12-5-3 | 19374.5000 | 330320.00000000 |
| sssd-15-6-3 | 15779.7000 | 513871.00000000 |
| sssd-16-8-3 | 13118.5000 | 709652.00000000 |
| sssd-18-8-3 | 12851.3000 | 637320.00000000 |
| sssd-20-9-3 | 11853.3000 | 510261.00000000 |
| sssd-22-8-3 | 12055.5000 | 730203.00000000 |
| nd-13 | 7251.3700 | 65.90790000 |
| nd-15 | 7230.4100 | 86.92650000 |
| nd-16 | 7227.5800 | 102.09800000 |
| fo7_2 | 7403.9100 | 17.74930000 |
| fo7_ar2_1 | 7545.5400 | 34.87130000 |
| fo7_ar25_1 | 7414.1500 | 25.67840000 |
| fo7_ar3_1 | 7413.0500 | 23.12100000 |
| fo7_ar4_1 | 7368.0300 | 29.47550000 |
| fo7_ar5_1 | 7340.0900 | 19.01200000 |
| fo7 | 7431.2200 | 28.45230000 |
| fo8_ar2_1 | 7498.4800 | 48.41990000 |
| fo8_ar25_1 | 7372.1000 | 41.63040000 |
| fo8_ar3_1 | 7329.2200 | 40.79120000 |
| fo8_ar4_1 | 7294.2400 | 33.46530000 |
| fo8_ar5_1 | 7299.6800 | 45.65780000 |
| fo8 | 7381.7800 | 41.06960000 |
| fo9_ar5_1 | 7263.1100 | 41.66030000 |
| fo9 | 7344.6400 | 49.96150000 |
| m7_ar3_1 | 7479.4900 | 143.58500000 |
| m7_ar5_1 | 7336.1600 | 106.46000000 |
| m7 | 7448.1800 | 106.75700000 |
| netmod_dol1 | 7214.8800 | -0.55139800 |
| no7_ar2_1 | 7471.5700 | 151.86000000 |
| no7_ar25_1 | 7380.7300 | 148.78600000 |
| no7_ar3_1 | 7374.7100 | 134.42700000 |
| no7_ar4_1 | 7367.5900 | 120.70100000 |
| no7_ar5_1 | 7343.6400 | 118.38200000 |
| o7_2 | 7409.9700 | 122.35300000 |
| o7_ar2_1 | 7458.1000 | 177.94600000 |
| o7_ar25_1 | 7424.6000 | 180.92200000 |
| o7_ar3_1 | 7369.9300 | 163.97700000 |
| o7_ar4_1 | 7346.2800 | 183.00000000 |
| o7_ar5_1 | 7350.2000 | 129.23900000 |
| o7 | 7424.4200 | 165.39600000 |
| o8_ar4_1 | 7302.2300 | 304.80900000 |
| tls4 | 15208.6000 | 13.70000000 |
| tls5 | 10552.2000 | 15.60000000 |
| tls6 | 9148.5200 | 21.40000000 |
SBB_sbb: fail:
| Modelname | Time (SBB_sbb) | Status (SBB_sbb) |
|---|---|---|
| clay0303m | -- | mstat(13)sstat( 1) |
| FLay05H | -- | mstat(13)sstat( 1) |
| FLay06M | -- | mstat(13)sstat( 1) |
| fo9_ar2_1 | -- | mstat(14)sstat( 3) |
| fo9_ar25_1 | -- | mstat(14)sstat( 3) |
| fo9_ar3_1 | -- | mstat(14)sstat( 3) |
| fo9_ar4_1 | -- | mstat(14)sstat( 3) |
| netmod_dol2 | -- | mstat(13)sstat(13) |
| o9_ar4_1 | -- | mstat(14)sstat( 3) |
| tls12 | -- | mstat(14)sstat( 3) |
| tls7 | -- | mstat(14)sstat( 3) |
BONMIN_bonmin-oa: all -- SBB_sbb: all
Back to topA "(max)" behind a model names indicates that this model is a maximization model.
Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.
A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (19374.50 seconds). The shift is 10s.
| Modelname | Time (BONMIN_bonmin-oa) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-oa/ SBB_sbb) | Obj (BONMIN_bonmin-oa) | Obj (SBB_sbb) | ObjEst (BONMIN_bonmin-oa) | ObjEst (SBB_sbb) | Gap (BONMIN_bonmin-oa) | Gap (SBB_sbb) |
| BatchS101006M | 443.5540 | 81.6070 | 5.435 | 769440.00000000 | 769440.00000000 | 769440.00000000 | 769440.00000000 | 0.0000 | 0.0000 |
| BatchS121208M | 655.4940 | 99.3970 | 6.595 | 1241130.00000000 | 1241130.00000000 | 1241130.00000000 | 1241130.00000000 | 0.0000 | 0.0000 |
| BatchS151208M | 4421.2200 | 123.5030 | 35.798 | 1543470.00000000 | 1543470.00000000 | 1543470.00000000 | 1543470.00000000 | 0.0000 | 0.0000 |
| BatchS201210M | 7325.7400 | 517.8210 | --- | mstat(14) sstat(3) | 2295350.00000000 | --- | 2295350.00000000 | --- | 0.0000 |
| clay0203h | 3.1620 | 3.9370 | 0.803 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 0.0000 | 0.0000 |
| clay0203m | 2.1970 | 1.8450 | 1.191 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 0.0000 | 0.0000 |
| clay0204h | 7.6910 | 43.6850 | 0.176 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 0.0000 | 0.0000 |
| clay0204m | 3.3410 | 10.9330 | 0.306 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 0.0000 | 0.0000 |
| clay0205h | 1044.7000 | 688.0400 | 1.518 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
| clay0205m | 122.4660 | 231.4940 | 0.529 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
| clay0303h | 5.9620 | 6.9610 | 0.856 | 26669.10000000 | 26669.10000000 | 26669.10000000 | 26669.10000000 | 0.0000 | 0.0000 |
| clay0303m | 5.6360 | 1.7160 | --- | 26669.10000000 | mstat(13) sstat(1) | 26669.10000000 | --- | 0.0000 | --- |
| clay0304h | 263.1000 | 510.2070 | 0.516 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 0.0000 | 0.0000 |
| clay0304m | 304.5220 | 94.4630 | 3.224 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 0.0000 | 0.0000 |
| clay0305h | 3838.3900 | 1521.9900 | 2.522 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
| clay0305m | 258.4510 | 186.2620 | 1.388 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
| FLay03H | 1.9810 | 1.0190 | 1.944 | 48.98980000 | 48.98980000 | 48.98980000 | 48.98980000 | 0.0000 | 0.0000 |
| FLay03M | 0.7030 | 0.6440 | 1.092 | 48.98980000 | 48.98980000 | 48.98980000 | 48.98980000 | 0.0000 | 0.0000 |
| FLay04H | 188.1580 | 25.2120 | 7.463 | 54.40590000 | 54.40590000 | 54.40590000 | 54.40590000 | 0.0000 | 0.0000 |
| FLay04M | 21.4410 | 10.0850 | 2.126 | 54.40590000 | 54.40590000 | 54.40590000 | 54.40590000 | 0.0000 | 0.0000 |
| FLay05H | 7414.4400 | 2611.9300 | --- | mstat(14) sstat(3) | mstat(13) sstat(1) | --- | --- | --- | --- |
| FLay05M | 7392.0500 | 504.3070 | --- | mstat(14) sstat(3) | 64.49810000 | --- | 64.49810000 | --- | 0.0000 |
| FLay06H | 7444.9700 | 7451.7700 | --- | mstat(14) sstat(3) | 66.93280000 | --- | 51.70410000 | --- | 0.2945 |
| FLay06M | 7509.8000 | 11788.9000 | --- | mstat(14) sstat(3) | mstat(13) sstat(1) | --- | --- | --- | --- |
| RSyn0810H (max) | 0.3760 | 2.9460 | 0.128 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 0.0000 | 0.0000 |
| RSyn0810M02H (max) | 3.1690 | 20.7120 | 0.153 | 1741.39000000 | 1741.39000000 | 1741.39000000 | 1741.39000000 | 0.0000 | 0.0000 |
| RSyn0810M02M (max) | 1576.3700 | 8679.9900 | 0.182 | 1741.39000000 | 1592.16000000 | 1741.39000000 | 3137.64000000 | 0.0000 | 0.4926 |
| RSyn0810M03H (max) | 16.1540 | 106.6050 | 0.152 | 2722.45000000 | 2722.45000000 | 2722.45000000 | 2722.45000000 | 0.0000 | 0.0000 |
| RSyn0810M03M (max) | 7502.6900 | 7569.2100 | --- | mstat(14) sstat(3) | 2368.77000000 | --- | 5509.95000000 | --- | 0.5701 |
| RSyn0810M04H (max) | 5.9150 | 30.6420 | 0.193 | 6581.94000000 | 6581.94000000 | 6581.94000000 | 6581.94000000 | 0.0000 | 0.0000 |
| RSyn0810M04M (max) | 7287.3300 | 7495.6000 | --- | mstat(14) sstat(3) | 5433.33000000 | --- | 10821.10000000 | --- | 0.4979 |
| RSyn0810M (max) | 5.4510 | 788.8410 | 0.007 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 0.0000 | 0.0000 |
| RSyn0820H (max) | 2.8310 | 4.6940 | 0.603 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 0.0000 | 0.0000 |
| RSyn0820M02H (max) | 4.7770 | 58.5700 | 0.082 | 1092.09000000 | 1092.09000000 | 1092.09000000 | 1092.09000000 | 0.0000 | 0.0000 |
| RSyn0820M02M (max) | 7628.2600 | 7627.2200 | --- | mstat(14) sstat(3) | 669.53700000 | --- | 4051.07000000 | --- | 0.8347 |
| RSyn0820M03H (max) | 40.6240 | 514.5710 | 0.079 | 2028.81000000 | 2028.81000000 | 2028.81000000 | 2028.81000000 | 0.0000 | 0.0000 |
| RSyn0820M03M (max) | 7489.7400 | 7451.4200 | --- | mstat(14) sstat(3) | 1439.77000000 | --- | 5861.88000000 | --- | 0.7544 |
| RSyn0820M04H (max) | 23.8390 | 427.0530 | 0.056 | 2450.77000000 | 2450.77000000 | 2450.77000000 | 2450.77000000 | 0.0000 | 0.0000 |
| RSyn0820M04M (max) | 7390.2200 | 7396.6400 | --- | mstat(14) sstat(3) | 1563.83000000 | --- | 8372.19000000 | --- | 0.8132 |
| RSyn0820M (max) | 26.1020 | 7190.5900 | 0.004 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 0.0000 | 0.0000 |
| RSyn0840H (max) | 0.9380 | 2.1890 | 0.429 | 325.55500000 | 325.55500000 | 325.55500000 | 325.55500000 | 0.0000 | 0.0000 |
| RSyn0840M02H (max) | 2.6350 | 18.9290 | 0.139 | 734.98400000 | 734.98400000 | 734.98400000 | 734.98400000 | 0.0000 | 0.0000 |
| RSyn0840M02M (max) | 4692.2000 | 8159.1100 | 0.575 | 734.98400000 | 191.12600000 | 734.98400000 | 4639.90000000 | 0.0000 | 0.9588 |
| RSyn0840M03H (max) | 16.8210 | 113.8710 | 0.148 | 2742.65000000 | 2742.65000000 | 2742.65000000 | 2742.65000000 | 0.0000 | 0.0000 |
| RSyn0840M03M (max) | 7529.0700 | 7609.5000 | --- | mstat(14) sstat(3) | 2241.35000000 | --- | 7850.66000000 | --- | 0.7145 |
| RSyn0840M04H (max) | 20.5300 | 740.9130 | 0.028 | 2564.50000000 | 2564.50000000 | 2564.50000000 | 2564.50000000 | 0.0000 | 0.0000 |
| RSyn0840M04M (max) | 7386.2300 | 7575.0000 | --- | mstat(14) sstat(3) | 2301.43000000 | --- | 12846.10000000 | --- | 0.8208 |
| RSyn0840M (max) | 71.2250 | 11688.7000 | 0.006 | 325.55500000 | 247.39700000 | 325.55500000 | 1497.16000000 | 0.0000 | 0.8348 |
| SLay05H | 17.2600 | 22.2240 | 0.777 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 0.0000 | 0.0000 |
| SLay05M | 2.3100 | 2.3020 | 1.003 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 0.0000 | 0.0000 |
| SLay06H | 1071.9600 | 387.8510 | 2.764 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 0.0000 | 0.0000 |
| SLay06M | 5.9020 | 1.1210 | 5.265 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 0.0000 | 0.0000 |
| SLay07H | 7358.1300 | 7383.1600 | --- | mstat(14) sstat(3) | 64748.80000000 | --- | 64698.40000000 | --- | 0.0008 |
| SLay07M | 75.2940 | 13.6680 | 5.509 | 64748.80000000 | 64748.80000000 | 64748.80000000 | 64748.80000000 | 0.0000 | 0.0000 |
| SLay08H | 7392.2500 | 7413.2200 | --- | mstat(14) sstat(3) | 85115.00000000 | --- | 82023.90000000 | --- | 0.0377 |
| SLay08M | 4354.4900 | 4.8160 | 904.172 | 84960.20000000 | 84960.20000000 | 84960.20000000 | 84960.20000000 | 0.0000 | 0.0000 |
| SLay09H | 7457.6700 | 7412.7900 | --- | mstat(14) sstat(3) | 122507.00000000 | --- | 103264.00000000 | --- | 0.1863 |
| SLay09M | 7497.8700 | 330.1600 | --- | mstat(14) sstat(3) | 107806.00000000 | --- | 107806.00000000 | --- | 0.0000 |
| SLay10H | 7430.0300 | 7356.2200 | --- | mstat(14) sstat(3) | 153256.00000000 | --- | 119326.00000000 | --- | 0.2843 |
| SLay10M | 7590.3000 | 538.4240 | --- | mstat(14) sstat(3) | 129580.00000000 | --- | 129580.00000000 | --- | 0.0000 |
| Syn10H (max) | 0.1470 | 0.1120 | 1.313 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 0.0000 | 0.0000 |
| Syn10M02H (max) | 0.2170 | 0.2850 | 0.761 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 0.0000 | 0.0000 |
| Syn10M02M (max) | 0.3820 | 3.3410 | 0.114 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 0.0000 | 0.0000 |
| Syn10M03H (max) | 0.2580 | 0.4480 | 0.576 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 0.0000 | 0.0000 |
| Syn10M03M (max) | 1.2110 | 13.2780 | 0.091 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 0.0000 | 0.0000 |
| Syn10M04H (max) | 0.2430 | 0.5910 | 0.411 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 0.0000 | 0.0000 |
| Syn10M04M (max) | 1.1090 | 58.3070 | 0.019 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 0.0000 | 0.0000 |
| Syn10M (max) | 0.1230 | 0.2170 | 0.567 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 0.0000 | 0.0000 |
| Syn20H (max) | 0.2340 | 0.2040 | 1.147 | 924.26300000 | 924.26300000 | 924.26300000 | 924.26300000 | 0.0000 | 0.0000 |
| Syn20M02H (max) | 0.5260 | 0.9990 | 0.527 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 0.0000 | 0.0000 |
| Syn20M02M (max) | 1.7920 | 819.5300 | 0.002 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 0.0000 | 0.0000 |
| Syn20M03H (max) | 0.3970 | 1.1720 | 0.339 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 0.0000 | 0.0000 |
| Syn20M03M (max) | 11.1250 | 7954.4200 | 0.001 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 2658.98000000 | 0.0000 | 0.0045 |
| Syn20M04H (max) | 0.6710 | 1.7440 | 0.385 | 3532.74000000 | 3532.74000000 | 3532.74000000 | 3532.74000000 | 0.0000 | 0.0000 |
| Syn20M04M (max) | 8.8990 | 7781.6900 | 0.001 | 3532.74000000 | 3500.74000000 | 3532.74000000 | 4698.66000000 | 0.0000 | 0.2549 |
| Syn20M (max) | 0.3360 | 3.3160 | 0.101 | 924.26300000 | 924.26300000 | 924.26300000 | 924.26300000 | 0.0000 | 0.0000 |
| Syn40H (max) | 0.9220 | 0.8680 | 1.062 | 67.71340000 | 67.71340000 | 67.71340000 | 67.71340000 | 0.0000 | 0.0000 |
| Syn40M02H (max) | 1.4350 | 3.8970 | 0.368 | 388.77300000 | 388.77300000 | 388.77300000 | 388.77300000 | 0.0000 | 0.0000 |
| Syn40M02M (max) | 255.9740 | 8804.5400 | 0.029 | 388.77200000 | 344.48700000 | 388.77200000 | 1726.45000000 | 0.0000 | 0.8005 |
| Syn40M03H (max) | 5.6220 | 16.2270 | 0.346 | 395.14900000 | 395.14900000 | 395.14900000 | 395.14900000 | 0.0000 | 0.0000 |
| Syn40M03M (max) | 7316.0000 | 7548.5800 | --- | mstat(14) sstat(3) | 294.29000000 | --- | 4342.80000000 | --- | 0.9322 |
| Syn40M04H (max) | 16.9830 | 60.9210 | 0.279 | 901.75200000 | 901.75200000 | 901.75200000 | 901.75200000 | 0.0000 | 0.0000 |
| Syn40M04M (max) | 7366.7500 | 7557.2600 | --- | mstat(14) sstat(3) | 831.89600000 | --- | 5965.61000000 | --- | 0.8606 |
| Syn40M (max) | 1.7210 | 10415.2000 | 0.000 | 67.71330000 | 67.71330000 | 67.71330000 | 257.14600000 | 0.0000 | 0.7367 |
| sssd-8-4-3 | 24.5310 | 931.0760 | 0.026 | 197181.00000000 | 197181.00000000 | 197181.00000000 | 197181.00000000 | 0.0000 | 0.0000 |
| sssd-10-4-3 | 295.4730 | 12944.6000 | 0.023 | 152710.00000000 | 159329.00000000 | 152710.00000000 | 143244.00000000 | 0.0000 | 0.1123 |
| sssd-12-5-3 | 7644.0900 | 19374.5000 | --- | mstat(14) sstat(3) | 330320.00000000 | --- | 101530.00000000 | --- | 2.2534 |
| sssd-15-6-3 | 7652.2600 | 15779.7000 | --- | mstat(14) sstat(3) | 513871.00000000 | --- | 155381.00000000 | --- | 2.3072 |
| sssd-16-8-3 | 7560.7900 | 13118.5000 | --- | mstat(14) sstat(3) | 709652.00000000 | --- | 223552.00000000 | --- | 2.1744 |
| sssd-18-8-3 | 7563.5400 | 12851.3000 | --- | mstat(14) sstat(3) | 637320.00000000 | --- | 192178.00000000 | --- | 2.3163 |
| sssd-20-9-3 | 7579.0800 | 11853.3000 | --- | mstat(14) sstat(3) | 510261.00000000 | --- | 180409.00000000 | --- | 1.8284 |
| sssd-22-8-3 | 7595.1700 | 12055.5000 | --- | mstat(14) sstat(3) | 730203.00000000 | --- | 216626.00000000 | --- | 2.3708 |
| uflquad-15-60 | 7313.5200 | 15.8290 | --- | mstat(14) sstat(3) | 1063.19000000 | --- | 1063.19000000 | --- | 0.0000 |
| uflquad-15-80 | 7304.0200 | 37.1940 | --- | mstat(14) sstat(3) | 1217.99000000 | --- | 1217.99000000 | --- | 0.0000 |
| uflquad-20-40 | 7323.5200 | 19.0030 | --- | mstat(14) sstat(3) | 860.96100000 | --- | 860.96100000 | --- | 0.0000 |
| uflquad-20-50 | 7309.2200 | 1623.3800 | --- | mstat(14) sstat(3) | 375.91900000 | --- | 375.91900000 | --- | 0.0000 |
| uflquad-25-25 | 3815.8500 | 5.7650 | 661.899 | 673.69700000 | 673.69700000 | 673.69700000 | 673.69700000 | 0.0000 | 0.0000 |
| uflquad-25-30 | 3352.3800 | 4.6730 | 717.394 | 669.84000000 | 669.84000000 | 669.84000000 | 669.84000000 | 0.0000 | 0.0000 |
| uflquad-25-40 | 7311.1900 | 27.5040 | --- | mstat(14) sstat(3) | 828.16500000 | --- | 828.16500000 | --- | 0.0000 |
| nd-10 | 448.2020 | 472.2360 | 0.949 | 52.46110000 | 52.46110000 | 52.46110000 | 52.46110000 | 0.0000 | 0.0000 |
| nd-12 | 660.6810 | 2721.8200 | 0.243 | 56.66960000 | 56.66960000 | 56.66960000 | 56.66960000 | 0.0000 | 0.0000 |
| nd-13 | 7242.2500 | 7251.3700 | --- | mstat(14) sstat(3) | 65.90790000 | --- | 54.66070000 | --- | 0.2058 |
| nd-15 | 7317.9200 | 7230.4100 | --- | mstat(14) sstat(3) | 86.92650000 | --- | 65.11490000 | --- | 0.3350 |
| nd-16 | 7310.7200 | 7227.5800 | --- | mstat(14) sstat(3) | 102.09800000 | --- | 78.22420000 | --- | 0.3052 |
| fo7_2 | 2450.5400 | 7403.9100 | 0.331 | 17.74930000 | 17.74930000 | 17.74930000 | 11.09430000 | 0.0000 | 0.5999 |
| fo7_ar2_1 | 7014.3900 | 7545.5400 | 0.930 | 24.83980000 | 34.87130000 | 24.83980000 | 19.42240000 | 0.0000 | 0.7954 |
| fo7_ar25_1 | 7344.8200 | 7414.1500 | --- | mstat(14) sstat(3) | 25.67840000 | --- | 17.25980000 | --- | 0.4878 |
| fo7_ar3_1 | 7348.9900 | 7413.0500 | --- | mstat(14) sstat(3) | 23.12100000 | --- | 15.69890000 | --- | 0.4728 |
| fo7_ar4_1 | 7356.0500 | 7368.0300 | --- | mstat(14) sstat(3) | 29.47550000 | --- | 14.72570000 | --- | 1.0016 |
| fo7_ar5_1 | 3347.9200 | 7340.0900 | 0.456 | 17.74930000 | 19.01200000 | 17.74930000 | 14.63770000 | 0.0000 | 0.2988 |
| fo7 | 7533.0200 | 7431.2200 | --- | mstat(14) sstat(3) | 28.45230000 | --- | 10.19240000 | --- | 1.7915 |
| fo8_ar2_1 | 7337.5900 | 7498.4800 | --- | mstat(14) sstat(3) | 48.41990000 | --- | 16.71750000 | --- | 1.8964 |
| fo8_ar25_1 | 7368.5500 | 7372.1000 | --- | mstat(14) sstat(3) | 41.63040000 | --- | 14.27250000 | --- | 1.9168 |
| fo8_ar3_1 | 7385.6400 | 7329.2200 | --- | mstat(14) sstat(3) | 40.79120000 | --- | 11.67870000 | --- | 2.4928 |
| fo8_ar4_1 | 7376.7900 | 7294.2400 | --- | mstat(14) sstat(3) | 33.46530000 | --- | 11.17020000 | --- | 1.9959 |
| fo8_ar5_1 | 7363.1100 | 7299.6800 | --- | mstat(14) sstat(3) | 45.65780000 | --- | 12.09400000 | --- | 2.7752 |
| fo8 | 7461.6700 | 7381.7800 | --- | mstat(14) sstat(3) | 41.06960000 | --- | 7.74500000 | --- | 4.3027 |
| fo9_ar2_1 | 7319.4100 | 7424.3900 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
| fo9_ar25_1 | 7320.8600 | 7375.1300 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
| fo9_ar3_1 | 7355.2500 | 7292.3500 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
| fo9_ar4_1 | 7367.7300 | 7268.4700 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
| fo9_ar5_1 | 7366.9600 | 7263.1100 | --- | mstat(14) sstat(3) | 41.66030000 | --- | 7.82468000 | --- | 4.3242 |
| fo9 | 7389.2400 | 7344.6400 | --- | mstat(14) sstat(3) | 49.96150000 | --- | 6.50795000 | --- | 6.6770 |
| m3 | 0.1970 | 0.4660 | 0.423 | 37.80000000 | 37.80000000 | 37.80000000 | 37.80000000 | 0.0000 | 0.0000 |
| m6 | 19.7720 | 1321.2900 | 0.015 | 82.25690000 | 82.25690000 | 82.25690000 | 82.25690000 | 0.0000 | 0.0000 |
| m7_ar2_1 | 150.4520 | 2283.0700 | 0.066 | 190.23500000 | 190.23500000 | 190.23500000 | 190.23500000 | 0.0000 | 0.0000 |
| m7_ar25_1 | 51.6280 | 4391.6700 | 0.012 | 143.58500000 | 143.58500000 | 143.58500000 | 143.58500000 | 0.0000 | 0.0000 |
| m7_ar3_1 | 726.3280 | 7479.4900 | 0.097 | 143.58500000 | 143.58500000 | 143.58500000 | 119.94100000 | 0.0000 | 0.1971 |
| m7_ar4_1 | 864.4930 | 7134.8100 | 0.121 | 106.75700000 | 106.75700000 | 106.75700000 | 106.75700000 | 0.0000 | 0.0000 |
| m7_ar5_1 | 1070.7000 | 7336.1600 | 0.146 | 106.46000000 | 106.46000000 | 106.46000000 | 94.28920000 | 0.0000 | 0.1291 |
| m7 | 140.0070 | 7448.1800 | 0.019 | 106.75700000 | 106.75700000 | 106.75700000 | 98.71500000 | 0.0000 | 0.0815 |
| netmod_dol1 | 7246.7400 | 7214.8800 | --- | mstat(14) sstat(3) | -0.55139800 | --- | -0.65233400 | --- | 0.1547 |
| netmod_dol2 | 7226.8800 | 5.3840 | --- | mstat(14) sstat(3) | mstat(13) sstat(13) | --- | --- | --- | --- |
| netmod_kar1 | 7342.0500 | 204.3500 | --- | mstat(14) sstat(3) | -0.41979000 | --- | -0.41979000 | --- | 0.0000 |
| netmod_kar2 | 7340.4800 | 202.6730 | --- | mstat(14) sstat(3) | -0.41979000 | --- | -0.41979000 | --- | 0.0000 |
| no7_ar2_1 | 7416.5100 | 7471.5700 | --- | mstat(14) sstat(3) | 151.86000000 | --- | 71.94960000 | --- | 1.1106 |
| no7_ar25_1 | 7478.8100 | 7380.7300 | --- | mstat(14) sstat(3) | 148.78600000 | --- | 60.32300000 | --- | 1.4665 |
| no7_ar3_1 | 7346.9800 | 7374.7100 | --- | mstat(14) sstat(3) | 134.42700000 | --- | 56.45360000 | --- | 1.3812 |
| no7_ar4_1 | 7509.2500 | 7367.5900 | --- | mstat(14) sstat(3) | 120.70100000 | --- | 55.14560000 | --- | 1.1888 |
| no7_ar5_1 | 7520.3100 | 7343.6400 | --- | mstat(14) sstat(3) | 118.38200000 | --- | 50.43270000 | --- | 1.3473 |
| o7_2 | 7491.1900 | 7409.9700 | --- | mstat(14) sstat(3) | 122.35300000 | --- | 59.31550000 | --- | 1.0627 |
| o7_ar2_1 | 7377.7100 | 7458.1000 | --- | mstat(14) sstat(3) | 177.94600000 | --- | 81.91440000 | --- | 1.1723 |
| o7_ar25_1 | 7508.8200 | 7424.6000 | --- | mstat(14) sstat(3) | 180.92200000 | --- | 78.99120000 | --- | 1.2904 |
| o7_ar3_1 | 7447.6000 | 7369.9300 | --- | mstat(14) sstat(3) | 163.97700000 | --- | 77.16780000 | --- | 1.1249 |
| o7_ar4_1 | 7486.9600 | 7346.2800 | --- | mstat(14) sstat(3) | 183.00000000 | --- | 69.24490000 | --- | 1.6428 |
| o7_ar5_1 | 7509.7000 | 7350.2000 | --- | mstat(14) sstat(3) | 129.23900000 | --- | 74.41120000 | --- | 0.7368 |
| o7 | 7602.1300 | 7424.4200 | --- | mstat(14) sstat(3) | 165.39600000 | --- | 51.96060000 | --- | 2.1831 |
| o8_ar4_1 | 7422.9300 | 7302.2300 | --- | mstat(14) sstat(3) | 304.80900000 | --- | 108.77000000 | --- | 1.8023 |
| o9_ar4_1 | 7408.1400 | 7297.6900 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
| tls12 | 7447.2500 | 7667.1300 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
| tls2 | 0.9500 | 4.2320 | 0.224 | 5.30000000 | 5.30000000 | 5.30000000 | 5.30000000 | 0.0000 | 0.0000 |
| tls4 | 7444.0400 | 15208.6000 | --- | mstat(14) sstat(3) | 13.70000000 | --- | 2.27539000 | --- | 5.0209 |
| tls5 | 7519.4400 | 10552.2000 | --- | mstat(14) sstat(3) | 15.60000000 | --- | 1.81080000 | --- | 7.6150 |
| tls6 | 7442.1800 | 9148.5200 | --- | mstat(14) sstat(3) | 21.40000000 | --- | 1.92937000 | --- | 10.0917 |
| tls7 | 7301.9600 | 8474.5600 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- | Shifted Geometric Mean (Solved) |
936.75 | 1170.83 |
| % Unsolved | 47.10% | 49.68% |