Solver Square Comparison: Considers all models.
Results created on 09/14/12 19:33:54 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver
Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.
Solver BONMIN_bonmin-ecp is represented on the left (rows) and solver SBB_sbb on top (columns).
See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.
Input File Number | Filename |
---|---|
Tracefile 1: | minlpconvex_bonmin-ecp.pav |
Tracefile 2: | minlpconvex_sbb.pav |
Solvers used : | BONMIN_bonmin-ecp |
SBB_sbb | |
Modeltype(s) |   MINLP |
SBB_sbb: optimal |
SBB_sbb: locally optimal |
SBB_sbb: feasible |
SBB_sbb: infeasible |
SBB_sbb: unbounded |
SBB_sbb: fail |
SBB_sbb: no data |
total BONMIN_bonmin-ecp | |
BONMIN_bonmin-ecp: optimal | 72 | - | 48 | - | - | 5 | - | 125 |
BONMIN_bonmin-ecp: locally optimal | - | - | - | - | - | - | - | - |
BONMIN_bonmin-ecp: feasible | 1 | - | 17 | - | - | 4 | - | 22 |
BONMIN_bonmin-ecp: infeasible | - | - | - | - | - | - | - | - |
BONMIN_bonmin-ecp: unbounded | - | - | - | - | - | - | - | - |
BONMIN_bonmin-ecp: fail | 5 | - | 1 | - | - | 2 | - | 8 |
BONMIN_bonmin-ecp: no data | - | - | - | - | - | - | - | - |
total SBB_sbb | 78 | - | 66 | - | - | 11 | - | 155 |
Solver return definitions:
Outcome | Model Status | Solver Status |
---|---|---|
optimal | 1 or 15 | 1 |
locally optimal | 2 | any |
feasible | 8 or 16 | 1 or 2 or 3 or 4 or 5 |
infeasible | 4 or 5 or 10 or 19 | 1 |
unbounded | 3 or 18 | 1 |
fail | all other | all other |
Solver Resource Times
- Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
- Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.50E-04. If both solutions are less than 1e-1, we use the absolute difference.
- Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.
BONMIN_bonmin-ecp: optimal -- SBB_sbb: optimal    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Obj (BONMIN_bonmin-ecp) | Obj (SBB_sbb) |
---|---|---|---|---|---|
BatchS101006M | 18.8830 | 81.6070 | 0.231 | 769440.00000000 | 769440.00000000 |
BatchS121208M | 40.0140 | 99.3970 | 0.403 | 1241130.00000000 | 1241130.00000000 |
BatchS151208M | 77.0810 | 123.5030 | 0.624 | 1543470.00000000 | 1543470.00000000 |
BatchS201210M | 159.9390 | 517.8210 | 0.309 | 2295350.00000000 | 2295350.00000000 |
clay0203h | 2.5780 | 3.9370 | 0.655 | 41573.30000000 | 41573.30000000 |
clay0203m | 0.8980 | 1.8450 | 0.487 | 41573.30000000 | 41573.30000000 |
clay0204h | 5.1590 | 43.6850 | 0.118 | 6545.00000000 | 6545.00000000 |
clay0204m | 1.2880 | 10.9330 | 0.118 | 6545.00000000 | 6545.00000000 |
clay0205h | 110.1870 | 688.0400 | 0.160 | 8092.50000000 | 8092.50000000 |
clay0205m | 7.4710 | 231.4940 | 0.032 | 8092.50000000 | 8092.50000000 |
clay0303h | 7.6320 | 6.9610 | 1.096 | 26669.10000000 | 26669.10000000 |
clay0304h | 361.6070 | 510.2070 | 0.709 | 40262.40000000 | 40262.40000000 |
clay0304m | 48.5040 | 94.4630 | 0.513 | 40262.40000000 | 40262.40000000 |
clay0305h | 111.3750 | 1521.9900 | 0.073 | 8092.50000000 | 8092.50000000 |
clay0305m | 9.2630 | 186.2620 | 0.050 | 8092.50000000 | 8092.50000000 |
FLay03H | 0.9610 | 1.0190 | 0.943 | 48.98980000 | 48.98980000 |
FLay03M | 0.1900 | 0.6440 | 0.295 | 48.98980000 | 48.98980000 |
FLay04H | 8.0320 | 25.2120 | 0.319 | 54.40590000 | 54.40590000 |
FLay04M | 2.2510 | 10.0850 | 0.223 | 54.40590000 | 54.40590000 |
FLay05M | 69.6520 | 504.3070 | 0.138 | 64.49810000 | 64.49810000 |
RSyn0810H | 0.5120 | 2.9460 | 0.174 | 1721.45000000 | 1721.45000000 |
RSyn0810M02H | 1.8920 | 20.7120 | 0.091 | 1741.39000000 | 1741.39000000 |
RSyn0810M03H | 5.8860 | 106.6050 | 0.055 | 2722.45000000 | 2722.45000000 |
RSyn0810M04H | 5.6390 | 30.6420 | 0.184 | 6581.94000000 | 6581.94000000 |
RSyn0810M | 1.3240 | 788.8410 | 0.002 | 1721.45000000 | 1721.45000000 |
RSyn0820H | 1.2260 | 4.6940 | 0.261 | 1150.30000000 | 1150.30000000 |
RSyn0820M | 3.0760 | 7190.5900 | 0.000 | 1150.30000000 | 1150.30000000 |
RSyn0840M02H | 1.8590 | 18.9290 | 0.098 | 734.98400000 | 734.98400000 |
RSyn0840M03H | 6.8420 | 113.8710 | 0.060 | 2742.65000000 | 2742.65000000 |
RSyn0840M04H | 17.8030 | 740.9130 | 0.024 | 2564.50000000 | 2564.50000000 |
SLay05H | 2.4860 | 22.2240 | 0.112 | 22664.70000000 | 22664.70000000 |
SLay05M | 0.4620 | 2.3020 | 0.201 | 22664.70000000 | 22664.70000000 |
SLay06H | 11.5030 | 387.8510 | 0.030 | 32757.00000000 | 32757.00000000 |
SLay06M | 0.8940 | 1.1210 | 0.798 | 32757.00000000 | 32757.00000000 |
SLay07M | 1.7220 | 13.6680 | 0.126 | 64748.80000000 | 64748.80000000 |
SLay08M | 5.6610 | 4.8160 | 1.175 | 84960.20000000 | 84960.20000000 |
SLay09M | 28.1110 | 330.1600 | 0.085 | 107806.00000000 | 107806.00000000 |
SLay10M | 396.9250 | 538.4240 | 0.737 | 129580.00000000 | 129580.00000000 |
Syn10H | 0.1720 | 0.1120 | 1.536 | 1267.35000000 | 1267.35000000 |
Syn10M02H | 0.2590 | 0.2850 | 0.909 | 2310.30000000 | 2310.30000000 |
Syn10M02M | 0.4210 | 3.3410 | 0.126 | 2310.30000000 | 2310.30000000 |
Syn10M03H | 0.3040 | 0.4480 | 0.679 | 3354.68000000 | 3354.68000000 |
Syn10M03M | 0.9830 | 13.2780 | 0.074 | 3354.68000000 | 3354.68000000 |
Syn10M04H | 0.1810 | 0.5910 | 0.306 | 4557.06000000 | 4557.06000000 |
Syn10M04M | 1.0200 | 58.3070 | 0.017 | 4557.06000000 | 4557.06000000 |
Syn20H | 0.3190 | 0.2040 | 1.564 | 924.26300000 | 924.26300000 |
Syn20M02H | 0.5650 | 0.9990 | 0.566 | 1752.13000000 | 1752.13000000 |
Syn20M02M | 1.3480 | 819.5300 | 0.002 | 1752.13000000 | 1752.13000000 |
Syn20M03H | 0.5830 | 1.1720 | 0.497 | 2646.95000000 | 2646.95000000 |
Syn20M04H | 0.8500 | 1.7440 | 0.487 | 3532.74000000 | 3532.74000000 |
Syn20M | 0.2210 | 3.3160 | 0.067 | 924.26300000 | 924.26300000 |
Syn40H | 0.6920 | 0.8680 | 0.797 | 67.71340000 | 67.71340000 |
Syn40M02H | 1.4210 | 3.8970 | 0.365 | 388.77300000 | 388.77300000 |
Syn40M03H | 5.8460 | 16.2270 | 0.360 | 395.14900000 | 395.14900000 |
Syn40M04H | 5.7460 | 60.9210 | 0.094 | 901.75200000 | 901.75200000 |
sssd-8-4-3 | 1.3690 | 931.0760 | 0.001 | 197181.00000000 | 197181.00000000 |
uflquad-15-60 | 55.5540 | 15.8290 | 3.510 | 1063.19000000 | 1063.19000000 |
uflquad-15-80 | 135.7990 | 37.1940 | 3.651 | 1217.99000000 | 1217.99000000 |
uflquad-20-40 | 63.0340 | 19.0030 | 3.317 | 860.96100000 | 860.96100000 |
uflquad-25-25 | 19.6040 | 5.7650 | 3.401 | 673.69700000 | 673.69700000 |
uflquad-25-30 | 25.4050 | 4.6730 | 5.437 | 669.84000000 | 669.84000000 |
uflquad-25-40 | 129.8530 | 27.5040 | 4.721 | 828.16500000 | 828.16500000 |
nd-10 | 33.6680 | 472.2360 | 0.071 | 52.46110000 | 52.46110000 |
nd-12 | 170.7070 | 2721.8200 | 0.063 | 56.66960000 | 56.66960000 |
m3 | 0.2430 | 0.4660 | 0.521 | 37.80000000 | 37.80000000 |
m6 | 7.3190 | 1321.2900 | 0.006 | 82.25690000 | 82.25690000 |
m7_ar2_1 | 163.7190 | 2283.0700 | 0.072 | 190.23500000 | 190.23500000 |
m7_ar25_1 | 11.1670 | 4391.6700 | 0.003 | 143.58500000 | 143.58500000 |
m7_ar4_1 | 34.5850 | 7134.8100 | 0.005 | 106.75700000 | 106.75700000 |
netmod_kar1 | 42.5770 | 204.3500 | 0.208 | -0.41979000 | -0.41979000 |
netmod_kar2 | 42.8470 | 202.6730 | 0.211 | -0.41979000 | -0.41979000 |
tls2 | 0.5020 | 4.2320 | 0.119 | 5.30000000 | 5.30000000 |
BONMIN_bonmin-ecp: optimal -- SBB_sbb: feasible    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Obj (BONMIN_bonmin-ecp) | Obj (SBB_sbb) |
---|---|---|---|---|---|
RSyn0810M02M | 192.1460 | 8679.9900 | 0.022 | 1741.39000000 | 1592.16000000 |
RSyn0810M03M | 516.2070 | 7569.2100 | 0.068 | 2722.45000000 | 2368.77000000 |
RSyn0810M04M | 628.9360 | 7495.6000 | 0.084 | 6581.93000000 | 5433.33000000 |
RSyn0820M02M | 2544.9800 | 7627.2200 | 0.334 | 1092.09000000 | 669.53700000 |
RSyn0840M | 2.9260 | 11688.7000 | 0.000 | 325.55500000 | 247.39700000 |
SLay07H | 60.6700 | 7383.1600 | 0.008 | 64748.80000000 | 64748.80000000 |
SLay08H | 174.7850 | 7413.2200 | 0.024 | 84960.20000000 | 85115.00000000 |
Syn20M03M | 2.0970 | 7954.4200 | 0.000 | 2646.95000000 | 2646.95000000 |
Syn20M04M | 8.1460 | 7781.6900 | 0.001 | 3532.74000000 | 3500.74000000 |
Syn40M02M | 8.1890 | 8804.5400 | 0.001 | 388.77200000 | 344.48700000 |
Syn40M03M | 76.3700 | 7548.5800 | 0.010 | 395.14800000 | 294.29000000 |
Syn40M04M | 4042.3500 | 7557.2600 | 0.535 | 901.75100000 | 831.89600000 |
Syn40M | 0.7600 | 10415.2000 | 0.000 | 67.71330000 | 67.71330000 |
sssd-10-4-3 | 4.8840 | 12944.6000 | 0.000 | 152710.00000000 | 159329.00000000 |
sssd-12-5-3 | 24.9800 | 19374.5000 | 0.001 | 261143.00000000 | 330320.00000000 |
sssd-15-6-3 | 93.9230 | 15779.7000 | 0.006 | 440711.00000000 | 513871.00000000 |
sssd-16-8-3 | 966.8690 | 13118.5000 | 0.074 | 615763.00000000 | 709652.00000000 |
sssd-18-8-3 | 2007.8900 | 12851.3000 | 0.156 | 524063.00000000 | 637320.00000000 |
fo7_2 | 669.6300 | 7403.9100 | 0.090 | 17.74930000 | 17.74930000 |
fo7_ar2_1 | 289.6840 | 7545.5400 | 0.038 | 24.83980000 | 34.87130000 |
fo7_ar25_1 | 98.4970 | 7414.1500 | 0.013 | 23.09360000 | 25.67840000 |
fo7_ar3_1 | 253.5790 | 7413.0500 | 0.034 | 22.51750000 | 23.12100000 |
fo7_ar4_1 | 255.6380 | 7368.0300 | 0.035 | 20.72980000 | 29.47550000 |
fo7_ar5_1 | 52.8810 | 7340.0900 | 0.007 | 17.74930000 | 19.01200000 |
fo7 | 585.4510 | 7431.2200 | 0.079 | 20.72980000 | 28.45230000 |
fo8_ar2_1 | 2852.8100 | 7498.4800 | 0.380 | 30.34060000 | 48.41990000 |
fo8_ar25_1 | 1939.5800 | 7372.1000 | 0.263 | 28.04520000 | 41.63040000 |
fo8_ar3_1 | 741.7770 | 7329.2200 | 0.101 | 23.91010000 | 40.79120000 |
fo8_ar4_1 | 745.5250 | 7294.2400 | 0.102 | 22.38190000 | 33.46530000 |
fo8_ar5_1 | 901.8370 | 7299.6800 | 0.124 | 22.38190000 | 45.65780000 |
fo8 | 3786.5400 | 7381.7800 | 0.513 | 22.38190000 | 41.06960000 |
fo9_ar5_1 | 2552.4500 | 7263.1100 | 0.351 | 23.46430000 | 41.66030000 |
m7_ar3_1 | 91.9730 | 7479.4900 | 0.012 | 143.58500000 | 143.58500000 |
m7_ar5_1 | 68.2970 | 7336.1600 | 0.009 | 106.46000000 | 106.46000000 |
m7 | 184.2350 | 7448.1800 | 0.025 | 106.75700000 | 106.75700000 |
no7_ar2_1 | 242.3140 | 7471.5700 | 0.032 | 107.81500000 | 151.86000000 |
no7_ar25_1 | 602.9350 | 7380.7300 | 0.082 | 107.81500000 | 148.78600000 |
no7_ar3_1 | 1243.3800 | 7374.7100 | 0.169 | 107.81500000 | 134.42700000 |
no7_ar4_1 | 823.2470 | 7367.5900 | 0.112 | 98.51840000 | 120.70100000 |
no7_ar5_1 | 477.5190 | 7343.6400 | 0.065 | 90.62270000 | 118.38200000 |
o7_2 | 1422.8800 | 7409.9700 | 0.192 | 116.94600000 | 122.35300000 |
o7_ar2_1 | 663.4050 | 7458.1000 | 0.089 | 140.41200000 | 177.94600000 |
o7_ar25_1 | 1119.5700 | 7424.6000 | 0.151 | 140.41200000 | 180.92200000 |
o7_ar3_1 | 1992.6000 | 7369.9300 | 0.270 | 137.93200000 | 163.97700000 |
o7_ar4_1 | 2899.6600 | 7346.2800 | 0.395 | 131.65300000 | 183.00000000 |
o7_ar5_1 | 1073.7500 | 7350.2000 | 0.146 | 116.94600000 | 129.23900000 |
o7 | 4180.1300 | 7424.4200 | 0.563 | 131.65300000 | 165.39600000 |
tls4 | 1082.3800 | 15208.6000 | 0.071 | 8.30000000 | 13.70000000 |
BONMIN_bonmin-ecp: optimal -- SBB_sbb: fail    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Obj (BONMIN_bonmin-ecp) | Status (SBB_sbb) |
---|---|---|---|---|---|
clay0303m | 2.4170 | 1.7160 | --- | 26669.10000000 | mstat(13)sstat( 1) |
FLay05H | 300.2890 | 2611.9300 | --- | 64.49810000 | mstat(13)sstat( 1) |
fo9_ar3_1 | 5716.6100 | 7292.3500 | --- | 24.81550000 | mstat(14)sstat( 3) |
fo9_ar4_1 | 4651.0300 | 7268.4700 | --- | 23.46430000 | mstat(14)sstat( 3) |
netmod_dol2 | 228.5540 | 5.3840 | --- | -0.56000800 | mstat(13)sstat(13) |
BONMIN_bonmin-ecp: feasible -- SBB_sbb: optimal    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Obj (BONMIN_bonmin-ecp) | Obj (SBB_sbb) |
---|---|---|---|---|---|
uflquad-20-50 | 7264.0500 | 1623.3800 | 4.475 | 375.91900000 | 375.91900000 |
BONMIN_bonmin-ecp: feasible -- SBB_sbb: feasible    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Obj (BONMIN_bonmin-ecp) | Obj (SBB_sbb) |
---|---|---|---|---|---|
FLay06H | 7281.0700 | 7451.7700 | 0.977 | 66.93280000 | 66.93280000 |
RSyn0820M03M | 7543.7500 | 7451.4200 | 1.012 | 2009.08000000 | 1439.77000000 |
RSyn0820M04M | 7357.5500 | 7396.6400 | 0.995 | 2406.04000000 | 1563.83000000 |
RSyn0840M02M | 7649.7500 | 8159.1100 | 0.938 | 732.20500000 | 191.12600000 |
RSyn0840M03M | 7602.9100 | 7609.5000 | 0.999 | 2735.85000000 | 2241.35000000 |
RSyn0840M04M | 7513.6400 | 7575.0000 | 0.992 | 2448.69000000 | 2301.43000000 |
SLay09H | 7248.6500 | 7412.7900 | 0.978 | 107983.00000000 | 122507.00000000 |
SLay10H | 7251.0400 | 7356.2200 | 0.986 | 130088.00000000 | 153256.00000000 |
sssd-20-9-3 | 7343.1200 | 11853.3000 | 0.620 | 478437.00000000 | 510261.00000000 |
sssd-22-8-3 | 7313.1400 | 12055.5000 | 0.607 | 596151.00000000 | 730203.00000000 |
nd-13 | 7222.1200 | 7251.3700 | 0.996 | 63.00510000 | 65.90790000 |
nd-15 | 7222.6900 | 7230.4100 | 0.999 | 82.59770000 | 86.92650000 |
nd-16 | 7222.1600 | 7227.5800 | 0.999 | 98.10190000 | 102.09800000 |
fo9 | 7297.3900 | 7344.6400 | 0.994 | 23.46430000 | 49.96150000 |
netmod_dol1 | 7273.5300 | 7214.8800 | 1.008 | -0.56000800 | -0.55139800 |
o8_ar4_1 | 7332.2800 | 7302.2300 | 1.004 | 256.13100000 | 304.80900000 |
tls5 | 7285.5500 | 10552.2000 | 0.690 | 10.80000000 | 15.60000000 |
BONMIN_bonmin-ecp: feasible -- SBB_sbb: fail    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Obj (BONMIN_bonmin-ecp) | Status (SBB_sbb) |
---|---|---|---|---|---|
FLay06M | 7284.5600 | 11788.9000 | --- | 66.93280000 | mstat(13)sstat( 1) |
fo9_ar2_1 | 7285.5400 | 7424.3900 | --- | 32.62500000 | mstat(14)sstat( 3) |
fo9_ar25_1 | 7281.9100 | 7375.1300 | --- | 32.25000000 | mstat(14)sstat( 3) |
o9_ar4_1 | 7282.0300 | 7297.6900 | --- | 277.23900000 | mstat(14)sstat( 3) |
BONMIN_bonmin-ecp: fail -- SBB_sbb: optimal    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Status (BONMIN_bonmin-ecp) | Obj (SBB_sbb) |
---|---|---|---|---|---|
RSyn0820M02H | 0.7970 | 58.5700 | --- | mstat(13)sstat( 1) | 1092.09000000 |
RSyn0820M03H | 1.1540 | 514.5710 | --- | mstat(13)sstat( 1) | 2028.81000000 |
RSyn0820M04H | 2.2000 | 427.0530 | --- | mstat(13)sstat( 1) | 2450.77000000 |
RSyn0840H | 0.3550 | 2.1890 | --- | mstat(13)sstat( 1) | 325.55500000 |
Syn10M | 0.0670 | 0.2170 | --- | mstat(13)sstat( 1) | 1267.35000000 |
BONMIN_bonmin-ecp: fail -- SBB_sbb: feasible    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Status (BONMIN_bonmin-ecp) | Obj (SBB_sbb) |
---|---|---|---|---|---|
tls6 | 7284.2000 | 9148.5200 | --- | mstat(14)sstat( 3) | 21.40000000 |
BONMIN_bonmin-ecp: fail -- SBB_sbb: fail    
Back to top
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/SBB_sbb) | Status (BONMIN_bonmin-ecp) | Status (SBB_sbb) |
---|---|---|---|---|---|
tls12 | 7262.9300 | 7667.1300 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
tls7 | 7268.1300 | 8474.5600 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
BONMIN_bonmin-ecp: optimal:
Modelname | Time (BONMIN_bonmin-ecp) | Obj (BONMIN_bonmin-ecp) |
---|---|---|
BatchS101006M | 18.8830 | 769440.00000000 |
BatchS121208M | 40.0140 | 1241130.00000000 |
BatchS151208M | 77.0810 | 1543470.00000000 |
BatchS201210M | 159.9390 | 2295350.00000000 |
clay0203h | 2.5780 | 41573.30000000 |
clay0203m | 0.8980 | 41573.30000000 |
clay0204h | 5.1590 | 6545.00000000 |
clay0204m | 1.2880 | 6545.00000000 |
clay0205h | 110.1870 | 8092.50000000 |
clay0205m | 7.4710 | 8092.50000000 |
clay0303h | 7.6320 | 26669.10000000 |
clay0303m | 2.4170 | 26669.10000000 |
clay0304h | 361.6070 | 40262.40000000 |
clay0304m | 48.5040 | 40262.40000000 |
clay0305h | 111.3750 | 8092.50000000 |
clay0305m | 9.2630 | 8092.50000000 |
FLay03H | 0.9610 | 48.98980000 |
FLay03M | 0.1900 | 48.98980000 |
FLay04H | 8.0320 | 54.40590000 |
FLay04M | 2.2510 | 54.40590000 |
FLay05H | 300.2890 | 64.49810000 |
FLay05M | 69.6520 | 64.49810000 |
RSyn0810H | 0.5120 | 1721.45000000 |
RSyn0810M02H | 1.8920 | 1741.39000000 |
RSyn0810M02M | 192.1460 | 1741.39000000 |
RSyn0810M03H | 5.8860 | 2722.45000000 |
RSyn0810M03M | 516.2070 | 2722.45000000 |
RSyn0810M04H | 5.6390 | 6581.94000000 |
RSyn0810M04M | 628.9360 | 6581.93000000 |
RSyn0810M | 1.3240 | 1721.45000000 |
RSyn0820H | 1.2260 | 1150.30000000 |
RSyn0820M02M | 2544.9800 | 1092.09000000 |
RSyn0820M | 3.0760 | 1150.30000000 |
RSyn0840M02H | 1.8590 | 734.98400000 |
RSyn0840M03H | 6.8420 | 2742.65000000 |
RSyn0840M04H | 17.8030 | 2564.50000000 |
RSyn0840M | 2.9260 | 325.55500000 |
SLay05H | 2.4860 | 22664.70000000 |
SLay05M | 0.4620 | 22664.70000000 |
SLay06H | 11.5030 | 32757.00000000 |
SLay06M | 0.8940 | 32757.00000000 |
SLay07H | 60.6700 | 64748.80000000 |
SLay07M | 1.7220 | 64748.80000000 |
SLay08H | 174.7850 | 84960.20000000 |
SLay08M | 5.6610 | 84960.20000000 |
SLay09M | 28.1110 | 107806.00000000 |
SLay10M | 396.9250 | 129580.00000000 |
Syn10H | 0.1720 | 1267.35000000 |
Syn10M02H | 0.2590 | 2310.30000000 |
Syn10M02M | 0.4210 | 2310.30000000 |
Syn10M03H | 0.3040 | 3354.68000000 |
Syn10M03M | 0.9830 | 3354.68000000 |
Syn10M04H | 0.1810 | 4557.06000000 |
Syn10M04M | 1.0200 | 4557.06000000 |
Syn20H | 0.3190 | 924.26300000 |
Syn20M02H | 0.5650 | 1752.13000000 |
Syn20M02M | 1.3480 | 1752.13000000 |
Syn20M03H | 0.5830 | 2646.95000000 |
Syn20M03M | 2.0970 | 2646.95000000 |
Syn20M04H | 0.8500 | 3532.74000000 |
Syn20M04M | 8.1460 | 3532.74000000 |
Syn20M | 0.2210 | 924.26300000 |
Syn40H | 0.6920 | 67.71340000 |
Syn40M02H | 1.4210 | 388.77300000 |
Syn40M02M | 8.1890 | 388.77200000 |
Syn40M03H | 5.8460 | 395.14900000 |
Syn40M03M | 76.3700 | 395.14800000 |
Syn40M04H | 5.7460 | 901.75200000 |
Syn40M04M | 4042.3500 | 901.75100000 |
Syn40M | 0.7600 | 67.71330000 |
sssd-8-4-3 | 1.3690 | 197181.00000000 |
sssd-10-4-3 | 4.8840 | 152710.00000000 |
sssd-12-5-3 | 24.9800 | 261143.00000000 |
sssd-15-6-3 | 93.9230 | 440711.00000000 |
sssd-16-8-3 | 966.8690 | 615763.00000000 |
sssd-18-8-3 | 2007.8900 | 524063.00000000 |
uflquad-15-60 | 55.5540 | 1063.19000000 |
uflquad-15-80 | 135.7990 | 1217.99000000 |
uflquad-20-40 | 63.0340 | 860.96100000 |
uflquad-25-25 | 19.6040 | 673.69700000 |
uflquad-25-30 | 25.4050 | 669.84000000 |
uflquad-25-40 | 129.8530 | 828.16500000 |
nd-10 | 33.6680 | 52.46110000 |
nd-12 | 170.7070 | 56.66960000 |
fo7_2 | 669.6300 | 17.74930000 |
fo7_ar2_1 | 289.6840 | 24.83980000 |
fo7_ar25_1 | 98.4970 | 23.09360000 |
fo7_ar3_1 | 253.5790 | 22.51750000 |
fo7_ar4_1 | 255.6380 | 20.72980000 |
fo7_ar5_1 | 52.8810 | 17.74930000 |
fo7 | 585.4510 | 20.72980000 |
fo8_ar2_1 | 2852.8100 | 30.34060000 |
fo8_ar25_1 | 1939.5800 | 28.04520000 |
fo8_ar3_1 | 741.7770 | 23.91010000 |
fo8_ar4_1 | 745.5250 | 22.38190000 |
fo8_ar5_1 | 901.8370 | 22.38190000 |
fo8 | 3786.5400 | 22.38190000 |
fo9_ar3_1 | 5716.6100 | 24.81550000 |
fo9_ar4_1 | 4651.0300 | 23.46430000 |
fo9_ar5_1 | 2552.4500 | 23.46430000 |
m3 | 0.2430 | 37.80000000 |
m6 | 7.3190 | 82.25690000 |
m7_ar2_1 | 163.7190 | 190.23500000 |
m7_ar25_1 | 11.1670 | 143.58500000 |
m7_ar3_1 | 91.9730 | 143.58500000 |
m7_ar4_1 | 34.5850 | 106.75700000 |
m7_ar5_1 | 68.2970 | 106.46000000 |
m7 | 184.2350 | 106.75700000 |
netmod_dol2 | 228.5540 | -0.56000800 |
netmod_kar1 | 42.5770 | -0.41979000 |
netmod_kar2 | 42.8470 | -0.41979000 |
no7_ar2_1 | 242.3140 | 107.81500000 |
no7_ar25_1 | 602.9350 | 107.81500000 |
no7_ar3_1 | 1243.3800 | 107.81500000 |
no7_ar4_1 | 823.2470 | 98.51840000 |
no7_ar5_1 | 477.5190 | 90.62270000 |
o7_2 | 1422.8800 | 116.94600000 |
o7_ar2_1 | 663.4050 | 140.41200000 |
o7_ar25_1 | 1119.5700 | 140.41200000 |
o7_ar3_1 | 1992.6000 | 137.93200000 |
o7_ar4_1 | 2899.6600 | 131.65300000 |
o7_ar5_1 | 1073.7500 | 116.94600000 |
o7 | 4180.1300 | 131.65300000 |
tls2 | 0.5020 | 5.30000000 |
tls4 | 1082.3800 | 8.30000000 |
BONMIN_bonmin-ecp: feasible:
Modelname | Time (BONMIN_bonmin-ecp) | Obj (BONMIN_bonmin-ecp) |
---|---|---|
FLay06H | 7281.0700 | 66.93280000 |
FLay06M | 7284.5600 | 66.93280000 |
RSyn0820M03M | 7543.7500 | 2009.08000000 |
RSyn0820M04M | 7357.5500 | 2406.04000000 |
RSyn0840M02M | 7649.7500 | 732.20500000 |
RSyn0840M03M | 7602.9100 | 2735.85000000 |
RSyn0840M04M | 7513.6400 | 2448.69000000 |
SLay09H | 7248.6500 | 107983.00000000 |
SLay10H | 7251.0400 | 130088.00000000 |
sssd-20-9-3 | 7343.1200 | 478437.00000000 |
sssd-22-8-3 | 7313.1400 | 596151.00000000 |
uflquad-20-50 | 7264.0500 | 375.91900000 |
nd-13 | 7222.1200 | 63.00510000 |
nd-15 | 7222.6900 | 82.59770000 |
nd-16 | 7222.1600 | 98.10190000 |
fo9_ar2_1 | 7285.5400 | 32.62500000 |
fo9_ar25_1 | 7281.9100 | 32.25000000 |
fo9 | 7297.3900 | 23.46430000 |
netmod_dol1 | 7273.5300 | -0.56000800 |
o8_ar4_1 | 7332.2800 | 256.13100000 |
o9_ar4_1 | 7282.0300 | 277.23900000 |
tls5 | 7285.5500 | 10.80000000 |
BONMIN_bonmin-ecp: fail:
Modelname | Time (BONMIN_bonmin-ecp) | Status (BONMIN_bonmin-ecp) |
---|---|---|
RSyn0820M02H | -- | mstat(13) sstat( 1) |
RSyn0820M03H | -- | mstat(13) sstat( 1) |
RSyn0820M04H | -- | mstat(13) sstat( 1) |
RSyn0840H | -- | mstat(13) sstat( 1) |
Syn10M | -- | mstat(13) sstat( 1) |
tls12 | -- | mstat(14) sstat( 3) |
tls6 | -- | mstat(14) sstat( 3) |
tls7 | -- | mstat(14) sstat( 3) |
SBB_sbb: optimal:
Modelname | Time (SBB_sbb) | Obj (SBB_sbb) |
---|---|---|
BatchS101006M | 81.6070 | 769440.00000000 |
BatchS121208M | 99.3970 | 1241130.00000000 |
BatchS151208M | 123.5030 | 1543470.00000000 |
BatchS201210M | 517.8210 | 2295350.00000000 |
clay0203h | 3.9370 | 41573.30000000 |
clay0203m | 1.8450 | 41573.30000000 |
clay0204h | 43.6850 | 6545.00000000 |
clay0204m | 10.9330 | 6545.00000000 |
clay0205h | 688.0400 | 8092.50000000 |
clay0205m | 231.4940 | 8092.50000000 |
clay0303h | 6.9610 | 26669.10000000 |
clay0304h | 510.2070 | 40262.40000000 |
clay0304m | 94.4630 | 40262.40000000 |
clay0305h | 1521.9900 | 8092.50000000 |
clay0305m | 186.2620 | 8092.50000000 |
FLay03H | 1.0190 | 48.98980000 |
FLay03M | 0.6440 | 48.98980000 |
FLay04H | 25.2120 | 54.40590000 |
FLay04M | 10.0850 | 54.40590000 |
FLay05M | 504.3070 | 64.49810000 |
RSyn0810H | 2.9460 | 1721.45000000 |
RSyn0810M02H | 20.7120 | 1741.39000000 |
RSyn0810M03H | 106.6050 | 2722.45000000 |
RSyn0810M04H | 30.6420 | 6581.94000000 |
RSyn0810M | 788.8410 | 1721.45000000 |
RSyn0820H | 4.6940 | 1150.30000000 |
RSyn0820M02H | 58.5700 | 1092.09000000 |
RSyn0820M03H | 514.5710 | 2028.81000000 |
RSyn0820M04H | 427.0530 | 2450.77000000 |
RSyn0820M | 7190.5900 | 1150.30000000 |
RSyn0840H | 2.1890 | 325.55500000 |
RSyn0840M02H | 18.9290 | 734.98400000 |
RSyn0840M03H | 113.8710 | 2742.65000000 |
RSyn0840M04H | 740.9130 | 2564.50000000 |
SLay05H | 22.2240 | 22664.70000000 |
SLay05M | 2.3020 | 22664.70000000 |
SLay06H | 387.8510 | 32757.00000000 |
SLay06M | 1.1210 | 32757.00000000 |
SLay07M | 13.6680 | 64748.80000000 |
SLay08M | 4.8160 | 84960.20000000 |
SLay09M | 330.1600 | 107806.00000000 |
SLay10M | 538.4240 | 129580.00000000 |
Syn10H | 0.1120 | 1267.35000000 |
Syn10M02H | 0.2850 | 2310.30000000 |
Syn10M02M | 3.3410 | 2310.30000000 |
Syn10M03H | 0.4480 | 3354.68000000 |
Syn10M03M | 13.2780 | 3354.68000000 |
Syn10M04H | 0.5910 | 4557.06000000 |
Syn10M04M | 58.3070 | 4557.06000000 |
Syn10M | 0.2170 | 1267.35000000 |
Syn20H | 0.2040 | 924.26300000 |
Syn20M02H | 0.9990 | 1752.13000000 |
Syn20M02M | 819.5300 | 1752.13000000 |
Syn20M03H | 1.1720 | 2646.95000000 |
Syn20M04H | 1.7440 | 3532.74000000 |
Syn20M | 3.3160 | 924.26300000 |
Syn40H | 0.8680 | 67.71340000 |
Syn40M02H | 3.8970 | 388.77300000 |
Syn40M03H | 16.2270 | 395.14900000 |
Syn40M04H | 60.9210 | 901.75200000 |
sssd-8-4-3 | 931.0760 | 197181.00000000 |
uflquad-15-60 | 15.8290 | 1063.19000000 |
uflquad-15-80 | 37.1940 | 1217.99000000 |
uflquad-20-40 | 19.0030 | 860.96100000 |
uflquad-20-50 | 1623.3800 | 375.91900000 |
uflquad-25-25 | 5.7650 | 673.69700000 |
uflquad-25-30 | 4.6730 | 669.84000000 |
uflquad-25-40 | 27.5040 | 828.16500000 |
nd-10 | 472.2360 | 52.46110000 |
nd-12 | 2721.8200 | 56.66960000 |
m3 | 0.4660 | 37.80000000 |
m6 | 1321.2900 | 82.25690000 |
m7_ar2_1 | 2283.0700 | 190.23500000 |
m7_ar25_1 | 4391.6700 | 143.58500000 |
m7_ar4_1 | 7134.8100 | 106.75700000 |
netmod_kar1 | 204.3500 | -0.41979000 |
netmod_kar2 | 202.6730 | -0.41979000 |
tls2 | 4.2320 | 5.30000000 |
SBB_sbb: feasible:
Modelname | Time (SBB_sbb) | Obj (SBB_sbb) |
---|---|---|
FLay06H | 7451.7700 | 66.93280000 |
RSyn0810M02M | 8679.9900 | 1592.16000000 |
RSyn0810M03M | 7569.2100 | 2368.77000000 |
RSyn0810M04M | 7495.6000 | 5433.33000000 |
RSyn0820M02M | 7627.2200 | 669.53700000 |
RSyn0820M03M | 7451.4200 | 1439.77000000 |
RSyn0820M04M | 7396.6400 | 1563.83000000 |
RSyn0840M02M | 8159.1100 | 191.12600000 |
RSyn0840M03M | 7609.5000 | 2241.35000000 |
RSyn0840M04M | 7575.0000 | 2301.43000000 |
RSyn0840M | 11688.7000 | 247.39700000 |
SLay07H | 7383.1600 | 64748.80000000 |
SLay08H | 7413.2200 | 85115.00000000 |
SLay09H | 7412.7900 | 122507.00000000 |
SLay10H | 7356.2200 | 153256.00000000 |
Syn20M03M | 7954.4200 | 2646.95000000 |
Syn20M04M | 7781.6900 | 3500.74000000 |
Syn40M02M | 8804.5400 | 344.48700000 |
Syn40M03M | 7548.5800 | 294.29000000 |
Syn40M04M | 7557.2600 | 831.89600000 |
Syn40M | 10415.2000 | 67.71330000 |
sssd-10-4-3 | 12944.6000 | 159329.00000000 |
sssd-12-5-3 | 19374.5000 | 330320.00000000 |
sssd-15-6-3 | 15779.7000 | 513871.00000000 |
sssd-16-8-3 | 13118.5000 | 709652.00000000 |
sssd-18-8-3 | 12851.3000 | 637320.00000000 |
sssd-20-9-3 | 11853.3000 | 510261.00000000 |
sssd-22-8-3 | 12055.5000 | 730203.00000000 |
nd-13 | 7251.3700 | 65.90790000 |
nd-15 | 7230.4100 | 86.92650000 |
nd-16 | 7227.5800 | 102.09800000 |
fo7_2 | 7403.9100 | 17.74930000 |
fo7_ar2_1 | 7545.5400 | 34.87130000 |
fo7_ar25_1 | 7414.1500 | 25.67840000 |
fo7_ar3_1 | 7413.0500 | 23.12100000 |
fo7_ar4_1 | 7368.0300 | 29.47550000 |
fo7_ar5_1 | 7340.0900 | 19.01200000 |
fo7 | 7431.2200 | 28.45230000 |
fo8_ar2_1 | 7498.4800 | 48.41990000 |
fo8_ar25_1 | 7372.1000 | 41.63040000 |
fo8_ar3_1 | 7329.2200 | 40.79120000 |
fo8_ar4_1 | 7294.2400 | 33.46530000 |
fo8_ar5_1 | 7299.6800 | 45.65780000 |
fo8 | 7381.7800 | 41.06960000 |
fo9_ar5_1 | 7263.1100 | 41.66030000 |
fo9 | 7344.6400 | 49.96150000 |
m7_ar3_1 | 7479.4900 | 143.58500000 |
m7_ar5_1 | 7336.1600 | 106.46000000 |
m7 | 7448.1800 | 106.75700000 |
netmod_dol1 | 7214.8800 | -0.55139800 |
no7_ar2_1 | 7471.5700 | 151.86000000 |
no7_ar25_1 | 7380.7300 | 148.78600000 |
no7_ar3_1 | 7374.7100 | 134.42700000 |
no7_ar4_1 | 7367.5900 | 120.70100000 |
no7_ar5_1 | 7343.6400 | 118.38200000 |
o7_2 | 7409.9700 | 122.35300000 |
o7_ar2_1 | 7458.1000 | 177.94600000 |
o7_ar25_1 | 7424.6000 | 180.92200000 |
o7_ar3_1 | 7369.9300 | 163.97700000 |
o7_ar4_1 | 7346.2800 | 183.00000000 |
o7_ar5_1 | 7350.2000 | 129.23900000 |
o7 | 7424.4200 | 165.39600000 |
o8_ar4_1 | 7302.2300 | 304.80900000 |
tls4 | 15208.6000 | 13.70000000 |
tls5 | 10552.2000 | 15.60000000 |
tls6 | 9148.5200 | 21.40000000 |
SBB_sbb: fail:
Modelname | Time (SBB_sbb) | Status (SBB_sbb) |
---|---|---|
clay0303m | -- | mstat(13)sstat( 1) |
FLay05H | -- | mstat(13)sstat( 1) |
FLay06M | -- | mstat(13)sstat( 1) |
fo9_ar2_1 | -- | mstat(14)sstat( 3) |
fo9_ar25_1 | -- | mstat(14)sstat( 3) |
fo9_ar3_1 | -- | mstat(14)sstat( 3) |
fo9_ar4_1 | -- | mstat(14)sstat( 3) |
netmod_dol2 | -- | mstat(13)sstat(13) |
o9_ar4_1 | -- | mstat(14)sstat( 3) |
tls12 | -- | mstat(14)sstat( 3) |
tls7 | -- | mstat(14)sstat( 3) |
BONMIN_bonmin-ecp: all -- SBB_sbb: all
Back to topA "(max)" behind a model names indicates that this model is a maximization model.
Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.
A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (19374.50 seconds). The shift is 10s.
Modelname | Time (BONMIN_bonmin-ecp) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-ecp/ SBB_sbb) | Obj (BONMIN_bonmin-ecp) | Obj (SBB_sbb) | ObjEst (BONMIN_bonmin-ecp) | ObjEst (SBB_sbb) | Gap (BONMIN_bonmin-ecp) | Gap (SBB_sbb) |
BatchS101006M | 18.8830 | 81.6070 | 0.231 | 769440.00000000 | 769440.00000000 | 769440.00000000 | 769440.00000000 | 0.0000 | 0.0000 |
BatchS121208M | 40.0140 | 99.3970 | 0.403 | 1241130.00000000 | 1241130.00000000 | 1241130.00000000 | 1241130.00000000 | 0.0000 | 0.0000 |
BatchS151208M | 77.0810 | 123.5030 | 0.624 | 1543470.00000000 | 1543470.00000000 | 1543470.00000000 | 1543470.00000000 | 0.0000 | 0.0000 |
BatchS201210M | 159.9390 | 517.8210 | 0.309 | 2295350.00000000 | 2295350.00000000 | 2295350.00000000 | 2295350.00000000 | 0.0000 | 0.0000 |
clay0203h | 2.5780 | 3.9370 | 0.655 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 0.0000 | 0.0000 |
clay0203m | 0.8980 | 1.8450 | 0.487 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 0.0000 | 0.0000 |
clay0204h | 5.1590 | 43.6850 | 0.118 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 0.0000 | 0.0000 |
clay0204m | 1.2880 | 10.9330 | 0.118 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 0.0000 | 0.0000 |
clay0205h | 110.1870 | 688.0400 | 0.160 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
clay0205m | 7.4710 | 231.4940 | 0.032 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
clay0303h | 7.6320 | 6.9610 | 1.096 | 26669.10000000 | 26669.10000000 | 26669.10000000 | 26669.10000000 | 0.0000 | 0.0000 |
clay0303m | 2.4170 | 1.7160 | --- | 26669.10000000 | mstat(13) sstat(1) | 26669.10000000 | --- | 0.0000 | --- |
clay0304h | 361.6070 | 510.2070 | 0.709 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 0.0000 | 0.0000 |
clay0304m | 48.5040 | 94.4630 | 0.513 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 0.0000 | 0.0000 |
clay0305h | 111.3750 | 1521.9900 | 0.073 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
clay0305m | 9.2630 | 186.2620 | 0.050 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
FLay03H | 0.9610 | 1.0190 | 0.943 | 48.98980000 | 48.98980000 | 48.98980000 | 48.98980000 | 0.0000 | 0.0000 |
FLay03M | 0.1900 | 0.6440 | 0.295 | 48.98980000 | 48.98980000 | 48.98980000 | 48.98980000 | 0.0000 | 0.0000 |
FLay04H | 8.0320 | 25.2120 | 0.319 | 54.40590000 | 54.40590000 | 54.40590000 | 54.40590000 | 0.0000 | 0.0000 |
FLay04M | 2.2510 | 10.0850 | 0.223 | 54.40590000 | 54.40590000 | 54.40590000 | 54.40590000 | 0.0000 | 0.0000 |
FLay05H | 300.2890 | 2611.9300 | --- | 64.49810000 | mstat(13) sstat(1) | 64.49810000 | --- | 0.0000 | --- |
FLay05M | 69.6520 | 504.3070 | 0.138 | 64.49810000 | 64.49810000 | 64.49810000 | 64.49810000 | 0.0000 | 0.0000 |
FLay06H | 7281.0700 | 7451.7700 | 0.977 | 66.93280000 | 66.93280000 | 61.62670000 | 51.70410000 | 0.0861 | 0.2945 |
FLay06M | 7284.5600 | 11788.9000 | --- | 66.93280000 | mstat(13) sstat(1) | 64.01070000 | --- | 0.0457 | --- |
RSyn0810H (max) | 0.5120 | 2.9460 | 0.174 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 0.0000 | 0.0000 |
RSyn0810M02H (max) | 1.8920 | 20.7120 | 0.091 | 1741.39000000 | 1741.39000000 | 1741.39000000 | 1741.39000000 | 0.0000 | 0.0000 |
RSyn0810M02M (max) | 192.1460 | 8679.9900 | 0.022 | 1741.39000000 | 1592.16000000 | 1741.39000000 | 3137.64000000 | 0.0000 | 0.4926 |
RSyn0810M03H (max) | 5.8860 | 106.6050 | 0.055 | 2722.45000000 | 2722.45000000 | 2722.45000000 | 2722.45000000 | 0.0000 | 0.0000 |
RSyn0810M03M (max) | 516.2070 | 7569.2100 | 0.068 | 2722.45000000 | 2368.77000000 | 2722.45000000 | 5509.95000000 | 0.0000 | 0.5701 |
RSyn0810M04H (max) | 5.6390 | 30.6420 | 0.184 | 6581.94000000 | 6581.94000000 | 6581.94000000 | 6581.94000000 | 0.0000 | 0.0000 |
RSyn0810M04M (max) | 628.9360 | 7495.6000 | 0.084 | 6581.93000000 | 5433.33000000 | 6581.93000000 | 10821.10000000 | 0.0000 | 0.4979 |
RSyn0810M (max) | 1.3240 | 788.8410 | 0.002 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 0.0000 | 0.0000 |
RSyn0820H (max) | 1.2260 | 4.6940 | 0.261 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 0.0000 | 0.0000 |
RSyn0820M02H (max) | 0.7970 | 58.5700 | --- | mstat(13) sstat(1) | 1092.09000000 | --- | 1092.09000000 | --- | 0.0000 |
RSyn0820M02M (max) | 2544.9800 | 7627.2200 | 0.334 | 1092.09000000 | 669.53700000 | 1092.09000000 | 4051.07000000 | 0.0000 | 0.8347 |
RSyn0820M03H (max) | 1.1540 | 514.5710 | --- | mstat(13) sstat(1) | 2028.81000000 | --- | 2028.81000000 | --- | 0.0000 |
RSyn0820M03M (max) | 7543.7500 | 7451.4200 | 1.012 | 2009.08000000 | 1439.77000000 | 2473.50000000 | 5861.88000000 | 0.1878 | 0.7544 |
RSyn0820M04H (max) | 2.2000 | 427.0530 | --- | mstat(13) sstat(1) | 2450.77000000 | --- | 2450.77000000 | --- | 0.0000 |
RSyn0820M04M (max) | 7357.5500 | 7396.6400 | 0.995 | 2406.04000000 | 1563.83000000 | 3286.00000000 | 8372.19000000 | 0.2678 | 0.8132 |
RSyn0820M (max) | 3.0760 | 7190.5900 | 0.000 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 0.0000 | 0.0000 |
RSyn0840H (max) | 0.3550 | 2.1890 | --- | mstat(13) sstat(1) | 325.55500000 | --- | 325.55500000 | --- | 0.0000 |
RSyn0840M02H (max) | 1.8590 | 18.9290 | 0.098 | 734.98400000 | 734.98400000 | 734.98400000 | 734.98400000 | 0.0000 | 0.0000 |
RSyn0840M02M (max) | 7649.7500 | 8159.1100 | 0.938 | 732.20500000 | 191.12600000 | 754.17300000 | 4639.90000000 | 0.0291 | 0.9588 |
RSyn0840M03H (max) | 6.8420 | 113.8710 | 0.060 | 2742.65000000 | 2742.65000000 | 2742.65000000 | 2742.65000000 | 0.0000 | 0.0000 |
RSyn0840M03M (max) | 7602.9100 | 7609.5000 | 0.999 | 2735.85000000 | 2241.35000000 | 2802.70000000 | 7850.66000000 | 0.0239 | 0.7145 |
RSyn0840M04H (max) | 17.8030 | 740.9130 | 0.024 | 2564.50000000 | 2564.50000000 | 2564.50000000 | 2564.50000000 | 0.0000 | 0.0000 |
RSyn0840M04M (max) | 7513.6400 | 7575.0000 | 0.992 | 2448.69000000 | 2301.43000000 | 3827.05000000 | 12846.10000000 | 0.3602 | 0.8208 |
RSyn0840M (max) | 2.9260 | 11688.7000 | 0.000 | 325.55500000 | 247.39700000 | 325.55500000 | 1497.16000000 | 0.0000 | 0.8348 |
SLay05H | 2.4860 | 22.2240 | 0.112 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 0.0000 | 0.0000 |
SLay05M | 0.4620 | 2.3020 | 0.201 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 0.0000 | 0.0000 |
SLay06H | 11.5030 | 387.8510 | 0.030 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 0.0000 | 0.0000 |
SLay06M | 0.8940 | 1.1210 | 0.798 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 0.0000 | 0.0000 |
SLay07H | 60.6700 | 7383.1600 | 0.008 | 64748.80000000 | 64748.80000000 | 64748.80000000 | 64698.40000000 | 0.0000 | 0.0008 |
SLay07M | 1.7220 | 13.6680 | 0.126 | 64748.80000000 | 64748.80000000 | 64748.80000000 | 64748.80000000 | 0.0000 | 0.0000 |
SLay08H | 174.7850 | 7413.2200 | 0.024 | 84960.20000000 | 85115.00000000 | 84960.20000000 | 82023.90000000 | 0.0000 | 0.0377 |
SLay08M | 5.6610 | 4.8160 | 1.175 | 84960.20000000 | 84960.20000000 | 84960.20000000 | 84960.20000000 | 0.0000 | 0.0000 |
SLay09H | 7248.6500 | 7412.7900 | 0.978 | 107983.00000000 | 122507.00000000 | 105702.00000000 | 103264.00000000 | 0.0216 | 0.1863 |
SLay09M | 28.1110 | 330.1600 | 0.085 | 107806.00000000 | 107806.00000000 | 107806.00000000 | 107806.00000000 | 0.0000 | 0.0000 |
SLay10H | 7251.0400 | 7356.2200 | 0.986 | 130088.00000000 | 153256.00000000 | 119968.00000000 | 119326.00000000 | 0.0844 | 0.2843 |
SLay10M | 396.9250 | 538.4240 | 0.737 | 129580.00000000 | 129580.00000000 | 129580.00000000 | 129580.00000000 | 0.0000 | 0.0000 |
Syn10H (max) | 0.1720 | 0.1120 | 1.536 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 0.0000 | 0.0000 |
Syn10M02H (max) | 0.2590 | 0.2850 | 0.909 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 0.0000 | 0.0000 |
Syn10M02M (max) | 0.4210 | 3.3410 | 0.126 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 0.0000 | 0.0000 |
Syn10M03H (max) | 0.3040 | 0.4480 | 0.679 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 0.0000 | 0.0000 |
Syn10M03M (max) | 0.9830 | 13.2780 | 0.074 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 0.0000 | 0.0000 |
Syn10M04H (max) | 0.1810 | 0.5910 | 0.306 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 0.0000 | 0.0000 |
Syn10M04M (max) | 1.0200 | 58.3070 | 0.017 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 0.0000 | 0.0000 |
Syn10M (max) | 0.0670 | 0.2170 | --- | mstat(13) sstat(1) | 1267.35000000 | --- | 1267.35000000 | --- | 0.0000 |
Syn20H (max) | 0.3190 | 0.2040 | 1.564 | 924.26300000 | 924.26300000 | 924.26300000 | 924.26300000 | 0.0000 | 0.0000 |
Syn20M02H (max) | 0.5650 | 0.9990 | 0.566 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 0.0000 | 0.0000 |
Syn20M02M (max) | 1.3480 | 819.5300 | 0.002 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 0.0000 | 0.0000 |
Syn20M03H (max) | 0.5830 | 1.1720 | 0.497 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 0.0000 | 0.0000 |
Syn20M03M (max) | 2.0970 | 7954.4200 | 0.000 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 2658.98000000 | 0.0000 | 0.0045 |
Syn20M04H (max) | 0.8500 | 1.7440 | 0.487 | 3532.74000000 | 3532.74000000 | 3532.75000000 | 3532.74000000 | 0.0000 | 0.0000 |
Syn20M04M (max) | 8.1460 | 7781.6900 | 0.001 | 3532.74000000 | 3500.74000000 | 3532.74000000 | 4698.66000000 | 0.0000 | 0.2549 |
Syn20M (max) | 0.2210 | 3.3160 | 0.067 | 924.26300000 | 924.26300000 | 924.26300000 | 924.26300000 | 0.0000 | 0.0000 |
Syn40H (max) | 0.6920 | 0.8680 | 0.797 | 67.71340000 | 67.71340000 | 67.71340000 | 67.71340000 | 0.0000 | 0.0000 |
Syn40M02H (max) | 1.4210 | 3.8970 | 0.365 | 388.77300000 | 388.77300000 | 388.77300000 | 388.77300000 | 0.0000 | 0.0000 |
Syn40M02M (max) | 8.1890 | 8804.5400 | 0.001 | 388.77200000 | 344.48700000 | 388.77200000 | 1726.45000000 | 0.0000 | 0.8005 |
Syn40M03H (max) | 5.8460 | 16.2270 | 0.360 | 395.14900000 | 395.14900000 | 395.14900000 | 395.14900000 | 0.0000 | 0.0000 |
Syn40M03M (max) | 76.3700 | 7548.5800 | 0.010 | 395.14800000 | 294.29000000 | 395.14800000 | 4342.80000000 | 0.0000 | 0.9322 |
Syn40M04H (max) | 5.7460 | 60.9210 | 0.094 | 901.75200000 | 901.75200000 | 901.75200000 | 901.75200000 | 0.0000 | 0.0000 |
Syn40M04M (max) | 4042.3500 | 7557.2600 | 0.535 | 901.75100000 | 831.89600000 | 901.75100000 | 5965.61000000 | 0.0000 | 0.8606 |
Syn40M (max) | 0.7600 | 10415.2000 | 0.000 | 67.71330000 | 67.71330000 | 67.71330000 | 257.14600000 | 0.0000 | 0.7367 |
sssd-8-4-3 | 1.3690 | 931.0760 | 0.001 | 197181.00000000 | 197181.00000000 | 197181.00000000 | 197181.00000000 | 0.0000 | 0.0000 |
sssd-10-4-3 | 4.8840 | 12944.6000 | 0.000 | 152710.00000000 | 159329.00000000 | 152710.00000000 | 143244.00000000 | 0.0000 | 0.1123 |
sssd-12-5-3 | 24.9800 | 19374.5000 | 0.001 | 261143.00000000 | 330320.00000000 | 261143.00000000 | 101530.00000000 | 0.0000 | 2.2534 |
sssd-15-6-3 | 93.9230 | 15779.7000 | 0.006 | 440711.00000000 | 513871.00000000 | 440711.00000000 | 155381.00000000 | 0.0000 | 2.3072 |
sssd-16-8-3 | 966.8690 | 13118.5000 | 0.074 | 615763.00000000 | 709652.00000000 | 615763.00000000 | 223552.00000000 | 0.0000 | 2.1744 |
sssd-18-8-3 | 2007.8900 | 12851.3000 | 0.156 | 524063.00000000 | 637320.00000000 | 524062.00000000 | 192178.00000000 | 0.0000 | 2.3163 |
sssd-20-9-3 | 7343.1200 | 11853.3000 | 0.620 | 478437.00000000 | 510261.00000000 | 476479.00000000 | 180409.00000000 | 0.0041 | 1.8284 |
sssd-22-8-3 | 7313.1400 | 12055.5000 | 0.607 | 596151.00000000 | 730203.00000000 | 595601.00000000 | 216626.00000000 | 0.0009 | 2.3708 |
uflquad-15-60 | 55.5540 | 15.8290 | 3.510 | 1063.19000000 | 1063.19000000 | 1063.19000000 | 1063.19000000 | 0.0000 | 0.0000 |
uflquad-15-80 | 135.7990 | 37.1940 | 3.651 | 1217.99000000 | 1217.99000000 | 1217.99000000 | 1217.99000000 | 0.0000 | 0.0000 |
uflquad-20-40 | 63.0340 | 19.0030 | 3.317 | 860.96100000 | 860.96100000 | 860.96100000 | 860.96100000 | 0.0000 | 0.0000 |
uflquad-20-50 | 7264.0500 | 1623.3800 | 4.475 | 375.91900000 | 375.91900000 | 302.77000000 | 375.91900000 | 0.2416 | 0.0000 |
uflquad-25-25 | 19.6040 | 5.7650 | 3.401 | 673.69700000 | 673.69700000 | 673.69700000 | 673.69700000 | 0.0000 | 0.0000 |
uflquad-25-30 | 25.4050 | 4.6730 | 5.437 | 669.84000000 | 669.84000000 | 669.84000000 | 669.84000000 | 0.0000 | 0.0000 |
uflquad-25-40 | 129.8530 | 27.5040 | 4.721 | 828.16500000 | 828.16500000 | 828.16500000 | 828.16500000 | 0.0000 | 0.0000 |
nd-10 | 33.6680 | 472.2360 | 0.071 | 52.46110000 | 52.46110000 | 52.46110000 | 52.46110000 | 0.0000 | 0.0000 |
nd-12 | 170.7070 | 2721.8200 | 0.063 | 56.66960000 | 56.66960000 | 56.66960000 | 56.66960000 | 0.0000 | 0.0000 |
nd-13 | 7222.1200 | 7251.3700 | 0.996 | 63.00510000 | 65.90790000 | 58.18300000 | 54.66070000 | 0.0829 | 0.2058 |
nd-15 | 7222.6900 | 7230.4100 | 0.999 | 82.59770000 | 86.92650000 | 68.86560000 | 65.11490000 | 0.1994 | 0.3350 |
nd-16 | 7222.1600 | 7227.5800 | 0.999 | 98.10190000 | 102.09800000 | 93.90990000 | 78.22420000 | 0.0446 | 0.3052 |
fo7_2 | 669.6300 | 7403.9100 | 0.090 | 17.74930000 | 17.74930000 | 17.74930000 | 11.09430000 | 0.0000 | 0.5999 |
fo7_ar2_1 | 289.6840 | 7545.5400 | 0.038 | 24.83980000 | 34.87130000 | 24.83980000 | 19.42240000 | 0.0000 | 0.7954 |
fo7_ar25_1 | 98.4970 | 7414.1500 | 0.013 | 23.09360000 | 25.67840000 | 23.09360000 | 17.25980000 | 0.0000 | 0.4878 |
fo7_ar3_1 | 253.5790 | 7413.0500 | 0.034 | 22.51750000 | 23.12100000 | 22.51750000 | 15.69890000 | 0.0000 | 0.4728 |
fo7_ar4_1 | 255.6380 | 7368.0300 | 0.035 | 20.72980000 | 29.47550000 | 20.72980000 | 14.72570000 | 0.0000 | 1.0016 |
fo7_ar5_1 | 52.8810 | 7340.0900 | 0.007 | 17.74930000 | 19.01200000 | 17.74930000 | 14.63770000 | 0.0000 | 0.2988 |
fo7 | 585.4510 | 7431.2200 | 0.079 | 20.72980000 | 28.45230000 | 20.72980000 | 10.19240000 | 0.0000 | 1.7915 |
fo8_ar2_1 | 2852.8100 | 7498.4800 | 0.380 | 30.34060000 | 48.41990000 | 30.34060000 | 16.71750000 | 0.0000 | 1.8964 |
fo8_ar25_1 | 1939.5800 | 7372.1000 | 0.263 | 28.04520000 | 41.63040000 | 28.04520000 | 14.27250000 | 0.0000 | 1.9168 |
fo8_ar3_1 | 741.7770 | 7329.2200 | 0.101 | 23.91010000 | 40.79120000 | 23.91010000 | 11.67870000 | 0.0000 | 2.4928 |
fo8_ar4_1 | 745.5250 | 7294.2400 | 0.102 | 22.38190000 | 33.46530000 | 22.38190000 | 11.17020000 | 0.0000 | 1.9959 |
fo8_ar5_1 | 901.8370 | 7299.6800 | 0.124 | 22.38190000 | 45.65780000 | 22.38190000 | 12.09400000 | 0.0000 | 2.7752 |
fo8 | 3786.5400 | 7381.7800 | 0.513 | 22.38190000 | 41.06960000 | 22.38190000 | 7.74500000 | 0.0000 | 4.3027 |
fo9_ar2_1 | 7285.5400 | 7424.3900 | --- | 32.62500000 | mstat(14) sstat(3) | 28.82180000 | --- | 0.1320 | --- |
fo9_ar25_1 | 7281.9100 | 7375.1300 | --- | 32.25000000 | mstat(14) sstat(3) | 27.19580000 | --- | 0.1858 | --- |
fo9_ar3_1 | 5716.6100 | 7292.3500 | --- | 24.81550000 | mstat(14) sstat(3) | 24.81550000 | --- | 0.0000 | --- |
fo9_ar4_1 | 4651.0300 | 7268.4700 | --- | 23.46430000 | mstat(14) sstat(3) | 23.46430000 | --- | 0.0000 | --- |
fo9_ar5_1 | 2552.4500 | 7263.1100 | 0.351 | 23.46430000 | 41.66030000 | 23.46430000 | 7.82468000 | 0.0000 | 4.3242 |
fo9 | 7297.3900 | 7344.6400 | 0.994 | 23.46430000 | 49.96150000 | 19.54830000 | 6.50795000 | 0.2003 | 6.6770 |
m3 | 0.2430 | 0.4660 | 0.521 | 37.80000000 | 37.80000000 | 37.80000000 | 37.80000000 | 0.0000 | 0.0000 |
m6 | 7.3190 | 1321.2900 | 0.006 | 82.25690000 | 82.25690000 | 82.25690000 | 82.25690000 | 0.0000 | 0.0000 |
m7_ar2_1 | 163.7190 | 2283.0700 | 0.072 | 190.23500000 | 190.23500000 | 190.23500000 | 190.23500000 | 0.0000 | 0.0000 |
m7_ar25_1 | 11.1670 | 4391.6700 | 0.003 | 143.58500000 | 143.58500000 | 143.58500000 | 143.58500000 | 0.0000 | 0.0000 |
m7_ar3_1 | 91.9730 | 7479.4900 | 0.012 | 143.58500000 | 143.58500000 | 143.58500000 | 119.94100000 | 0.0000 | 0.1971 |
m7_ar4_1 | 34.5850 | 7134.8100 | 0.005 | 106.75700000 | 106.75700000 | 106.75700000 | 106.75700000 | 0.0000 | 0.0000 |
m7_ar5_1 | 68.2970 | 7336.1600 | 0.009 | 106.46000000 | 106.46000000 | 106.46000000 | 94.28920000 | 0.0000 | 0.1291 |
m7 | 184.2350 | 7448.1800 | 0.025 | 106.75700000 | 106.75700000 | 106.75700000 | 98.71500000 | 0.0000 | 0.0815 |
netmod_dol1 | 7273.5300 | 7214.8800 | 1.008 | -0.56000800 | -0.55139800 | -0.67306100 | -0.65233400 | 0.1680 | 0.1547 |
netmod_dol2 | 228.5540 | 5.3840 | --- | -0.56000800 | mstat(13) sstat(13) | -0.56000800 | --- | 0.0000 | --- |
netmod_kar1 | 42.5770 | 204.3500 | 0.208 | -0.41979000 | -0.41979000 | -0.41979000 | -0.41979000 | 0.0000 | 0.0000 |
netmod_kar2 | 42.8470 | 202.6730 | 0.211 | -0.41979000 | -0.41979000 | -0.41979000 | -0.41979000 | 0.0000 | 0.0000 |
no7_ar2_1 | 242.3140 | 7471.5700 | 0.032 | 107.81500000 | 151.86000000 | 107.81500000 | 71.94960000 | 0.0000 | 1.1106 |
no7_ar25_1 | 602.9350 | 7380.7300 | 0.082 | 107.81500000 | 148.78600000 | 107.81500000 | 60.32300000 | 0.0000 | 1.4665 |
no7_ar3_1 | 1243.3800 | 7374.7100 | 0.169 | 107.81500000 | 134.42700000 | 107.81500000 | 56.45360000 | 0.0000 | 1.3812 |
no7_ar4_1 | 823.2470 | 7367.5900 | 0.112 | 98.51840000 | 120.70100000 | 98.51840000 | 55.14560000 | 0.0000 | 1.1888 |
no7_ar5_1 | 477.5190 | 7343.6400 | 0.065 | 90.62270000 | 118.38200000 | 90.62270000 | 50.43270000 | 0.0000 | 1.3473 |
o7_2 | 1422.8800 | 7409.9700 | 0.192 | 116.94600000 | 122.35300000 | 116.94600000 | 59.31550000 | 0.0000 | 1.0627 |
o7_ar2_1 | 663.4050 | 7458.1000 | 0.089 | 140.41200000 | 177.94600000 | 140.41200000 | 81.91440000 | 0.0000 | 1.1723 |
o7_ar25_1 | 1119.5700 | 7424.6000 | 0.151 | 140.41200000 | 180.92200000 | 140.41200000 | 78.99120000 | 0.0000 | 1.2904 |
o7_ar3_1 | 1992.6000 | 7369.9300 | 0.270 | 137.93200000 | 163.97700000 | 137.93200000 | 77.16780000 | 0.0000 | 1.1249 |
o7_ar4_1 | 2899.6600 | 7346.2800 | 0.395 | 131.65300000 | 183.00000000 | 131.65300000 | 69.24490000 | 0.0000 | 1.6428 |
o7_ar5_1 | 1073.7500 | 7350.2000 | 0.146 | 116.94600000 | 129.23900000 | 116.94600000 | 74.41120000 | 0.0000 | 0.7368 |
o7 | 4180.1300 | 7424.4200 | 0.563 | 131.65300000 | 165.39600000 | 131.65300000 | 51.96060000 | 0.0000 | 2.1831 |
o8_ar4_1 | 7332.2800 | 7302.2300 | 1.004 | 256.13100000 | 304.80900000 | 196.32100000 | 108.77000000 | 0.3047 | 1.8023 |
o9_ar4_1 | 7282.0300 | 7297.6900 | --- | 277.23900000 | mstat(14) sstat(3) | 163.96900000 | --- | 0.6908 | --- |
tls12 | 7262.9300 | 7667.1300 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
tls2 | 0.5020 | 4.2320 | 0.119 | 5.30000000 | 5.30000000 | 5.30000000 | 5.30000000 | 0.0000 | 0.0000 |
tls4 | 1082.3800 | 15208.6000 | 0.071 | 8.30000000 | 13.70000000 | 8.30000000 | 2.27539000 | 0.0000 | 5.0209 |
tls5 | 7285.5500 | 10552.2000 | 0.690 | 10.80000000 | 15.60000000 | 5.99275000 | 1.81080000 | 0.8022 | 7.6150 |
tls6 | 7284.2000 | 9148.5200 | --- | mstat(14) sstat(3) | 21.40000000 | --- | 1.92937000 | --- | 10.0917 |
tls7 | 7268.1300 | 8474.5600 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- | Shifted Geometric Mean (Solved) |
209.19 | 1170.83 |
% Unsolved | 19.35% | 49.68% |