Solver Square Comparison: Considers all models.
Results created on 09/14/12 19:33:54 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver
Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.
Solver BONMIN_bonmin-bb is represented on the left (rows) and solver SBB_sbb on top (columns).
See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.
Input File Number | Filename |
---|---|
Tracefile 1: | minlpconvex_bonmin-bb.pav |
Tracefile 2: | minlpconvex_sbb.pav |
Solvers used : | BONMIN_bonmin-bb |
SBB_sbb | |
Modeltype(s) |   MINLP |
SBB_sbb: optimal |
SBB_sbb: locally optimal |
SBB_sbb: feasible |
SBB_sbb: infeasible |
SBB_sbb: unbounded |
SBB_sbb: fail |
SBB_sbb: no data |
total BONMIN_bonmin-bb | |
BONMIN_bonmin-bb: optimal | 76 | - | 11 | - | - | 3 | - | 90 |
BONMIN_bonmin-bb: locally optimal | - | - | - | - | - | - | - | - |
BONMIN_bonmin-bb: feasible | 2 | - | 49 | - | - | 1 | - | 52 |
BONMIN_bonmin-bb: infeasible | - | - | - | - | - | - | - | - |
BONMIN_bonmin-bb: unbounded | - | - | - | - | - | - | - | - |
BONMIN_bonmin-bb: fail | - | - | 6 | - | - | 7 | - | 13 |
BONMIN_bonmin-bb: no data | - | - | - | - | - | - | - | - |
total SBB_sbb | 78 | - | 66 | - | - | 11 | - | 155 |
Solver return definitions:
Outcome | Model Status | Solver Status |
---|---|---|
optimal | 1 or 15 | 1 |
locally optimal | 2 | any |
feasible | 8 or 16 | 1 or 2 or 3 or 4 or 5 |
infeasible | 4 or 5 or 10 or 19 | 1 |
unbounded | 3 or 18 | 1 |
fail | all other | all other |
Solver Resource Times
- Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
- Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.50E-04. If both solutions are less than 1e-1, we use the absolute difference.
- Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.
BONMIN_bonmin-bb: optimal -- SBB_sbb: optimal    
Back to top
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/SBB_sbb) | Obj (BONMIN_bonmin-bb) | Obj (SBB_sbb) |
---|---|---|---|---|---|
BatchS101006M | 18.3460 | 81.6070 | 0.225 | 769440.00000000 | 769440.00000000 |
BatchS121208M | 37.3690 | 99.3970 | 0.376 | 1241130.00000000 | 1241130.00000000 |
BatchS151208M | 110.9250 | 123.5030 | 0.898 | 1543470.00000000 | 1543470.00000000 |
BatchS201210M | 144.9750 | 517.8210 | 0.280 | 2295350.00000000 | 2295350.00000000 |
clay0203h | 6.8740 | 3.9370 | 1.746 | 41573.30000000 | 41573.30000000 |
clay0203m | 4.2890 | 1.8450 | 2.325 | 41573.30000000 | 41573.30000000 |
clay0204h | 52.7820 | 43.6850 | 1.208 | 6545.00000000 | 6545.00000000 |
clay0204m | 9.1500 | 10.9330 | 0.837 | 6545.00000000 | 6545.00000000 |
clay0205h | 1775.5400 | 688.0400 | 2.581 | 8092.50000000 | 8092.50000000 |
clay0205m | 708.5470 | 231.4940 | 3.061 | 8092.50000000 | 8092.50000000 |
clay0303h | 18.6050 | 6.9610 | 2.673 | 26669.10000000 | 26669.10000000 |
clay0304h | 208.0350 | 510.2070 | 0.408 | 40262.40000000 | 40262.40000000 |
clay0304m | 61.5350 | 94.4630 | 0.651 | 40262.40000000 | 40262.40000000 |
clay0305h | 1662.5000 | 1521.9900 | 1.092 | 8092.50000000 | 8092.50000000 |
clay0305m | 250.6350 | 186.2620 | 1.346 | 8092.50000000 | 8092.50000000 |
FLay03H | 2.2550 | 1.0190 | 2.213 | 48.98980000 | 48.98980000 |
FLay03M | 0.8650 | 0.6440 | 1.343 | 48.98980000 | 48.98980000 |
FLay04H | 38.9700 | 25.2120 | 1.546 | 54.40590000 | 54.40590000 |
FLay04M | 12.8400 | 10.0850 | 1.273 | 54.40590000 | 54.40590000 |
FLay05M | 617.4280 | 504.3070 | 1.224 | 64.49810000 | 64.49810000 |
RSyn0810H | 3.0840 | 2.9460 | 1.047 | 1721.45000000 | 1721.45000000 |
RSyn0810M02H | 18.2470 | 20.7120 | 0.881 | 1741.39000000 | 1741.39000000 |
RSyn0810M03H | 53.8100 | 106.6050 | 0.505 | 2722.45000000 | 2722.45000000 |
RSyn0810M04H | 30.9780 | 30.6420 | 1.011 | 6581.94000000 | 6581.94000000 |
RSyn0810M | 450.3500 | 788.8410 | 0.571 | 1721.45000000 | 1721.45000000 |
RSyn0820H | 5.5110 | 4.6940 | 1.174 | 1150.30000000 | 1150.30000000 |
RSyn0820M02H | 22.9370 | 58.5700 | 0.392 | 1092.09000000 | 1092.09000000 |
RSyn0820M03H | 75.2470 | 514.5710 | 0.146 | 2028.81000000 | 2028.81000000 |
RSyn0820M04H | 91.3950 | 427.0530 | 0.214 | 2450.77000000 | 2450.77000000 |
RSyn0820M | 3363.6400 | 7190.5900 | 0.468 | 1150.30000000 | 1150.30000000 |
RSyn0840H | 3.7300 | 2.1890 | 1.704 | 325.55500000 | 325.55500000 |
RSyn0840M02H | 23.3200 | 18.9290 | 1.232 | 734.98400000 | 734.98400000 |
RSyn0840M03H | 66.9090 | 113.8710 | 0.588 | 2742.65000000 | 2742.65000000 |
RSyn0840M04H | 240.4630 | 740.9130 | 0.325 | 2564.50000000 | 2564.50000000 |
SLay05H | 4.4500 | 22.2240 | 0.200 | 22664.70000000 | 22664.70000000 |
SLay05M | 2.5770 | 2.3020 | 1.119 | 22664.70000000 | 22664.70000000 |
SLay06H | 54.5440 | 387.8510 | 0.141 | 32757.00000000 | 32757.00000000 |
SLay06M | 27.4070 | 1.1210 | 24.449 | 32757.00000000 | 32757.00000000 |
SLay07M | 66.4610 | 13.6680 | 4.863 | 64748.80000000 | 64748.80000000 |
SLay08M | 67.5310 | 4.8160 | 14.022 | 84960.20000000 | 84960.20000000 |
SLay09M | 69.8780 | 330.1600 | 0.212 | 107806.00000000 | 107806.00000000 |
SLay10M | 144.9750 | 538.4240 | 0.269 | 129580.00000000 | 129580.00000000 |
Syn10H | 0.3520 | 0.1120 | 3.143 | 1267.35000000 | 1267.35000000 |
Syn10M02H | 0.3180 | 0.2850 | 1.116 | 2310.30000000 | 2310.30000000 |
Syn10M02M | 4.5530 | 3.3410 | 1.363 | 2310.30000000 | 2310.30000000 |
Syn10M03H | 0.7190 | 0.4480 | 1.605 | 3354.68000000 | 3354.68000000 |
Syn10M03M | 19.6690 | 13.2780 | 1.481 | 3354.68000000 | 3354.68000000 |
Syn10M04H | 1.0620 | 0.5910 | 1.797 | 4557.06000000 | 4557.06000000 |
Syn10M04M | 56.4720 | 58.3070 | 0.969 | 4557.06000000 | 4557.06000000 |
Syn10M | 0.6270 | 0.2170 | 2.889 | 1267.35000000 | 1267.35000000 |
Syn20H | 0.4150 | 0.2040 | 2.034 | 924.26300000 | 924.26300000 |
Syn20M02H | 2.2460 | 0.9990 | 2.248 | 1752.13000000 | 1752.13000000 |
Syn20M02M | 458.7050 | 819.5300 | 0.560 | 1752.13000000 | 1752.13000000 |
Syn20M03H | 4.2170 | 1.1720 | 3.598 | 2646.95000000 | 2646.95000000 |
Syn20M04H | 7.6110 | 1.7440 | 4.364 | 3532.74000000 | 3532.74000000 |
Syn20M | 4.8100 | 3.3160 | 1.451 | 924.26300000 | 924.26300000 |
Syn40H | 1.5330 | 0.8680 | 1.766 | 67.71340000 | 67.71340000 |
Syn40M02H | 3.5190 | 3.8970 | 0.903 | 388.77300000 | 388.77300000 |
Syn40M03H | 17.1110 | 16.2270 | 1.054 | 395.14900000 | 395.14900000 |
Syn40M04H | 53.4430 | 60.9210 | 0.877 | 901.75200000 | 901.75200000 |
sssd-8-4-3 | 9.6910 | 931.0760 | 0.010 | 197181.00000000 | 197181.00000000 |
uflquad-15-60 | 12.4560 | 15.8290 | 0.787 | 1063.19000000 | 1063.19000000 |
uflquad-15-80 | 22.6090 | 37.1940 | 0.608 | 1217.99000000 | 1217.99000000 |
uflquad-20-40 | 17.2550 | 19.0030 | 0.908 | 860.96100000 | 860.96100000 |
uflquad-20-50 | 225.1360 | 1623.3800 | 0.139 | 375.91900000 | 375.91900000 |
uflquad-25-25 | 10.5160 | 5.7650 | 1.824 | 673.69700000 | 673.69700000 |
uflquad-25-30 | 12.5240 | 4.6730 | 2.680 | 669.84000000 | 669.84000000 |
uflquad-25-40 | 23.3470 | 27.5040 | 0.849 | 828.16500000 | 828.16500000 |
nd-10 | 1189.2800 | 472.2360 | 2.518 | 52.46110000 | 52.46110000 |
m3 | 1.3530 | 0.4660 | 2.903 | 37.80000000 | 37.80000000 |
m6 | 46.2730 | 1321.2900 | 0.035 | 82.25690000 | 82.25690000 |
m7_ar2_1 | 2569.7700 | 2283.0700 | 1.126 | 190.23500000 | 190.23500000 |
m7_ar25_1 | 166.4970 | 4391.6700 | 0.038 | 143.58500000 | 143.58500000 |
netmod_kar1 | 15.0230 | 204.3500 | 0.074 | -0.41979000 | -0.41979000 |
netmod_kar2 | 15.0430 | 202.6730 | 0.074 | -0.41979000 | -0.41979000 |
tls2 | 5.9730 | 4.2320 | 1.411 | 5.30000000 | 5.30000000 |
BONMIN_bonmin-bb: optimal -- SBB_sbb: feasible    
Back to top
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/SBB_sbb) | Obj (BONMIN_bonmin-bb) | Obj (SBB_sbb) |
---|---|---|---|---|---|
SLay07H | 67.9740 | 7383.1600 | 0.009 | 64748.80000000 | 64748.80000000 |
SLay08H | 69.2590 | 7413.2200 | 0.009 | 84960.20000000 | 85115.00000000 |
SLay09H | 79.2830 | 7412.7900 | 0.011 | 107806.00000000 | 122507.00000000 |
SLay10H | 336.6470 | 7356.2200 | 0.046 | 129580.00000000 | 153256.00000000 |
Syn40M | 973.0320 | 10415.2000 | 0.093 | 67.71330000 | 67.71330000 |
sssd-10-4-3 | 12.5650 | 12944.6000 | 0.001 | 152710.00000000 | 159329.00000000 |
sssd-12-5-3 | 52.5360 | 19374.5000 | 0.003 | 261143.00000000 | 330320.00000000 |
sssd-15-6-3 | 231.9490 | 15779.7000 | 0.015 | 440711.00000000 | 513871.00000000 |
fo7_2 | 2031.2700 | 7403.9100 | 0.274 | 17.74930000 | 17.74930000 |
fo7_ar5_1 | 4544.9200 | 7340.0900 | 0.619 | 17.74930000 | 19.01200000 |
m7 | 507.3050 | 7448.1800 | 0.068 | 106.75700000 | 106.75700000 |
BONMIN_bonmin-bb: optimal -- SBB_sbb: fail    
Back to top
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/SBB_sbb) | Obj (BONMIN_bonmin-bb) | Status (SBB_sbb) |
---|---|---|---|---|---|
clay0303m | 5.5580 | 1.7160 | --- | 26669.10000000 | mstat(13)sstat( 1) |
FLay05H | 3506.4800 | 2611.9300 | --- | 64.49810000 | mstat(13)sstat( 1) |
netmod_dol2 | 1936.8100 | 5.3840 | --- | -0.56000800 | mstat(13)sstat(13) |
BONMIN_bonmin-bb: feasible -- SBB_sbb: optimal    
Back to top
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/SBB_sbb) | Obj (BONMIN_bonmin-bb) | Obj (SBB_sbb) |
---|---|---|---|---|---|
nd-12 | 7239.3100 | 2721.8200 | 2.660 | 58.30360000 | 56.66960000 |
m7_ar4_1 | 7488.2500 | 7134.8100 | 1.050 | 148.62000000 | 106.75700000 |
BONMIN_bonmin-bb: feasible -- SBB_sbb: feasible    
Back to top
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/SBB_sbb) | Obj (BONMIN_bonmin-bb) | Obj (SBB_sbb) |
---|---|---|---|---|---|
FLay06H | 7394.3800 | 7451.7700 | 0.992 | 66.93280000 | 66.93280000 |
RSyn0810M02M | 7375.6600 | 8679.9900 | 0.850 | 1712.69000000 | 1592.16000000 |
RSyn0810M03M | 7323.3200 | 7569.2100 | 0.968 | 2712.25000000 | 2368.77000000 |
RSyn0810M04M | 7294.0800 | 7495.6000 | 0.973 | 6511.67000000 | 5433.33000000 |
RSyn0820M02M | 7354.5600 | 7627.2200 | 0.964 | 973.26200000 | 669.53700000 |
RSyn0820M03M | 7306.8100 | 7451.4200 | 0.981 | 1952.37000000 | 1439.77000000 |
RSyn0820M04M | 7273.8100 | 7396.6400 | 0.983 | 2347.74000000 | 1563.83000000 |
RSyn0840M02M | 7321.5600 | 8159.1100 | 0.897 | 636.57100000 | 191.12600000 |
RSyn0840M03M | 7282.9700 | 7609.5000 | 0.957 | 2643.92000000 | 2241.35000000 |
RSyn0840M04M | 7267.4400 | 7575.0000 | 0.959 | 2293.65000000 | 2301.43000000 |
RSyn0840M | 7448.0700 | 11688.7000 | 0.637 | 318.55500000 | 247.39700000 |
Syn40M02M | 7384.0100 | 8804.5400 | 0.839 | 360.41500000 | 344.48700000 |
Syn40M03M | 7331.7900 | 7548.5800 | 0.971 | 331.14400000 | 294.29000000 |
Syn40M04M | 7295.7900 | 7557.2600 | 0.965 | 808.85200000 | 831.89600000 |
sssd-16-8-3 | 7649.9500 | 13118.5000 | 0.583 | 616043.00000000 | 709652.00000000 |
sssd-18-8-3 | 7643.5000 | 12851.3000 | 0.595 | 524139.00000000 | 637320.00000000 |
sssd-20-9-3 | 7616.2900 | 11853.3000 | 0.643 | 478924.00000000 | 510261.00000000 |
sssd-22-8-3 | 7614.5400 | 12055.5000 | 0.632 | 596139.00000000 | 730203.00000000 |
nd-13 | 7237.1500 | 7251.3700 | 0.998 | 64.98350000 | 65.90790000 |
nd-15 | 7227.0400 | 7230.4100 | 1.000 | 83.33530000 | 86.92650000 |
nd-16 | 7227.7000 | 7227.5800 | 1.000 | 99.04390000 | 102.09800000 |
fo7_ar2_1 | 7489.7600 | 7545.5400 | 0.993 | 24.83980000 | 34.87130000 |
fo7_ar25_1 | 7485.8900 | 7414.1500 | 1.010 | 25.58910000 | 25.67840000 |
fo7_ar3_1 | 7504.2700 | 7413.0500 | 1.012 | 24.19550000 | 23.12100000 |
fo7_ar4_1 | 7491.1600 | 7368.0300 | 1.017 | 20.72980000 | 29.47550000 |
fo7 | 7510.0700 | 7431.2200 | 1.011 | 20.72980000 | 28.45230000 |
fo8_ar2_1 | 7456.9100 | 7498.4800 | 0.994 | 48.68170000 | 48.41990000 |
fo8_ar3_1 | 7454.6600 | 7329.2200 | 1.017 | 39.65250000 | 40.79120000 |
fo8_ar4_1 | 7459.2200 | 7294.2400 | 1.023 | 28.46650000 | 33.46530000 |
fo8_ar5_1 | 7462.5000 | 7299.6800 | 1.022 | 24.42260000 | 45.65780000 |
fo8 | 7478.3600 | 7381.7800 | 1.013 | 26.86260000 | 41.06960000 |
fo9 | 7445.8100 | 7344.6400 | 1.014 | 30.46430000 | 49.96150000 |
m7_ar3_1 | 7483.3400 | 7479.4900 | 1.001 | 143.58500000 | 143.58500000 |
m7_ar5_1 | 7487.6700 | 7336.1600 | 1.021 | 106.46000000 | 106.46000000 |
netmod_dol1 | 7250.5400 | 7214.8800 | 1.005 | -0.56000800 | -0.55139800 |
no7_ar2_1 | 7503.1200 | 7471.5700 | 1.004 | 125.58900000 | 151.86000000 |
no7_ar25_1 | 7492.9500 | 7380.7300 | 1.015 | 115.10000000 | 148.78600000 |
no7_ar3_1 | 7500.7900 | 7374.7100 | 1.017 | 117.22400000 | 134.42700000 |
no7_ar4_1 | 7496.5500 | 7367.5900 | 1.018 | 100.41900000 | 120.70100000 |
no7_ar5_1 | 7486.4200 | 7343.6400 | 1.019 | 90.62270000 | 118.38200000 |
o7_2 | 7514.5300 | 7409.9700 | 1.014 | 116.94600000 | 122.35300000 |
o7_ar2_1 | 7480.0300 | 7458.1000 | 1.003 | 153.24900000 | 177.94600000 |
o7_ar25_1 | 7497.6300 | 7424.6000 | 1.010 | 151.01400000 | 180.92200000 |
o7_ar3_1 | 7488.1600 | 7369.9300 | 1.016 | 146.09600000 | 163.97700000 |
o7_ar4_1 | 7482.3300 | 7346.2800 | 1.019 | 136.73100000 | 183.00000000 |
o7_ar5_1 | 7488.1200 | 7350.2000 | 1.019 | 118.76700000 | 129.23900000 |
o7 | 7521.1600 | 7424.4200 | 1.013 | 131.65300000 | 165.39600000 |
o8_ar4_1 | 7450.2100 | 7302.2300 | 1.020 | 298.51200000 | 304.80900000 |
tls4 | 7676.4700 | 15208.6000 | 0.505 | 8.30000000 | 13.70000000 |
BONMIN_bonmin-bb: feasible -- SBB_sbb: fail    
Back to top
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/SBB_sbb) | Obj (BONMIN_bonmin-bb) | Status (SBB_sbb) |
---|---|---|---|---|---|
FLay06M | 7661.7800 | 11788.9000 | --- | 66.93280000 | mstat(13)sstat( 1) |
BONMIN_bonmin-bb: fail -- SBB_sbb: feasible    
Back to top
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/SBB_sbb) | Status (BONMIN_bonmin-bb) | Obj (SBB_sbb) |
---|---|---|---|---|---|
Syn20M03M | 4346.9500 | 7954.4200 | --- | mstat(13)sstat( 1) | 2646.95000000 |
Syn20M04M | 12.8750 | 7781.6900 | --- | mstat(13)sstat( 1) | 3500.74000000 |
fo8_ar25_1 | 7466.7000 | 7372.1000 | --- | mstat(14)sstat( 3) | 41.63040000 |
fo9_ar5_1 | 7424.9100 | 7263.1100 | --- | mstat(14)sstat( 3) | 41.66030000 |
tls5 | 7597.7300 | 10552.2000 | --- | mstat(14)sstat( 3) | 15.60000000 |
tls6 | 7535.5100 | 9148.5200 | --- | mstat(14)sstat( 3) | 21.40000000 |
BONMIN_bonmin-bb: fail -- SBB_sbb: fail    
Back to top
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/SBB_sbb) | Status (BONMIN_bonmin-bb) | Status (SBB_sbb) |
---|---|---|---|---|---|
fo9_ar2_1 | 7427.4000 | 7424.3900 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
fo9_ar25_1 | 7422.6000 | 7375.1300 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
fo9_ar3_1 | 7423.6500 | 7292.3500 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
fo9_ar4_1 | 7424.4900 | 7268.4700 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
o9_ar4_1 | 7422.0700 | 7297.6900 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
tls12 | 7370.2300 | 7667.1300 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
tls7 | 7489.1300 | 8474.5600 | --- | mstat(14)sstat( 3) | mstat(14)sstat( 3) |
BONMIN_bonmin-bb: optimal:
Modelname | Time (BONMIN_bonmin-bb) | Obj (BONMIN_bonmin-bb) |
---|---|---|
BatchS101006M | 18.3460 | 769440.00000000 |
BatchS121208M | 37.3690 | 1241130.00000000 |
BatchS151208M | 110.9250 | 1543470.00000000 |
BatchS201210M | 144.9750 | 2295350.00000000 |
clay0203h | 6.8740 | 41573.30000000 |
clay0203m | 4.2890 | 41573.30000000 |
clay0204h | 52.7820 | 6545.00000000 |
clay0204m | 9.1500 | 6545.00000000 |
clay0205h | 1775.5400 | 8092.50000000 |
clay0205m | 708.5470 | 8092.50000000 |
clay0303h | 18.6050 | 26669.10000000 |
clay0303m | 5.5580 | 26669.10000000 |
clay0304h | 208.0350 | 40262.40000000 |
clay0304m | 61.5350 | 40262.40000000 |
clay0305h | 1662.5000 | 8092.50000000 |
clay0305m | 250.6350 | 8092.50000000 |
FLay03H | 2.2550 | 48.98980000 |
FLay03M | 0.8650 | 48.98980000 |
FLay04H | 38.9700 | 54.40590000 |
FLay04M | 12.8400 | 54.40590000 |
FLay05H | 3506.4800 | 64.49810000 |
FLay05M | 617.4280 | 64.49810000 |
RSyn0810H | 3.0840 | 1721.45000000 |
RSyn0810M02H | 18.2470 | 1741.39000000 |
RSyn0810M03H | 53.8100 | 2722.45000000 |
RSyn0810M04H | 30.9780 | 6581.94000000 |
RSyn0810M | 450.3500 | 1721.45000000 |
RSyn0820H | 5.5110 | 1150.30000000 |
RSyn0820M02H | 22.9370 | 1092.09000000 |
RSyn0820M03H | 75.2470 | 2028.81000000 |
RSyn0820M04H | 91.3950 | 2450.77000000 |
RSyn0820M | 3363.6400 | 1150.30000000 |
RSyn0840H | 3.7300 | 325.55500000 |
RSyn0840M02H | 23.3200 | 734.98400000 |
RSyn0840M03H | 66.9090 | 2742.65000000 |
RSyn0840M04H | 240.4630 | 2564.50000000 |
SLay05H | 4.4500 | 22664.70000000 |
SLay05M | 2.5770 | 22664.70000000 |
SLay06H | 54.5440 | 32757.00000000 |
SLay06M | 27.4070 | 32757.00000000 |
SLay07H | 67.9740 | 64748.80000000 |
SLay07M | 66.4610 | 64748.80000000 |
SLay08H | 69.2590 | 84960.20000000 |
SLay08M | 67.5310 | 84960.20000000 |
SLay09H | 79.2830 | 107806.00000000 |
SLay09M | 69.8780 | 107806.00000000 |
SLay10H | 336.6470 | 129580.00000000 |
SLay10M | 144.9750 | 129580.00000000 |
Syn10H | 0.3520 | 1267.35000000 |
Syn10M02H | 0.3180 | 2310.30000000 |
Syn10M02M | 4.5530 | 2310.30000000 |
Syn10M03H | 0.7190 | 3354.68000000 |
Syn10M03M | 19.6690 | 3354.68000000 |
Syn10M04H | 1.0620 | 4557.06000000 |
Syn10M04M | 56.4720 | 4557.06000000 |
Syn10M | 0.6270 | 1267.35000000 |
Syn20H | 0.4150 | 924.26300000 |
Syn20M02H | 2.2460 | 1752.13000000 |
Syn20M02M | 458.7050 | 1752.13000000 |
Syn20M03H | 4.2170 | 2646.95000000 |
Syn20M04H | 7.6110 | 3532.74000000 |
Syn20M | 4.8100 | 924.26300000 |
Syn40H | 1.5330 | 67.71340000 |
Syn40M02H | 3.5190 | 388.77300000 |
Syn40M03H | 17.1110 | 395.14900000 |
Syn40M04H | 53.4430 | 901.75200000 |
Syn40M | 973.0320 | 67.71330000 |
sssd-8-4-3 | 9.6910 | 197181.00000000 |
sssd-10-4-3 | 12.5650 | 152710.00000000 |
sssd-12-5-3 | 52.5360 | 261143.00000000 |
sssd-15-6-3 | 231.9490 | 440711.00000000 |
uflquad-15-60 | 12.4560 | 1063.19000000 |
uflquad-15-80 | 22.6090 | 1217.99000000 |
uflquad-20-40 | 17.2550 | 860.96100000 |
uflquad-20-50 | 225.1360 | 375.91900000 |
uflquad-25-25 | 10.5160 | 673.69700000 |
uflquad-25-30 | 12.5240 | 669.84000000 |
uflquad-25-40 | 23.3470 | 828.16500000 |
nd-10 | 1189.2800 | 52.46110000 |
fo7_2 | 2031.2700 | 17.74930000 |
fo7_ar5_1 | 4544.9200 | 17.74930000 |
m3 | 1.3530 | 37.80000000 |
m6 | 46.2730 | 82.25690000 |
m7_ar2_1 | 2569.7700 | 190.23500000 |
m7_ar25_1 | 166.4970 | 143.58500000 |
m7 | 507.3050 | 106.75700000 |
netmod_dol2 | 1936.8100 | -0.56000800 |
netmod_kar1 | 15.0230 | -0.41979000 |
netmod_kar2 | 15.0430 | -0.41979000 |
tls2 | 5.9730 | 5.30000000 |
BONMIN_bonmin-bb: feasible:
Modelname | Time (BONMIN_bonmin-bb) | Obj (BONMIN_bonmin-bb) |
---|---|---|
FLay06H | 7394.3800 | 66.93280000 |
FLay06M | 7661.7800 | 66.93280000 |
RSyn0810M02M | 7375.6600 | 1712.69000000 |
RSyn0810M03M | 7323.3200 | 2712.25000000 |
RSyn0810M04M | 7294.0800 | 6511.67000000 |
RSyn0820M02M | 7354.5600 | 973.26200000 |
RSyn0820M03M | 7306.8100 | 1952.37000000 |
RSyn0820M04M | 7273.8100 | 2347.74000000 |
RSyn0840M02M | 7321.5600 | 636.57100000 |
RSyn0840M03M | 7282.9700 | 2643.92000000 |
RSyn0840M04M | 7267.4400 | 2293.65000000 |
RSyn0840M | 7448.0700 | 318.55500000 |
Syn40M02M | 7384.0100 | 360.41500000 |
Syn40M03M | 7331.7900 | 331.14400000 |
Syn40M04M | 7295.7900 | 808.85200000 |
sssd-16-8-3 | 7649.9500 | 616043.00000000 |
sssd-18-8-3 | 7643.5000 | 524139.00000000 |
sssd-20-9-3 | 7616.2900 | 478924.00000000 |
sssd-22-8-3 | 7614.5400 | 596139.00000000 |
nd-12 | 7239.3100 | 58.30360000 |
nd-13 | 7237.1500 | 64.98350000 |
nd-15 | 7227.0400 | 83.33530000 |
nd-16 | 7227.7000 | 99.04390000 |
fo7_ar2_1 | 7489.7600 | 24.83980000 |
fo7_ar25_1 | 7485.8900 | 25.58910000 |
fo7_ar3_1 | 7504.2700 | 24.19550000 |
fo7_ar4_1 | 7491.1600 | 20.72980000 |
fo7 | 7510.0700 | 20.72980000 |
fo8_ar2_1 | 7456.9100 | 48.68170000 |
fo8_ar3_1 | 7454.6600 | 39.65250000 |
fo8_ar4_1 | 7459.2200 | 28.46650000 |
fo8_ar5_1 | 7462.5000 | 24.42260000 |
fo8 | 7478.3600 | 26.86260000 |
fo9 | 7445.8100 | 30.46430000 |
m7_ar3_1 | 7483.3400 | 143.58500000 |
m7_ar4_1 | 7488.2500 | 148.62000000 |
m7_ar5_1 | 7487.6700 | 106.46000000 |
netmod_dol1 | 7250.5400 | -0.56000800 |
no7_ar2_1 | 7503.1200 | 125.58900000 |
no7_ar25_1 | 7492.9500 | 115.10000000 |
no7_ar3_1 | 7500.7900 | 117.22400000 |
no7_ar4_1 | 7496.5500 | 100.41900000 |
no7_ar5_1 | 7486.4200 | 90.62270000 |
o7_2 | 7514.5300 | 116.94600000 |
o7_ar2_1 | 7480.0300 | 153.24900000 |
o7_ar25_1 | 7497.6300 | 151.01400000 |
o7_ar3_1 | 7488.1600 | 146.09600000 |
o7_ar4_1 | 7482.3300 | 136.73100000 |
o7_ar5_1 | 7488.1200 | 118.76700000 |
o7 | 7521.1600 | 131.65300000 |
o8_ar4_1 | 7450.2100 | 298.51200000 |
tls4 | 7676.4700 | 8.30000000 |
BONMIN_bonmin-bb: fail:
Modelname | Time (BONMIN_bonmin-bb) | Status (BONMIN_bonmin-bb) |
---|---|---|
Syn20M03M | -- | mstat(13) sstat( 1) |
Syn20M04M | -- | mstat(13) sstat( 1) |
fo8_ar25_1 | -- | mstat(14) sstat( 3) |
fo9_ar2_1 | -- | mstat(14) sstat( 3) |
fo9_ar25_1 | -- | mstat(14) sstat( 3) |
fo9_ar3_1 | -- | mstat(14) sstat( 3) |
fo9_ar4_1 | -- | mstat(14) sstat( 3) |
fo9_ar5_1 | -- | mstat(14) sstat( 3) |
o9_ar4_1 | -- | mstat(14) sstat( 3) |
tls12 | -- | mstat(14) sstat( 3) |
tls5 | -- | mstat(14) sstat( 3) |
tls6 | -- | mstat(14) sstat( 3) |
tls7 | -- | mstat(14) sstat( 3) |
SBB_sbb: optimal:
Modelname | Time (SBB_sbb) | Obj (SBB_sbb) |
---|---|---|
BatchS101006M | 81.6070 | 769440.00000000 |
BatchS121208M | 99.3970 | 1241130.00000000 |
BatchS151208M | 123.5030 | 1543470.00000000 |
BatchS201210M | 517.8210 | 2295350.00000000 |
clay0203h | 3.9370 | 41573.30000000 |
clay0203m | 1.8450 | 41573.30000000 |
clay0204h | 43.6850 | 6545.00000000 |
clay0204m | 10.9330 | 6545.00000000 |
clay0205h | 688.0400 | 8092.50000000 |
clay0205m | 231.4940 | 8092.50000000 |
clay0303h | 6.9610 | 26669.10000000 |
clay0304h | 510.2070 | 40262.40000000 |
clay0304m | 94.4630 | 40262.40000000 |
clay0305h | 1521.9900 | 8092.50000000 |
clay0305m | 186.2620 | 8092.50000000 |
FLay03H | 1.0190 | 48.98980000 |
FLay03M | 0.6440 | 48.98980000 |
FLay04H | 25.2120 | 54.40590000 |
FLay04M | 10.0850 | 54.40590000 |
FLay05M | 504.3070 | 64.49810000 |
RSyn0810H | 2.9460 | 1721.45000000 |
RSyn0810M02H | 20.7120 | 1741.39000000 |
RSyn0810M03H | 106.6050 | 2722.45000000 |
RSyn0810M04H | 30.6420 | 6581.94000000 |
RSyn0810M | 788.8410 | 1721.45000000 |
RSyn0820H | 4.6940 | 1150.30000000 |
RSyn0820M02H | 58.5700 | 1092.09000000 |
RSyn0820M03H | 514.5710 | 2028.81000000 |
RSyn0820M04H | 427.0530 | 2450.77000000 |
RSyn0820M | 7190.5900 | 1150.30000000 |
RSyn0840H | 2.1890 | 325.55500000 |
RSyn0840M02H | 18.9290 | 734.98400000 |
RSyn0840M03H | 113.8710 | 2742.65000000 |
RSyn0840M04H | 740.9130 | 2564.50000000 |
SLay05H | 22.2240 | 22664.70000000 |
SLay05M | 2.3020 | 22664.70000000 |
SLay06H | 387.8510 | 32757.00000000 |
SLay06M | 1.1210 | 32757.00000000 |
SLay07M | 13.6680 | 64748.80000000 |
SLay08M | 4.8160 | 84960.20000000 |
SLay09M | 330.1600 | 107806.00000000 |
SLay10M | 538.4240 | 129580.00000000 |
Syn10H | 0.1120 | 1267.35000000 |
Syn10M02H | 0.2850 | 2310.30000000 |
Syn10M02M | 3.3410 | 2310.30000000 |
Syn10M03H | 0.4480 | 3354.68000000 |
Syn10M03M | 13.2780 | 3354.68000000 |
Syn10M04H | 0.5910 | 4557.06000000 |
Syn10M04M | 58.3070 | 4557.06000000 |
Syn10M | 0.2170 | 1267.35000000 |
Syn20H | 0.2040 | 924.26300000 |
Syn20M02H | 0.9990 | 1752.13000000 |
Syn20M02M | 819.5300 | 1752.13000000 |
Syn20M03H | 1.1720 | 2646.95000000 |
Syn20M04H | 1.7440 | 3532.74000000 |
Syn20M | 3.3160 | 924.26300000 |
Syn40H | 0.8680 | 67.71340000 |
Syn40M02H | 3.8970 | 388.77300000 |
Syn40M03H | 16.2270 | 395.14900000 |
Syn40M04H | 60.9210 | 901.75200000 |
sssd-8-4-3 | 931.0760 | 197181.00000000 |
uflquad-15-60 | 15.8290 | 1063.19000000 |
uflquad-15-80 | 37.1940 | 1217.99000000 |
uflquad-20-40 | 19.0030 | 860.96100000 |
uflquad-20-50 | 1623.3800 | 375.91900000 |
uflquad-25-25 | 5.7650 | 673.69700000 |
uflquad-25-30 | 4.6730 | 669.84000000 |
uflquad-25-40 | 27.5040 | 828.16500000 |
nd-10 | 472.2360 | 52.46110000 |
nd-12 | 2721.8200 | 56.66960000 |
m3 | 0.4660 | 37.80000000 |
m6 | 1321.2900 | 82.25690000 |
m7_ar2_1 | 2283.0700 | 190.23500000 |
m7_ar25_1 | 4391.6700 | 143.58500000 |
m7_ar4_1 | 7134.8100 | 106.75700000 |
netmod_kar1 | 204.3500 | -0.41979000 |
netmod_kar2 | 202.6730 | -0.41979000 |
tls2 | 4.2320 | 5.30000000 |
SBB_sbb: feasible:
Modelname | Time (SBB_sbb) | Obj (SBB_sbb) |
---|---|---|
FLay06H | 7451.7700 | 66.93280000 |
RSyn0810M02M | 8679.9900 | 1592.16000000 |
RSyn0810M03M | 7569.2100 | 2368.77000000 |
RSyn0810M04M | 7495.6000 | 5433.33000000 |
RSyn0820M02M | 7627.2200 | 669.53700000 |
RSyn0820M03M | 7451.4200 | 1439.77000000 |
RSyn0820M04M | 7396.6400 | 1563.83000000 |
RSyn0840M02M | 8159.1100 | 191.12600000 |
RSyn0840M03M | 7609.5000 | 2241.35000000 |
RSyn0840M04M | 7575.0000 | 2301.43000000 |
RSyn0840M | 11688.7000 | 247.39700000 |
SLay07H | 7383.1600 | 64748.80000000 |
SLay08H | 7413.2200 | 85115.00000000 |
SLay09H | 7412.7900 | 122507.00000000 |
SLay10H | 7356.2200 | 153256.00000000 |
Syn20M03M | 7954.4200 | 2646.95000000 |
Syn20M04M | 7781.6900 | 3500.74000000 |
Syn40M02M | 8804.5400 | 344.48700000 |
Syn40M03M | 7548.5800 | 294.29000000 |
Syn40M04M | 7557.2600 | 831.89600000 |
Syn40M | 10415.2000 | 67.71330000 |
sssd-10-4-3 | 12944.6000 | 159329.00000000 |
sssd-12-5-3 | 19374.5000 | 330320.00000000 |
sssd-15-6-3 | 15779.7000 | 513871.00000000 |
sssd-16-8-3 | 13118.5000 | 709652.00000000 |
sssd-18-8-3 | 12851.3000 | 637320.00000000 |
sssd-20-9-3 | 11853.3000 | 510261.00000000 |
sssd-22-8-3 | 12055.5000 | 730203.00000000 |
nd-13 | 7251.3700 | 65.90790000 |
nd-15 | 7230.4100 | 86.92650000 |
nd-16 | 7227.5800 | 102.09800000 |
fo7_2 | 7403.9100 | 17.74930000 |
fo7_ar2_1 | 7545.5400 | 34.87130000 |
fo7_ar25_1 | 7414.1500 | 25.67840000 |
fo7_ar3_1 | 7413.0500 | 23.12100000 |
fo7_ar4_1 | 7368.0300 | 29.47550000 |
fo7_ar5_1 | 7340.0900 | 19.01200000 |
fo7 | 7431.2200 | 28.45230000 |
fo8_ar2_1 | 7498.4800 | 48.41990000 |
fo8_ar25_1 | 7372.1000 | 41.63040000 |
fo8_ar3_1 | 7329.2200 | 40.79120000 |
fo8_ar4_1 | 7294.2400 | 33.46530000 |
fo8_ar5_1 | 7299.6800 | 45.65780000 |
fo8 | 7381.7800 | 41.06960000 |
fo9_ar5_1 | 7263.1100 | 41.66030000 |
fo9 | 7344.6400 | 49.96150000 |
m7_ar3_1 | 7479.4900 | 143.58500000 |
m7_ar5_1 | 7336.1600 | 106.46000000 |
m7 | 7448.1800 | 106.75700000 |
netmod_dol1 | 7214.8800 | -0.55139800 |
no7_ar2_1 | 7471.5700 | 151.86000000 |
no7_ar25_1 | 7380.7300 | 148.78600000 |
no7_ar3_1 | 7374.7100 | 134.42700000 |
no7_ar4_1 | 7367.5900 | 120.70100000 |
no7_ar5_1 | 7343.6400 | 118.38200000 |
o7_2 | 7409.9700 | 122.35300000 |
o7_ar2_1 | 7458.1000 | 177.94600000 |
o7_ar25_1 | 7424.6000 | 180.92200000 |
o7_ar3_1 | 7369.9300 | 163.97700000 |
o7_ar4_1 | 7346.2800 | 183.00000000 |
o7_ar5_1 | 7350.2000 | 129.23900000 |
o7 | 7424.4200 | 165.39600000 |
o8_ar4_1 | 7302.2300 | 304.80900000 |
tls4 | 15208.6000 | 13.70000000 |
tls5 | 10552.2000 | 15.60000000 |
tls6 | 9148.5200 | 21.40000000 |
SBB_sbb: fail:
Modelname | Time (SBB_sbb) | Status (SBB_sbb) |
---|---|---|
clay0303m | -- | mstat(13)sstat( 1) |
FLay05H | -- | mstat(13)sstat( 1) |
FLay06M | -- | mstat(13)sstat( 1) |
fo9_ar2_1 | -- | mstat(14)sstat( 3) |
fo9_ar25_1 | -- | mstat(14)sstat( 3) |
fo9_ar3_1 | -- | mstat(14)sstat( 3) |
fo9_ar4_1 | -- | mstat(14)sstat( 3) |
netmod_dol2 | -- | mstat(13)sstat(13) |
o9_ar4_1 | -- | mstat(14)sstat( 3) |
tls12 | -- | mstat(14)sstat( 3) |
tls7 | -- | mstat(14)sstat( 3) |
BONMIN_bonmin-bb: all -- SBB_sbb: all
Back to topA "(max)" behind a model names indicates that this model is a maximization model.
Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.
A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (19374.50 seconds). The shift is 10s.
Modelname | Time (BONMIN_bonmin-bb) | Time (SBB_sbb) | Ratio (BONMIN_bonmin-bb/ SBB_sbb) | Obj (BONMIN_bonmin-bb) | Obj (SBB_sbb) | ObjEst (BONMIN_bonmin-bb) | ObjEst (SBB_sbb) | Gap (BONMIN_bonmin-bb) | Gap (SBB_sbb) |
BatchS101006M | 18.3460 | 81.6070 | 0.225 | 769440.00000000 | 769440.00000000 | 769440.00000000 | 769440.00000000 | 0.0000 | 0.0000 |
BatchS121208M | 37.3690 | 99.3970 | 0.376 | 1241130.00000000 | 1241130.00000000 | 1241130.00000000 | 1241130.00000000 | 0.0000 | 0.0000 |
BatchS151208M | 110.9250 | 123.5030 | 0.898 | 1543470.00000000 | 1543470.00000000 | 1543470.00000000 | 1543470.00000000 | 0.0000 | 0.0000 |
BatchS201210M | 144.9750 | 517.8210 | 0.280 | 2295350.00000000 | 2295350.00000000 | 2295350.00000000 | 2295350.00000000 | 0.0000 | 0.0000 |
clay0203h | 6.8740 | 3.9370 | 1.746 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 0.0000 | 0.0000 |
clay0203m | 4.2890 | 1.8450 | 2.325 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 41573.30000000 | 0.0000 | 0.0000 |
clay0204h | 52.7820 | 43.6850 | 1.208 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 0.0000 | 0.0000 |
clay0204m | 9.1500 | 10.9330 | 0.837 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 6545.00000000 | 0.0000 | 0.0000 |
clay0205h | 1775.5400 | 688.0400 | 2.581 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
clay0205m | 708.5470 | 231.4940 | 3.061 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
clay0303h | 18.6050 | 6.9610 | 2.673 | 26669.10000000 | 26669.10000000 | 26669.10000000 | 26669.10000000 | 0.0000 | 0.0000 |
clay0303m | 5.5580 | 1.7160 | --- | 26669.10000000 | mstat(13) sstat(1) | 26669.10000000 | --- | 0.0000 | --- |
clay0304h | 208.0350 | 510.2070 | 0.408 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 0.0000 | 0.0000 |
clay0304m | 61.5350 | 94.4630 | 0.651 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 40262.40000000 | 0.0000 | 0.0000 |
clay0305h | 1662.5000 | 1521.9900 | 1.092 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
clay0305m | 250.6350 | 186.2620 | 1.346 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 8092.50000000 | 0.0000 | 0.0000 |
FLay03H | 2.2550 | 1.0190 | 2.213 | 48.98980000 | 48.98980000 | 48.98980000 | 48.98980000 | 0.0000 | 0.0000 |
FLay03M | 0.8650 | 0.6440 | 1.343 | 48.98980000 | 48.98980000 | 48.98980000 | 48.98980000 | 0.0000 | 0.0000 |
FLay04H | 38.9700 | 25.2120 | 1.546 | 54.40590000 | 54.40590000 | 54.40590000 | 54.40590000 | 0.0000 | 0.0000 |
FLay04M | 12.8400 | 10.0850 | 1.273 | 54.40590000 | 54.40590000 | 54.40590000 | 54.40590000 | 0.0000 | 0.0000 |
FLay05H | 3506.4800 | 2611.9300 | --- | 64.49810000 | mstat(13) sstat(1) | 64.49810000 | --- | 0.0000 | --- |
FLay05M | 617.4280 | 504.3070 | 1.224 | 64.49810000 | 64.49810000 | 64.49810000 | 64.49810000 | 0.0000 | 0.0000 |
FLay06H | 7394.3800 | 7451.7700 | 0.992 | 66.93280000 | 66.93280000 | 60.00000000 | 51.70410000 | 0.1155 | 0.2945 |
FLay06M | 7661.7800 | 11788.9000 | --- | 66.93280000 | mstat(13) sstat(1) | 64.49810000 | --- | 0.0377 | --- |
RSyn0810H (max) | 3.0840 | 2.9460 | 1.047 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 0.0000 | 0.0000 |
RSyn0810M02H (max) | 18.2470 | 20.7120 | 0.881 | 1741.39000000 | 1741.39000000 | 1741.39000000 | 1741.39000000 | 0.0000 | 0.0000 |
RSyn0810M02M (max) | 7375.6600 | 8679.9900 | 0.850 | 1712.69000000 | 1592.16000000 | 2660.89000000 | 3137.64000000 | 0.3563 | 0.4926 |
RSyn0810M03H (max) | 53.8100 | 106.6050 | 0.505 | 2722.45000000 | 2722.45000000 | 2722.45000000 | 2722.45000000 | 0.0000 | 0.0000 |
RSyn0810M03M (max) | 7323.3200 | 7569.2100 | 0.968 | 2712.25000000 | 2368.77000000 | 3758.91000000 | 5509.95000000 | 0.2784 | 0.5701 |
RSyn0810M04H (max) | 30.9780 | 30.6420 | 1.011 | 6581.94000000 | 6581.94000000 | 6581.94000000 | 6581.94000000 | 0.0000 | 0.0000 |
RSyn0810M04M (max) | 7294.0800 | 7495.6000 | 0.973 | 6511.67000000 | 5433.33000000 | 8852.77000000 | 10821.10000000 | 0.2644 | 0.4979 |
RSyn0810M (max) | 450.3500 | 788.8410 | 0.571 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 1721.45000000 | 0.0000 | 0.0000 |
RSyn0820H (max) | 5.5110 | 4.6940 | 1.174 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 0.0000 | 0.0000 |
RSyn0820M02H (max) | 22.9370 | 58.5700 | 0.392 | 1092.09000000 | 1092.09000000 | 1092.09000000 | 1092.09000000 | 0.0000 | 0.0000 |
RSyn0820M02M (max) | 7354.5600 | 7627.2200 | 0.964 | 973.26200000 | 669.53700000 | 2383.29000000 | 4051.07000000 | 0.5916 | 0.8347 |
RSyn0820M03H (max) | 75.2470 | 514.5710 | 0.146 | 2028.81000000 | 2028.81000000 | 2028.81000000 | 2028.81000000 | 0.0000 | 0.0000 |
RSyn0820M03M (max) | 7306.8100 | 7451.4200 | 0.981 | 1952.37000000 | 1439.77000000 | 4591.76000000 | 5861.88000000 | 0.5748 | 0.7544 |
RSyn0820M04H (max) | 91.3950 | 427.0530 | 0.214 | 2450.77000000 | 2450.77000000 | 2450.77000000 | 2450.77000000 | 0.0000 | 0.0000 |
RSyn0820M04M (max) | 7273.8100 | 7396.6400 | 0.983 | 2347.74000000 | 1563.83000000 | 6735.90000000 | 8372.19000000 | 0.6515 | 0.8132 |
RSyn0820M (max) | 3363.6400 | 7190.5900 | 0.468 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 1150.30000000 | 0.0000 | 0.0000 |
RSyn0840H (max) | 3.7300 | 2.1890 | 1.704 | 325.55500000 | 325.55500000 | 325.55500000 | 325.55500000 | 0.0000 | 0.0000 |
RSyn0840M02H (max) | 23.3200 | 18.9290 | 1.232 | 734.98400000 | 734.98400000 | 734.98400000 | 734.98400000 | 0.0000 | 0.0000 |
RSyn0840M02M (max) | 7321.5600 | 8159.1100 | 0.897 | 636.57100000 | 191.12600000 | 3524.62000000 | 4639.90000000 | 0.8194 | 0.9588 |
RSyn0840M03H (max) | 66.9090 | 113.8710 | 0.588 | 2742.65000000 | 2742.65000000 | 2742.65000000 | 2742.65000000 | 0.0000 | 0.0000 |
RSyn0840M03M (max) | 7282.9700 | 7609.5000 | 0.957 | 2643.92000000 | 2241.35000000 | 6439.72000000 | 7850.66000000 | 0.5894 | 0.7145 |
RSyn0840M04H (max) | 240.4630 | 740.9130 | 0.325 | 2564.50000000 | 2564.50000000 | 2564.50000000 | 2564.50000000 | 0.0000 | 0.0000 |
RSyn0840M04M (max) | 7267.4400 | 7575.0000 | 0.959 | 2293.65000000 | 2301.43000000 | 10426.00000000 | 12846.10000000 | 0.7800 | 0.8208 |
RSyn0840M (max) | 7448.0700 | 11688.7000 | 0.637 | 318.55500000 | 247.39700000 | 628.57700000 | 1497.16000000 | 0.4932 | 0.8348 |
SLay05H | 4.4500 | 22.2240 | 0.200 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 0.0000 | 0.0000 |
SLay05M | 2.5770 | 2.3020 | 1.119 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 22664.70000000 | 0.0000 | 0.0000 |
SLay06H | 54.5440 | 387.8510 | 0.141 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 0.0000 | 0.0000 |
SLay06M | 27.4070 | 1.1210 | 24.449 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 32757.00000000 | 0.0000 | 0.0000 |
SLay07H | 67.9740 | 7383.1600 | 0.009 | 64748.80000000 | 64748.80000000 | 64748.80000000 | 64698.40000000 | 0.0000 | 0.0008 |
SLay07M | 66.4610 | 13.6680 | 4.863 | 64748.80000000 | 64748.80000000 | 64748.80000000 | 64748.80000000 | 0.0000 | 0.0000 |
SLay08H | 69.2590 | 7413.2200 | 0.009 | 84960.20000000 | 85115.00000000 | 84960.20000000 | 82023.90000000 | 0.0000 | 0.0377 |
SLay08M | 67.5310 | 4.8160 | 14.022 | 84960.20000000 | 84960.20000000 | 84960.20000000 | 84960.20000000 | 0.0000 | 0.0000 |
SLay09H | 79.2830 | 7412.7900 | 0.011 | 107806.00000000 | 122507.00000000 | 107806.00000000 | 103264.00000000 | 0.0000 | 0.1863 |
SLay09M | 69.8780 | 330.1600 | 0.212 | 107806.00000000 | 107806.00000000 | 107806.00000000 | 107806.00000000 | 0.0000 | 0.0000 |
SLay10H | 336.6470 | 7356.2200 | 0.046 | 129580.00000000 | 153256.00000000 | 129580.00000000 | 119326.00000000 | 0.0000 | 0.2843 |
SLay10M | 144.9750 | 538.4240 | 0.269 | 129580.00000000 | 129580.00000000 | 129580.00000000 | 129580.00000000 | 0.0000 | 0.0000 |
Syn10H (max) | 0.3520 | 0.1120 | 3.143 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 0.0000 | 0.0000 |
Syn10M02H (max) | 0.3180 | 0.2850 | 1.116 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 0.0000 | 0.0000 |
Syn10M02M (max) | 4.5530 | 3.3410 | 1.363 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 2310.30000000 | 0.0000 | 0.0000 |
Syn10M03H (max) | 0.7190 | 0.4480 | 1.605 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 0.0000 | 0.0000 |
Syn10M03M (max) | 19.6690 | 13.2780 | 1.481 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 3354.68000000 | 0.0000 | 0.0000 |
Syn10M04H (max) | 1.0620 | 0.5910 | 1.797 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 0.0000 | 0.0000 |
Syn10M04M (max) | 56.4720 | 58.3070 | 0.969 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 4557.06000000 | 0.0000 | 0.0000 |
Syn10M (max) | 0.6270 | 0.2170 | 2.889 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 1267.35000000 | 0.0000 | 0.0000 |
Syn20H (max) | 0.4150 | 0.2040 | 2.034 | 924.26300000 | 924.26300000 | 924.26300000 | 924.26300000 | 0.0000 | 0.0000 |
Syn20M02H (max) | 2.2460 | 0.9990 | 2.248 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 0.0000 | 0.0000 |
Syn20M02M (max) | 458.7050 | 819.5300 | 0.560 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 1752.13000000 | 0.0000 | 0.0000 |
Syn20M03H (max) | 4.2170 | 1.1720 | 3.598 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 2646.95000000 | 0.0000 | 0.0000 |
Syn20M03M (max) | 4346.9500 | 7954.4200 | --- | mstat(13) sstat(1) | 2646.95000000 | --- | 2658.98000000 | --- | 0.0045 |
Syn20M04H (max) | 7.6110 | 1.7440 | 4.364 | 3532.74000000 | 3532.74000000 | 3532.74000000 | 3532.74000000 | 0.0000 | 0.0000 |
Syn20M04M (max) | 12.8750 | 7781.6900 | --- | mstat(13) sstat(1) | 3500.74000000 | --- | 4698.66000000 | --- | 0.2549 |
Syn20M (max) | 4.8100 | 3.3160 | 1.451 | 924.26300000 | 924.26300000 | 924.26300000 | 924.26300000 | 0.0000 | 0.0000 |
Syn40H (max) | 1.5330 | 0.8680 | 1.766 | 67.71340000 | 67.71340000 | 67.71340000 | 67.71340000 | 0.0000 | 0.0000 |
Syn40M02H (max) | 3.5190 | 3.8970 | 0.903 | 388.77300000 | 388.77300000 | 388.77300000 | 388.77300000 | 0.0000 | 0.0000 |
Syn40M02M (max) | 7384.0100 | 8804.5400 | 0.839 | 360.41500000 | 344.48700000 | 838.70100000 | 1726.45000000 | 0.5703 | 0.8005 |
Syn40M03H (max) | 17.1110 | 16.2270 | 1.054 | 395.14900000 | 395.14900000 | 395.14900000 | 395.14900000 | 0.0000 | 0.0000 |
Syn40M03M (max) | 7331.7900 | 7548.5800 | 0.971 | 331.14400000 | 294.29000000 | 2046.18000000 | 4342.80000000 | 0.8382 | 0.9322 |
Syn40M04H (max) | 53.4430 | 60.9210 | 0.877 | 901.75200000 | 901.75200000 | 901.75200000 | 901.75200000 | 0.0000 | 0.0000 |
Syn40M04M (max) | 7295.7900 | 7557.2600 | 0.965 | 808.85200000 | 831.89600000 | 3468.91000000 | 5965.61000000 | 0.7668 | 0.8606 |
Syn40M (max) | 973.0320 | 10415.2000 | 0.093 | 67.71330000 | 67.71330000 | 67.71330000 | 257.14600000 | 0.0000 | 0.7367 |
sssd-8-4-3 | 9.6910 | 931.0760 | 0.010 | 197181.00000000 | 197181.00000000 | 197181.00000000 | 197181.00000000 | 0.0000 | 0.0000 |
sssd-10-4-3 | 12.5650 | 12944.6000 | 0.001 | 152710.00000000 | 159329.00000000 | 152710.00000000 | 143244.00000000 | 0.0000 | 0.1123 |
sssd-12-5-3 | 52.5360 | 19374.5000 | 0.003 | 261143.00000000 | 330320.00000000 | 261143.00000000 | 101530.00000000 | 0.0000 | 2.2534 |
sssd-15-6-3 | 231.9490 | 15779.7000 | 0.015 | 440711.00000000 | 513871.00000000 | 440711.00000000 | 155381.00000000 | 0.0000 | 2.3072 |
sssd-16-8-3 | 7649.9500 | 13118.5000 | 0.583 | 616043.00000000 | 709652.00000000 | 615229.00000000 | 223552.00000000 | 0.0013 | 2.1744 |
sssd-18-8-3 | 7643.5000 | 12851.3000 | 0.595 | 524139.00000000 | 637320.00000000 | 523745.00000000 | 192178.00000000 | 0.0008 | 2.3163 |
sssd-20-9-3 | 7616.2900 | 11853.3000 | 0.643 | 478924.00000000 | 510261.00000000 | 477253.00000000 | 180409.00000000 | 0.0035 | 1.8284 |
sssd-22-8-3 | 7614.5400 | 12055.5000 | 0.632 | 596139.00000000 | 730203.00000000 | 595726.00000000 | 216626.00000000 | 0.0007 | 2.3708 |
uflquad-15-60 | 12.4560 | 15.8290 | 0.787 | 1063.19000000 | 1063.19000000 | 1063.19000000 | 1063.19000000 | 0.0000 | 0.0000 |
uflquad-15-80 | 22.6090 | 37.1940 | 0.608 | 1217.99000000 | 1217.99000000 | 1217.99000000 | 1217.99000000 | 0.0000 | 0.0000 |
uflquad-20-40 | 17.2550 | 19.0030 | 0.908 | 860.96100000 | 860.96100000 | 860.96100000 | 860.96100000 | 0.0000 | 0.0000 |
uflquad-20-50 | 225.1360 | 1623.3800 | 0.139 | 375.91900000 | 375.91900000 | 375.91900000 | 375.91900000 | 0.0000 | 0.0000 |
uflquad-25-25 | 10.5160 | 5.7650 | 1.824 | 673.69700000 | 673.69700000 | 673.69700000 | 673.69700000 | 0.0000 | 0.0000 |
uflquad-25-30 | 12.5240 | 4.6730 | 2.680 | 669.84000000 | 669.84000000 | 669.84000000 | 669.84000000 | 0.0000 | 0.0000 |
uflquad-25-40 | 23.3470 | 27.5040 | 0.849 | 828.16500000 | 828.16500000 | 828.16500000 | 828.16500000 | 0.0000 | 0.0000 |
nd-10 | 1189.2800 | 472.2360 | 2.518 | 52.46110000 | 52.46110000 | 52.46110000 | 52.46110000 | 0.0000 | 0.0000 |
nd-12 | 7239.3100 | 2721.8200 | 2.660 | 58.30360000 | 56.66960000 | 54.74920000 | 56.66960000 | 0.0649 | 0.0000 |
nd-13 | 7237.1500 | 7251.3700 | 0.998 | 64.98350000 | 65.90790000 | 50.34500000 | 54.66070000 | 0.2908 | 0.2058 |
nd-15 | 7227.0400 | 7230.4100 | 1.000 | 83.33530000 | 86.92650000 | 60.07600000 | 65.11490000 | 0.3872 | 0.3350 |
nd-16 | 7227.7000 | 7227.5800 | 1.000 | 99.04390000 | 102.09800000 | 81.15100000 | 78.22420000 | 0.2205 | 0.3052 |
fo7_2 | 2031.2700 | 7403.9100 | 0.274 | 17.74930000 | 17.74930000 | 17.74930000 | 11.09430000 | 0.0000 | 0.5999 |
fo7_ar2_1 | 7489.7600 | 7545.5400 | 0.993 | 24.83980000 | 34.87130000 | 24.24210000 | 19.42240000 | 0.0247 | 0.7954 |
fo7_ar25_1 | 7485.8900 | 7414.1500 | 1.010 | 25.58910000 | 25.67840000 | 20.66020000 | 17.25980000 | 0.2386 | 0.4878 |
fo7_ar3_1 | 7504.2700 | 7413.0500 | 1.012 | 24.19550000 | 23.12100000 | 19.48500000 | 15.69890000 | 0.2418 | 0.4728 |
fo7_ar4_1 | 7491.1600 | 7368.0300 | 1.017 | 20.72980000 | 29.47550000 | 20.20060000 | 14.72570000 | 0.0262 | 1.0016 |
fo7_ar5_1 | 4544.9200 | 7340.0900 | 0.619 | 17.74930000 | 19.01200000 | 17.74930000 | 14.63770000 | 0.0000 | 0.2988 |
fo7 | 7510.0700 | 7431.2200 | 1.011 | 20.72980000 | 28.45230000 | 20.65930000 | 10.19240000 | 0.0034 | 1.7915 |
fo8_ar2_1 | 7456.9100 | 7498.4800 | 0.994 | 48.68170000 | 48.41990000 | 23.75590000 | 16.71750000 | 1.0492 | 1.8964 |
fo8_ar25_1 | 7466.7000 | 7372.1000 | --- | mstat(14) sstat(3) | 41.63040000 | --- | 14.27250000 | --- | 1.9168 |
fo8_ar3_1 | 7454.6600 | 7329.2200 | 1.017 | 39.65250000 | 40.79120000 | 21.45650000 | 11.67870000 | 0.8480 | 2.4928 |
fo8_ar4_1 | 7459.2200 | 7294.2400 | 1.023 | 28.46650000 | 33.46530000 | 19.75000000 | 11.17020000 | 0.4413 | 1.9959 |
fo8_ar5_1 | 7462.5000 | 7299.6800 | 1.022 | 24.42260000 | 45.65780000 | 17.50910000 | 12.09400000 | 0.3949 | 2.7752 |
fo8 | 7478.3600 | 7381.7800 | 1.013 | 26.86260000 | 41.06960000 | 19.65960000 | 7.74500000 | 0.3664 | 4.3027 |
fo9_ar2_1 | 7427.4000 | 7424.3900 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
fo9_ar25_1 | 7422.6000 | 7375.1300 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
fo9_ar3_1 | 7423.6500 | 7292.3500 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
fo9_ar4_1 | 7424.4900 | 7268.4700 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
fo9_ar5_1 | 7424.9100 | 7263.1100 | --- | mstat(14) sstat(3) | 41.66030000 | --- | 7.82468000 | --- | 4.3242 |
fo9 | 7445.8100 | 7344.6400 | 1.014 | 30.46430000 | 49.96150000 | 15.34770000 | 6.50795000 | 0.9849 | 6.6770 |
m3 | 1.3530 | 0.4660 | 2.903 | 37.80000000 | 37.80000000 | 37.80000000 | 37.80000000 | 0.0000 | 0.0000 |
m6 | 46.2730 | 1321.2900 | 0.035 | 82.25690000 | 82.25690000 | 82.25690000 | 82.25690000 | 0.0000 | 0.0000 |
m7_ar2_1 | 2569.7700 | 2283.0700 | 1.126 | 190.23500000 | 190.23500000 | 190.23500000 | 190.23500000 | 0.0000 | 0.0000 |
m7_ar25_1 | 166.4970 | 4391.6700 | 0.038 | 143.58500000 | 143.58500000 | 143.58500000 | 143.58500000 | 0.0000 | 0.0000 |
m7_ar3_1 | 7483.3400 | 7479.4900 | 1.001 | 143.58500000 | 143.58500000 | 132.58100000 | 119.94100000 | 0.0830 | 0.1971 |
m7_ar4_1 | 7488.2500 | 7134.8100 | 1.050 | 148.62000000 | 106.75700000 | 93.12320000 | 106.75700000 | 0.5960 | 0.0000 |
m7_ar5_1 | 7487.6700 | 7336.1600 | 1.021 | 106.46000000 | 106.46000000 | 95.02320000 | 94.28920000 | 0.1204 | 0.1291 |
m7 | 507.3050 | 7448.1800 | 0.068 | 106.75700000 | 106.75700000 | 106.75700000 | 98.71500000 | 0.0000 | 0.0815 |
netmod_dol1 | 7250.5400 | 7214.8800 | 1.005 | -0.56000800 | -0.55139800 | -0.61127200 | -0.65233400 | 0.0839 | 0.1547 |
netmod_dol2 | 1936.8100 | 5.3840 | --- | -0.56000800 | mstat(13) sstat(13) | -0.56000800 | --- | 0.0000 | --- |
netmod_kar1 | 15.0230 | 204.3500 | 0.074 | -0.41979000 | -0.41979000 | -0.41979000 | -0.41979000 | 0.0000 | 0.0000 |
netmod_kar2 | 15.0430 | 202.6730 | 0.074 | -0.41979000 | -0.41979000 | -0.41979000 | -0.41979000 | 0.0000 | 0.0000 |
no7_ar2_1 | 7503.1200 | 7471.5700 | 1.004 | 125.58900000 | 151.86000000 | 84.26260000 | 71.94960000 | 0.4904 | 1.1106 |
no7_ar25_1 | 7492.9500 | 7380.7300 | 1.015 | 115.10000000 | 148.78600000 | 86.25610000 | 60.32300000 | 0.3344 | 1.4665 |
no7_ar3_1 | 7500.7900 | 7374.7100 | 1.017 | 117.22400000 | 134.42700000 | 81.15050000 | 56.45360000 | 0.4445 | 1.3812 |
no7_ar4_1 | 7496.5500 | 7367.5900 | 1.018 | 100.41900000 | 120.70100000 | 82.50910000 | 55.14560000 | 0.2171 | 1.1888 |
no7_ar5_1 | 7486.4200 | 7343.6400 | 1.019 | 90.62270000 | 118.38200000 | 86.93780000 | 50.43270000 | 0.0424 | 1.3473 |
o7_2 | 7514.5300 | 7409.9700 | 1.014 | 116.94600000 | 122.35300000 | 90.89210000 | 59.31550000 | 0.2866 | 1.0627 |
o7_ar2_1 | 7480.0300 | 7458.1000 | 1.003 | 153.24900000 | 177.94600000 | 106.53200000 | 81.91440000 | 0.4385 | 1.1723 |
o7_ar25_1 | 7497.6300 | 7424.6000 | 1.010 | 151.01400000 | 180.92200000 | 98.40300000 | 78.99120000 | 0.5346 | 1.2904 |
o7_ar3_1 | 7488.1600 | 7369.9300 | 1.016 | 146.09600000 | 163.97700000 | 99.94000000 | 77.16780000 | 0.4618 | 1.1249 |
o7_ar4_1 | 7482.3300 | 7346.2800 | 1.019 | 136.73100000 | 183.00000000 | 97.48570000 | 69.24490000 | 0.4026 | 1.6428 |
o7_ar5_1 | 7488.1200 | 7350.2000 | 1.019 | 118.76700000 | 129.23900000 | 92.16150000 | 74.41120000 | 0.2887 | 0.7368 |
o7 | 7521.1600 | 7424.4200 | 1.013 | 131.65300000 | 165.39600000 | 96.09110000 | 51.96060000 | 0.3701 | 2.1831 |
o8_ar4_1 | 7450.2100 | 7302.2300 | 1.020 | 298.51200000 | 304.80900000 | 133.62500000 | 108.77000000 | 1.2340 | 1.8023 |
o9_ar4_1 | 7422.0700 | 7297.6900 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
tls12 | 7370.2300 | 7667.1300 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- |
tls2 | 5.9730 | 4.2320 | 1.411 | 5.30000000 | 5.30000000 | 5.30000000 | 5.30000000 | 0.0000 | 0.0000 |
tls4 | 7676.4700 | 15208.6000 | 0.505 | 8.30000000 | 13.70000000 | 5.65847000 | 2.27539000 | 0.4668 | 5.0209 |
tls5 | 7597.7300 | 10552.2000 | --- | mstat(14) sstat(3) | 15.60000000 | --- | 1.81080000 | --- | 7.6150 |
tls6 | 7535.5100 | 9148.5200 | --- | mstat(14) sstat(3) | 21.40000000 | --- | 1.92937000 | --- | 10.0917 |
tls7 | 7489.1300 | 8474.5600 | --- | mstat(14) sstat(3) | mstat(14) sstat(3) | --- | --- | --- | --- | Shifted Geometric Mean (Solved) |
698.09 | 1170.83 |
% Unsolved | 41.94% | 49.68% |