Solver Square Comparison

Solver Square Comparison: Considers all models.

Results created on 09/14/12 19:33:53 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver BONMIN_bonmin-oa-cpx is represented on the left (rows) and solver SBB_sbb on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number	Filename
Tracefile 1:	minlpconvex_bonmin-oa-cpx.pav
Tracefile 2:	minlpconvex_sbb.pav
Solvers used :	BONMIN_bonmin-oa-cpx
	SBB_sbb
Modeltype(s)	`MINLP`

	SBB_sbb: optimal	SBB_sbb: locally optimal	SBB_sbb: feasible	SBB_sbb: infeasible	SBB_sbb: unbounded	SBB_sbb: fail	SBB_sbb: no data	total BONMIN_bonmin-oa-cpx
BONMIN_bonmin-oa-cpx: optimal	`77`	-	`58`	-	-	`7`	-	`142`
BONMIN_bonmin-oa-cpx: locally optimal	-	-	-	-	-	-	-	`-`
BONMIN_bonmin-oa-cpx: feasible	-	-	-	-	-	-	-	`-`
BONMIN_bonmin-oa-cpx: infeasible	-	-	-	-	-	-	-	`-`
BONMIN_bonmin-oa-cpx: unbounded	-	-	-	-	-	-	-	`-`
BONMIN_bonmin-oa-cpx: fail	`1`	-	`8`	-	-	`4`	-	`13`
BONMIN_bonmin-oa-cpx: no data	-	-	-	-	-	-	-	`-`
total SBB_sbb	`78`	`-`	`66`	`-`	`-`	`11`	`-`	`155`

Solver return definitions:

Outcome	Model Status	Solver Status
optimal	1 or 15	1
locally optimal	2	any
feasible	8 or 16	1 or 2 or 3 or 4 or 5
infeasible	4 or 5 or 10 or 19	1
unbounded	3 or 18	1
fail	all other	all other

Solver Resource Times

Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.50E-04. If both solutions are less than 1e-1, we use the absolute difference.
Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

BONMIN_bonmin-oa-cpx: optimal -- SBB_sbb: optimal

Modelname	Time (BONMIN_bonmin-oa-cpx)	Time (SBB_sbb)	Ratio (BONMIN_bonmin-oa-cpx/SBB_sbb)	Obj (BONMIN_bonmin-oa-cpx)	Obj (SBB_sbb)
`BatchS101006M`	`5.7990`	`81.6070`	`0.071`	`769440.00000000`	`769440.00000000`
`BatchS121208M`	`5.6200`	`99.3970`	`0.057`	`1241130.00000000`	`1241130.00000000`
`BatchS151208M`	`9.5070`	`123.5030`	`0.077`	`1543470.00000000`	`1543470.00000000`
`BatchS201210M`	`18.8690`	`517.8210`	`0.036`	`2295350.00000000`	`2295350.00000000`
`clay0203h`	`1.1870`	`3.9370`	`0.301`	`41573.30000000`	`41573.30000000`
`clay0203m`	`0.8400`	`1.8450`	`0.455`	`41573.30000000`	`41573.30000000`
`clay0204h`	`1.1220`	`43.6850`	`0.026`	`6545.00000000`	`6545.00000000`
`clay0204m`	`0.8370`	`10.9330`	`0.077`	`6545.00000000`	`6545.00000000`
`clay0205h`	`13.7010`	`688.0400`	`0.020`	`8092.50000000`	`8092.50000000`
`clay0205m`	`6.8530`	`231.4940`	`0.030`	`8092.50000000`	`8092.50000000`
`clay0303h`	`1.6610`	`6.9610`	`0.239`	`26669.10000000`	`26669.10000000`
`clay0304h`	`7.5810`	`510.2070`	`0.015`	`40262.40000000`	`40262.40000000`
`clay0304m`	`2.9740`	`94.4630`	`0.031`	`40262.40000000`	`40262.40000000`
`clay0305h`	`19.0080`	`1521.9900`	`0.012`	`8092.50000000`	`8092.50000000`
`clay0305m`	`10.1620`	`186.2620`	`0.055`	`8092.50000000`	`8092.50000000`
`FLay03H`	`0.9280`	`1.0190`	`0.911`	`48.98980000`	`48.98980000`
`FLay03M`	`0.3870`	`0.6440`	`0.601`	`48.98980000`	`48.98980000`
`FLay04H`	`24.4840`	`25.2120`	`0.971`	`54.40590000`	`54.40590000`
`FLay04M`	`6.1940`	`10.0850`	`0.614`	`54.40590000`	`54.40590000`
`FLay05M`	`3181.8400`	`504.3070`	`6.309`	`64.49810000`	`64.49810000`
`RSyn0810H`	`0.3240`	`2.9460`	`0.110`	`1721.45000000`	`1721.45000000`
`RSyn0810M02H`	`1.0490`	`20.7120`	`0.051`	`1741.39000000`	`1741.39000000`
`RSyn0810M03H`	`1.7340`	`106.6050`	`0.016`	`2722.45000000`	`2722.45000000`
`RSyn0810M04H`	`1.6210`	`30.6420`	`0.053`	`6581.94000000`	`6581.94000000`
`RSyn0810M`	`0.5910`	`788.8410`	`0.001`	`1721.45000000`	`1721.45000000`
`RSyn0820H`	`0.6790`	`4.6940`	`0.145`	`1150.30000000`	`1150.30000000`
`RSyn0820M02H`	`1.5050`	`58.5700`	`0.026`	`1092.09000000`	`1092.09000000`
`RSyn0820M03H`	`1.3970`	`514.5710`	`0.003`	`2028.81000000`	`2028.81000000`
`RSyn0820M04H`	`2.8380`	`427.0530`	`0.007`	`2450.77000000`	`2450.77000000`
`RSyn0820M`	`0.7180`	`7190.5900`	`0.000`	`1150.30000000`	`1150.30000000`
`RSyn0840H`	`0.6410`	`2.1890`	`0.293`	`325.55500000`	`325.55500000`
`RSyn0840M02H`	`1.5210`	`18.9290`	`0.080`	`734.98400000`	`734.98400000`
`RSyn0840M03H`	`1.8420`	`113.8710`	`0.016`	`2742.65000000`	`2742.65000000`
`RSyn0840M04H`	`2.2560`	`740.9130`	`0.003`	`2564.50000000`	`2564.50000000`
`SLay05H`	`0.8580`	`22.2240`	`0.039`	`22664.70000000`	`22664.70000000`
`SLay05M`	`0.2550`	`2.3020`	`0.111`	`22664.70000000`	`22664.70000000`
`SLay06H`	`3.3740`	`387.8510`	`0.009`	`32757.00000000`	`32757.00000000`
`SLay06M`	`0.7360`	`1.1210`	`0.657`	`32757.00000000`	`32757.00000000`
`SLay07M`	`1.2450`	`13.6680`	`0.091`	`64748.80000000`	`64748.80000000`
`SLay08M`	`4.0190`	`4.8160`	`0.835`	`84960.20000000`	`84960.20000000`
`SLay09M`	`23.3270`	`330.1600`	`0.071`	`107806.00000000`	`107806.00000000`
`SLay10M`	`1865.1800`	`538.4240`	`3.464`	`129580.00000000`	`129580.00000000`
`Syn10H`	`0.0790`	`0.1120`	`0.705`	`1267.35000000`	`1267.35000000`
`Syn10M02H`	`0.1040`	`0.2850`	`0.365`	`2310.30000000`	`2310.30000000`
`Syn10M02M`	`0.0870`	`3.3410`	`0.026`	`2310.30000000`	`2310.30000000`
`Syn10M03H`	`0.2390`	`0.4480`	`0.533`	`3354.68000000`	`3354.68000000`
`Syn10M03M`	`0.0940`	`13.2780`	`0.007`	`3354.68000000`	`3354.68000000`
`Syn10M04H`	`0.2800`	`0.5910`	`0.474`	`4557.06000000`	`4557.06000000`
`Syn10M04M`	`0.2310`	`58.3070`	`0.004`	`4557.06000000`	`4557.06000000`
`Syn10M`	`0.0730`	`0.2170`	`0.336`	`1267.35000000`	`1267.35000000`
`Syn20H`	`0.1130`	`0.2040`	`0.554`	`924.26300000`	`924.26300000`
`Syn20M02H`	`0.2350`	`0.9990`	`0.235`	`1752.13000000`	`1752.13000000`
`Syn20M02M`	`0.2670`	`819.5300`	`0.000`	`1752.13000000`	`1752.13000000`
`Syn20M03H`	`0.4420`	`1.1720`	`0.377`	`2646.95000000`	`2646.95000000`
`Syn20M04H`	`0.5890`	`1.7440`	`0.338`	`3532.74000000`	`3532.74000000`
`Syn20M`	`0.1580`	`3.3160`	`0.048`	`924.26300000`	`924.26300000`
`Syn40H`	`0.7120`	`0.8680`	`0.820`	`67.71340000`	`67.71340000`
`Syn40M02H`	`0.6510`	`3.8970`	`0.167`	`388.77300000`	`388.77300000`
`Syn40M03H`	`1.2760`	`16.2270`	`0.079`	`395.14900000`	`395.14900000`
`Syn40M04H`	`1.8580`	`60.9210`	`0.030`	`901.75200000`	`901.75200000`
`sssd-8-4-3`	`1.2580`	`931.0760`	`0.001`	`197181.00000000`	`197181.00000000`
`uflquad-15-60`	`1331.2400`	`15.8290`	`84.101`	`1063.19000000`	`1063.19000000`
`uflquad-15-80`	`6321.9900`	`37.1940`	`169.973`	`1217.99000000`	`1217.99000000`
`uflquad-20-40`	`1139.1300`	`19.0030`	`59.945`	`860.96100000`	`860.96100000`
`uflquad-25-25`	`187.6740`	`5.7650`	`32.554`	`673.69700000`	`673.69700000`
`uflquad-25-30`	`177.6590`	`4.6730`	`38.018`	`669.84000000`	`669.84000000`
`uflquad-25-40`	`2968.5600`	`27.5040`	`107.932`	`828.16500000`	`828.16500000`
`nd-10`	`34.4900`	`472.2360`	`0.073`	`52.46110000`	`52.46110000`
`nd-12`	`12.4500`	`2721.8200`	`0.005`	`56.66960000`	`56.66960000`
`m3`	`0.1210`	`0.4660`	`0.260`	`37.80000000`	`37.80000000`
`m6`	`0.3750`	`1321.2900`	`0.000`	`82.25690000`	`82.25690000`
`m7_ar2_1`	`2.4430`	`2283.0700`	`0.001`	`190.23500000`	`190.23500000`
`m7_ar25_1`	`0.7410`	`4391.6700`	`0.000`	`143.58500000`	`143.58500000`
`m7_ar4_1`	`0.2950`	`7134.8100`	`0.000`	`106.75700000`	`106.75700000`
`netmod_kar1`	`80.3490`	`204.3500`	`0.393`	`-0.41979000`	`-0.41979000`
`netmod_kar2`	`80.1860`	`202.6730`	`0.396`	`-0.41979000`	`-0.41979000`
`tls2`	`0.3770`	`4.2320`	`0.089`	`5.30000000`	`5.30000000`

BONMIN_bonmin-oa-cpx: optimal -- SBB_sbb: feasible

Modelname	Time (BONMIN_bonmin-oa-cpx)	Time (SBB_sbb)	Ratio (BONMIN_bonmin-oa-cpx/SBB_sbb)	Obj (BONMIN_bonmin-oa-cpx)	Obj (SBB_sbb)
`RSyn0810M02M`	`5.9170`	`8679.9900`	`0.001`	`1741.39000000`	`1592.16000000`
`RSyn0810M03M`	`12.4870`	`7569.2100`	`0.002`	`2722.45000000`	`2368.77000000`
`RSyn0810M04M`	`8.0370`	`7495.6000`	`0.001`	`6581.93000000`	`5433.33000000`
`RSyn0820M02M`	`6.6110`	`7627.2200`	`0.001`	`1092.09000000`	`669.53700000`
`RSyn0820M03M`	`18.6970`	`7451.4200`	`0.003`	`2028.81000000`	`1439.77000000`
`RSyn0820M04M`	`53.8340`	`7396.6400`	`0.007`	`2450.77000000`	`1563.83000000`
`RSyn0840M02M`	`3.4070`	`8159.1100`	`0.000`	`734.98400000`	`191.12600000`
`RSyn0840M03M`	`7.1000`	`7609.5000`	`0.001`	`2742.65000000`	`2241.35000000`
`RSyn0840M04M`	`25.2500`	`7575.0000`	`0.003`	`2564.50000000`	`2301.43000000`
`RSyn0840M`	`0.9470`	`11688.7000`	`0.000`	`325.55500000`	`247.39700000`
`SLay07H`	`10.1450`	`7383.1600`	`0.001`	`64748.80000000`	`64748.80000000`
`SLay08H`	`35.0140`	`7413.2200`	`0.005`	`84960.20000000`	`85115.00000000`
`SLay09H`	`164.5140`	`7412.7900`	`0.022`	`107806.00000000`	`122507.00000000`
`Syn20M03M`	`0.3560`	`7954.4200`	`0.000`	`2646.95000000`	`2646.95000000`
`Syn20M04M`	`0.4250`	`7781.6900`	`0.000`	`3532.74000000`	`3500.74000000`
`Syn40M02M`	`0.5770`	`8804.5400`	`0.000`	`388.77200000`	`344.48700000`
`Syn40M03M`	`1.0780`	`7548.5800`	`0.000`	`395.14800000`	`294.29000000`
`Syn40M04M`	`1.2810`	`7557.2600`	`0.000`	`901.75100000`	`831.89600000`
`Syn40M`	`0.2920`	`10415.2000`	`0.000`	`67.71330000`	`67.71330000`
`sssd-10-4-3`	`1.7300`	`12944.6000`	`0.000`	`152710.00000000`	`159329.00000000`
`sssd-12-5-3`	`10.4130`	`19374.5000`	`0.001`	`261143.00000000`	`330320.00000000`
`sssd-15-6-3`	`41.0080`	`15779.7000`	`0.003`	`440711.00000000`	`513871.00000000`
`sssd-16-8-3`	`338.5340`	`13118.5000`	`0.026`	`615763.00000000`	`709652.00000000`
`sssd-18-8-3`	`1244.5200`	`12851.3000`	`0.097`	`524063.00000000`	`637320.00000000`
`nd-13`	`969.3710`	`7251.3700`	`0.134`	`63.00510000`	`65.90790000`
`nd-16`	`1511.5300`	`7227.5800`	`0.209`	`97.97920000`	`102.09800000`
`fo7_2`	`12.2390`	`7403.9100`	`0.002`	`17.74930000`	`17.74930000`
`fo7_ar2_1`	`9.6780`	`7545.5400`	`0.001`	`24.83980000`	`34.87130000`
`fo7_ar25_1`	`12.1740`	`7414.1500`	`0.002`	`23.09360000`	`25.67840000`
`fo7_ar3_1`	`15.4120`	`7413.0500`	`0.002`	`22.51750000`	`23.12100000`
`fo7_ar4_1`	`11.5850`	`7368.0300`	`0.002`	`20.72980000`	`29.47550000`
`fo7_ar5_1`	`4.2450`	`7340.0900`	`0.001`	`17.74930000`	`19.01200000`
`fo7`	`37.0670`	`7431.2200`	`0.005`	`20.72980000`	`28.45230000`
`fo8_ar2_1`	`52.4780`	`7498.4800`	`0.007`	`30.34060000`	`48.41990000`
`fo8_ar25_1`	`87.1140`	`7372.1000`	`0.012`	`28.04520000`	`41.63040000`
`fo8_ar3_1`	`12.0520`	`7329.2200`	`0.002`	`23.91010000`	`40.79120000`
`fo8_ar4_1`	`6.9970`	`7294.2400`	`0.001`	`22.38190000`	`33.46530000`
`fo8_ar5_1`	`22.0040`	`7299.6800`	`0.003`	`22.38190000`	`45.65780000`
`fo8`	`130.2710`	`7381.7800`	`0.018`	`22.38190000`	`41.06960000`
`fo9_ar5_1`	`104.1320`	`7263.1100`	`0.014`	`23.46430000`	`41.66030000`
`fo9`	`475.5770`	`7344.6400`	`0.065`	`23.46430000`	`49.96150000`
`m7_ar3_1`	`2.2540`	`7479.4900`	`0.000`	`143.58500000`	`143.58500000`
`m7_ar5_1`	`1.5140`	`7336.1600`	`0.000`	`106.46000000`	`106.46000000`
`m7`	`0.9230`	`7448.1800`	`0.000`	`106.75700000`	`106.75700000`
`no7_ar2_1`	`7.2730`	`7471.5700`	`0.001`	`107.81500000`	`151.86000000`
`no7_ar25_1`	`23.0790`	`7380.7300`	`0.003`	`107.81500000`	`148.78600000`
`no7_ar3_1`	`77.2440`	`7374.7100`	`0.010`	`107.81500000`	`134.42700000`
`no7_ar4_1`	`74.2580`	`7367.5900`	`0.010`	`98.51840000`	`120.70100000`
`no7_ar5_1`	`70.2040`	`7343.6400`	`0.010`	`90.62270000`	`118.38200000`
`o7_2`	`518.8520`	`7409.9700`	`0.070`	`116.94600000`	`122.35300000`
`o7_ar2_1`	`52.5910`	`7458.1000`	`0.007`	`140.41200000`	`177.94600000`
`o7_ar25_1`	`239.0250`	`7424.6000`	`0.032`	`140.41200000`	`180.92200000`
`o7_ar3_1`	`477.7380`	`7369.9300`	`0.065`	`137.93200000`	`163.97700000`
`o7_ar4_1`	`1632.0700`	`7346.2800`	`0.222`	`131.65300000`	`183.00000000`
`o7_ar5_1`	`333.8150`	`7350.2000`	`0.045`	`116.94600000`	`129.23900000`
`o7`	`2462.8400`	`7424.4200`	`0.332`	`131.65300000`	`165.39600000`
`o8_ar4_1`	`5426.3700`	`7302.2300`	`0.743`	`243.07100000`	`304.80900000`
`tls4`	`236.7010`	`15208.6000`	`0.016`	`8.30000000`	`13.70000000`

BONMIN_bonmin-oa-cpx: optimal -- SBB_sbb: fail

Modelname	Time (BONMIN_bonmin-oa-cpx)	Time (SBB_sbb)	Ratio (BONMIN_bonmin-oa-cpx/SBB_sbb)	Obj (BONMIN_bonmin-oa-cpx)	Status (SBB_sbb)
`clay0303m`	`1.2750`	`1.7160`	---	`26669.10000000`	`mstat(13)sstat( 1)`
`FLay05H`	`5798.8800`	`2611.9300`	---	`64.49810000`	`mstat(13)sstat( 1)`
`fo9_ar2_1`	`277.8710`	`7424.3900`	---	`32.62500000`	`mstat(14)sstat( 3)`
`fo9_ar25_1`	`1307.2300`	`7375.1300`	---	`32.18640000`	`mstat(14)sstat( 3)`
`fo9_ar3_1`	`41.5170`	`7292.3500`	---	`24.81550000`	`mstat(14)sstat( 3)`
`fo9_ar4_1`	`31.7720`	`7268.4700`	---	`23.46430000`	`mstat(14)sstat( 3)`
`netmod_dol2`	`235.5120`	`5.3840`	---	`-0.56000800`	`mstat(13)sstat(13)`

BONMIN_bonmin-oa-cpx: fail -- SBB_sbb: optimal

Modelname	Time (BONMIN_bonmin-oa-cpx)	Time (SBB_sbb)	Ratio (BONMIN_bonmin-oa-cpx/SBB_sbb)	Status (BONMIN_bonmin-oa-cpx)	Obj (SBB_sbb)
`uflquad-20-50`	`7220.7100`	`1623.3800`	---	`mstat(14)sstat( 3)`	`375.91900000`

BONMIN_bonmin-oa-cpx: fail -- SBB_sbb: feasible

Modelname	Time (BONMIN_bonmin-oa-cpx)	Time (SBB_sbb)	Ratio (BONMIN_bonmin-oa-cpx/SBB_sbb)	Status (BONMIN_bonmin-oa-cpx)	Obj (SBB_sbb)
`FLay06H`	`7228.5900`	`7451.7700`	---	`mstat(14)sstat( 3)`	`66.93280000`
`SLay10H`	`7226.3200`	`7356.2200`	---	`mstat(14)sstat( 3)`	`153256.00000000`
`sssd-20-9-3`	`7279.6900`	`11853.3000`	---	`mstat(14)sstat( 3)`	`510261.00000000`
`sssd-22-8-3`	`7307.2200`	`12055.5000`	---	`mstat(14)sstat( 3)`	`730203.00000000`
`nd-15`	`1715.8700`	`7230.4100`	---	`mstat(13)sstat( 1)`	`86.92650000`
`netmod_dol1`	`7220.1600`	`7214.8800`	---	`mstat(14)sstat( 3)`	`-0.55139800`
`tls5`	`7225.8400`	`10552.2000`	---	`mstat(14)sstat( 3)`	`15.60000000`
`tls6`	`7223.9800`	`9148.5200`	---	`mstat(14)sstat( 3)`	`21.40000000`

BONMIN_bonmin-oa-cpx: fail -- SBB_sbb: fail

Modelname	Time (BONMIN_bonmin-oa-cpx)	Time (SBB_sbb)	Ratio (BONMIN_bonmin-oa-cpx/SBB_sbb)	Status (BONMIN_bonmin-oa-cpx)	Status (SBB_sbb)
`FLay06M`	`7261.9600`	`11788.9000`	---	`mstat(14)sstat( 3)`	`mstat(13)sstat( 1)`
`o9_ar4_1`	`7245.7900`	`7297.6900`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`tls12`	`7221.1400`	`7667.1300`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`tls7`	`7224.8500`	`8474.5600`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`

BONMIN_bonmin-oa-cpx: optimal:

Modelname	Time (BONMIN_bonmin-oa-cpx)	Obj (BONMIN_bonmin-oa-cpx)
`BatchS101006M`	`5.7990`	`769440.00000000`
`BatchS121208M`	`5.6200`	`1241130.00000000`
`BatchS151208M`	`9.5070`	`1543470.00000000`
`BatchS201210M`	`18.8690`	`2295350.00000000`
`clay0203h`	`1.1870`	`41573.30000000`
`clay0203m`	`0.8400`	`41573.30000000`
`clay0204h`	`1.1220`	`6545.00000000`
`clay0204m`	`0.8370`	`6545.00000000`
`clay0205h`	`13.7010`	`8092.50000000`
`clay0205m`	`6.8530`	`8092.50000000`
`clay0303h`	`1.6610`	`26669.10000000`
`clay0303m`	`1.2750`	`26669.10000000`
`clay0304h`	`7.5810`	`40262.40000000`
`clay0304m`	`2.9740`	`40262.40000000`
`clay0305h`	`19.0080`	`8092.50000000`
`clay0305m`	`10.1620`	`8092.50000000`
`FLay03H`	`0.9280`	`48.98980000`
`FLay03M`	`0.3870`	`48.98980000`
`FLay04H`	`24.4840`	`54.40590000`
`FLay04M`	`6.1940`	`54.40590000`
`FLay05H`	`5798.8800`	`64.49810000`
`FLay05M`	`3181.8400`	`64.49810000`
`RSyn0810H`	`0.3240`	`1721.45000000`
`RSyn0810M02H`	`1.0490`	`1741.39000000`
`RSyn0810M02M`	`5.9170`	`1741.39000000`
`RSyn0810M03H`	`1.7340`	`2722.45000000`
`RSyn0810M03M`	`12.4870`	`2722.45000000`
`RSyn0810M04H`	`1.6210`	`6581.94000000`
`RSyn0810M04M`	`8.0370`	`6581.93000000`
`RSyn0810M`	`0.5910`	`1721.45000000`
`RSyn0820H`	`0.6790`	`1150.30000000`
`RSyn0820M02H`	`1.5050`	`1092.09000000`
`RSyn0820M02M`	`6.6110`	`1092.09000000`
`RSyn0820M03H`	`1.3970`	`2028.81000000`
`RSyn0820M03M`	`18.6970`	`2028.81000000`
`RSyn0820M04H`	`2.8380`	`2450.77000000`
`RSyn0820M04M`	`53.8340`	`2450.77000000`
`RSyn0820M`	`0.7180`	`1150.30000000`
`RSyn0840H`	`0.6410`	`325.55500000`
`RSyn0840M02H`	`1.5210`	`734.98400000`
`RSyn0840M02M`	`3.4070`	`734.98400000`
`RSyn0840M03H`	`1.8420`	`2742.65000000`
`RSyn0840M03M`	`7.1000`	`2742.65000000`
`RSyn0840M04H`	`2.2560`	`2564.50000000`
`RSyn0840M04M`	`25.2500`	`2564.50000000`
`RSyn0840M`	`0.9470`	`325.55500000`
`SLay05H`	`0.8580`	`22664.70000000`
`SLay05M`	`0.2550`	`22664.70000000`
`SLay06H`	`3.3740`	`32757.00000000`
`SLay06M`	`0.7360`	`32757.00000000`
`SLay07H`	`10.1450`	`64748.80000000`
`SLay07M`	`1.2450`	`64748.80000000`
`SLay08H`	`35.0140`	`84960.20000000`
`SLay08M`	`4.0190`	`84960.20000000`
`SLay09H`	`164.5140`	`107806.00000000`
`SLay09M`	`23.3270`	`107806.00000000`
`SLay10M`	`1865.1800`	`129580.00000000`
`Syn10H`	`0.0790`	`1267.35000000`
`Syn10M02H`	`0.1040`	`2310.30000000`
`Syn10M02M`	`0.0870`	`2310.30000000`
`Syn10M03H`	`0.2390`	`3354.68000000`
`Syn10M03M`	`0.0940`	`3354.68000000`
`Syn10M04H`	`0.2800`	`4557.06000000`
`Syn10M04M`	`0.2310`	`4557.06000000`
`Syn10M`	`0.0730`	`1267.35000000`
`Syn20H`	`0.1130`	`924.26300000`
`Syn20M02H`	`0.2350`	`1752.13000000`
`Syn20M02M`	`0.2670`	`1752.13000000`
`Syn20M03H`	`0.4420`	`2646.95000000`
`Syn20M03M`	`0.3560`	`2646.95000000`
`Syn20M04H`	`0.5890`	`3532.74000000`
`Syn20M04M`	`0.4250`	`3532.74000000`
`Syn20M`	`0.1580`	`924.26300000`
`Syn40H`	`0.7120`	`67.71340000`
`Syn40M02H`	`0.6510`	`388.77300000`
`Syn40M02M`	`0.5770`	`388.77200000`
`Syn40M03H`	`1.2760`	`395.14900000`
`Syn40M03M`	`1.0780`	`395.14800000`
`Syn40M04H`	`1.8580`	`901.75200000`
`Syn40M04M`	`1.2810`	`901.75100000`
`Syn40M`	`0.2920`	`67.71330000`
`sssd-8-4-3`	`1.2580`	`197181.00000000`
`sssd-10-4-3`	`1.7300`	`152710.00000000`
`sssd-12-5-3`	`10.4130`	`261143.00000000`
`sssd-15-6-3`	`41.0080`	`440711.00000000`
`sssd-16-8-3`	`338.5340`	`615763.00000000`
`sssd-18-8-3`	`1244.5200`	`524063.00000000`
`uflquad-15-60`	`1331.2400`	`1063.19000000`
`uflquad-15-80`	`6321.9900`	`1217.99000000`
`uflquad-20-40`	`1139.1300`	`860.96100000`
`uflquad-25-25`	`187.6740`	`673.69700000`
`uflquad-25-30`	`177.6590`	`669.84000000`
`uflquad-25-40`	`2968.5600`	`828.16500000`
`nd-10`	`34.4900`	`52.46110000`
`nd-12`	`12.4500`	`56.66960000`
`nd-13`	`969.3710`	`63.00510000`
`nd-16`	`1511.5300`	`97.97920000`
`fo7_2`	`12.2390`	`17.74930000`
`fo7_ar2_1`	`9.6780`	`24.83980000`
`fo7_ar25_1`	`12.1740`	`23.09360000`
`fo7_ar3_1`	`15.4120`	`22.51750000`
`fo7_ar4_1`	`11.5850`	`20.72980000`
`fo7_ar5_1`	`4.2450`	`17.74930000`
`fo7`	`37.0670`	`20.72980000`
`fo8_ar2_1`	`52.4780`	`30.34060000`
`fo8_ar25_1`	`87.1140`	`28.04520000`
`fo8_ar3_1`	`12.0520`	`23.91010000`
`fo8_ar4_1`	`6.9970`	`22.38190000`
`fo8_ar5_1`	`22.0040`	`22.38190000`
`fo8`	`130.2710`	`22.38190000`
`fo9_ar2_1`	`277.8710`	`32.62500000`
`fo9_ar25_1`	`1307.2300`	`32.18640000`
`fo9_ar3_1`	`41.5170`	`24.81550000`
`fo9_ar4_1`	`31.7720`	`23.46430000`
`fo9_ar5_1`	`104.1320`	`23.46430000`
`fo9`	`475.5770`	`23.46430000`
`m3`	`0.1210`	`37.80000000`
`m6`	`0.3750`	`82.25690000`
`m7_ar2_1`	`2.4430`	`190.23500000`
`m7_ar25_1`	`0.7410`	`143.58500000`
`m7_ar3_1`	`2.2540`	`143.58500000`
`m7_ar4_1`	`0.2950`	`106.75700000`
`m7_ar5_1`	`1.5140`	`106.46000000`
`m7`	`0.9230`	`106.75700000`
`netmod_dol2`	`235.5120`	`-0.56000800`
`netmod_kar1`	`80.3490`	`-0.41979000`
`netmod_kar2`	`80.1860`	`-0.41979000`
`no7_ar2_1`	`7.2730`	`107.81500000`
`no7_ar25_1`	`23.0790`	`107.81500000`
`no7_ar3_1`	`77.2440`	`107.81500000`
`no7_ar4_1`	`74.2580`	`98.51840000`
`no7_ar5_1`	`70.2040`	`90.62270000`
`o7_2`	`518.8520`	`116.94600000`
`o7_ar2_1`	`52.5910`	`140.41200000`
`o7_ar25_1`	`239.0250`	`140.41200000`
`o7_ar3_1`	`477.7380`	`137.93200000`
`o7_ar4_1`	`1632.0700`	`131.65300000`
`o7_ar5_1`	`333.8150`	`116.94600000`
`o7`	`2462.8400`	`131.65300000`
`o8_ar4_1`	`5426.3700`	`243.07100000`
`tls2`	`0.3770`	`5.30000000`
`tls4`	`236.7010`	`8.30000000`

BONMIN_bonmin-oa-cpx: fail:

Modelname	Time (BONMIN_bonmin-oa-cpx)	Status (BONMIN_bonmin-oa-cpx)
`FLay06H`	`--`	`mstat(14) sstat( 3)`
`FLay06M`	`--`	`mstat(14) sstat( 3)`
`SLay10H`	`--`	`mstat(14) sstat( 3)`
`sssd-20-9-3`	`--`	`mstat(14) sstat( 3)`
`sssd-22-8-3`	`--`	`mstat(14) sstat( 3)`
`uflquad-20-50`	`--`	`mstat(14) sstat( 3)`
`nd-15`	`--`	`mstat(13) sstat( 1)`
`netmod_dol1`	`--`	`mstat(14) sstat( 3)`
`o9_ar4_1`	`--`	`mstat(14) sstat( 3)`
`tls12`	`--`	`mstat(14) sstat( 3)`
`tls5`	`--`	`mstat(14) sstat( 3)`
`tls6`	`--`	`mstat(14) sstat( 3)`
`tls7`	`--`	`mstat(14) sstat( 3)`

SBB_sbb: optimal:

Modelname	Time (SBB_sbb)	Obj (SBB_sbb)
`BatchS101006M`	`81.6070`	`769440.00000000`
`BatchS121208M`	`99.3970`	`1241130.00000000`
`BatchS151208M`	`123.5030`	`1543470.00000000`
`BatchS201210M`	`517.8210`	`2295350.00000000`
`clay0203h`	`3.9370`	`41573.30000000`
`clay0203m`	`1.8450`	`41573.30000000`
`clay0204h`	`43.6850`	`6545.00000000`
`clay0204m`	`10.9330`	`6545.00000000`
`clay0205h`	`688.0400`	`8092.50000000`
`clay0205m`	`231.4940`	`8092.50000000`
`clay0303h`	`6.9610`	`26669.10000000`
`clay0304h`	`510.2070`	`40262.40000000`
`clay0304m`	`94.4630`	`40262.40000000`
`clay0305h`	`1521.9900`	`8092.50000000`
`clay0305m`	`186.2620`	`8092.50000000`
`FLay03H`	`1.0190`	`48.98980000`
`FLay03M`	`0.6440`	`48.98980000`
`FLay04H`	`25.2120`	`54.40590000`
`FLay04M`	`10.0850`	`54.40590000`
`FLay05M`	`504.3070`	`64.49810000`
`RSyn0810H`	`2.9460`	`1721.45000000`
`RSyn0810M02H`	`20.7120`	`1741.39000000`
`RSyn0810M03H`	`106.6050`	`2722.45000000`
`RSyn0810M04H`	`30.6420`	`6581.94000000`
`RSyn0810M`	`788.8410`	`1721.45000000`
`RSyn0820H`	`4.6940`	`1150.30000000`
`RSyn0820M02H`	`58.5700`	`1092.09000000`
`RSyn0820M03H`	`514.5710`	`2028.81000000`
`RSyn0820M04H`	`427.0530`	`2450.77000000`
`RSyn0820M`	`7190.5900`	`1150.30000000`
`RSyn0840H`	`2.1890`	`325.55500000`
`RSyn0840M02H`	`18.9290`	`734.98400000`
`RSyn0840M03H`	`113.8710`	`2742.65000000`
`RSyn0840M04H`	`740.9130`	`2564.50000000`
`SLay05H`	`22.2240`	`22664.70000000`
`SLay05M`	`2.3020`	`22664.70000000`
`SLay06H`	`387.8510`	`32757.00000000`
`SLay06M`	`1.1210`	`32757.00000000`
`SLay07M`	`13.6680`	`64748.80000000`
`SLay08M`	`4.8160`	`84960.20000000`
`SLay09M`	`330.1600`	`107806.00000000`
`SLay10M`	`538.4240`	`129580.00000000`
`Syn10H`	`0.1120`	`1267.35000000`
`Syn10M02H`	`0.2850`	`2310.30000000`
`Syn10M02M`	`3.3410`	`2310.30000000`
`Syn10M03H`	`0.4480`	`3354.68000000`
`Syn10M03M`	`13.2780`	`3354.68000000`
`Syn10M04H`	`0.5910`	`4557.06000000`
`Syn10M04M`	`58.3070`	`4557.06000000`
`Syn10M`	`0.2170`	`1267.35000000`
`Syn20H`	`0.2040`	`924.26300000`
`Syn20M02H`	`0.9990`	`1752.13000000`
`Syn20M02M`	`819.5300`	`1752.13000000`
`Syn20M03H`	`1.1720`	`2646.95000000`
`Syn20M04H`	`1.7440`	`3532.74000000`
`Syn20M`	`3.3160`	`924.26300000`
`Syn40H`	`0.8680`	`67.71340000`
`Syn40M02H`	`3.8970`	`388.77300000`
`Syn40M03H`	`16.2270`	`395.14900000`
`Syn40M04H`	`60.9210`	`901.75200000`
`sssd-8-4-3`	`931.0760`	`197181.00000000`
`uflquad-15-60`	`15.8290`	`1063.19000000`
`uflquad-15-80`	`37.1940`	`1217.99000000`
`uflquad-20-40`	`19.0030`	`860.96100000`
`uflquad-20-50`	`1623.3800`	`375.91900000`
`uflquad-25-25`	`5.7650`	`673.69700000`
`uflquad-25-30`	`4.6730`	`669.84000000`
`uflquad-25-40`	`27.5040`	`828.16500000`
`nd-10`	`472.2360`	`52.46110000`
`nd-12`	`2721.8200`	`56.66960000`
`m3`	`0.4660`	`37.80000000`
`m6`	`1321.2900`	`82.25690000`
`m7_ar2_1`	`2283.0700`	`190.23500000`
`m7_ar25_1`	`4391.6700`	`143.58500000`
`m7_ar4_1`	`7134.8100`	`106.75700000`
`netmod_kar1`	`204.3500`	`-0.41979000`
`netmod_kar2`	`202.6730`	`-0.41979000`
`tls2`	`4.2320`	`5.30000000`

SBB_sbb: feasible:

Modelname	Time (SBB_sbb)	Obj (SBB_sbb)
`FLay06H`	`7451.7700`	`66.93280000`
`RSyn0810M02M`	`8679.9900`	`1592.16000000`
`RSyn0810M03M`	`7569.2100`	`2368.77000000`
`RSyn0810M04M`	`7495.6000`	`5433.33000000`
`RSyn0820M02M`	`7627.2200`	`669.53700000`
`RSyn0820M03M`	`7451.4200`	`1439.77000000`
`RSyn0820M04M`	`7396.6400`	`1563.83000000`
`RSyn0840M02M`	`8159.1100`	`191.12600000`
`RSyn0840M03M`	`7609.5000`	`2241.35000000`
`RSyn0840M04M`	`7575.0000`	`2301.43000000`
`RSyn0840M`	`11688.7000`	`247.39700000`
`SLay07H`	`7383.1600`	`64748.80000000`
`SLay08H`	`7413.2200`	`85115.00000000`
`SLay09H`	`7412.7900`	`122507.00000000`
`SLay10H`	`7356.2200`	`153256.00000000`
`Syn20M03M`	`7954.4200`	`2646.95000000`
`Syn20M04M`	`7781.6900`	`3500.74000000`
`Syn40M02M`	`8804.5400`	`344.48700000`
`Syn40M03M`	`7548.5800`	`294.29000000`
`Syn40M04M`	`7557.2600`	`831.89600000`
`Syn40M`	`10415.2000`	`67.71330000`
`sssd-10-4-3`	`12944.6000`	`159329.00000000`
`sssd-12-5-3`	`19374.5000`	`330320.00000000`
`sssd-15-6-3`	`15779.7000`	`513871.00000000`
`sssd-16-8-3`	`13118.5000`	`709652.00000000`
`sssd-18-8-3`	`12851.3000`	`637320.00000000`
`sssd-20-9-3`	`11853.3000`	`510261.00000000`
`sssd-22-8-3`	`12055.5000`	`730203.00000000`
`nd-13`	`7251.3700`	`65.90790000`
`nd-15`	`7230.4100`	`86.92650000`
`nd-16`	`7227.5800`	`102.09800000`
`fo7_2`	`7403.9100`	`17.74930000`
`fo7_ar2_1`	`7545.5400`	`34.87130000`
`fo7_ar25_1`	`7414.1500`	`25.67840000`
`fo7_ar3_1`	`7413.0500`	`23.12100000`
`fo7_ar4_1`	`7368.0300`	`29.47550000`
`fo7_ar5_1`	`7340.0900`	`19.01200000`
`fo7`	`7431.2200`	`28.45230000`
`fo8_ar2_1`	`7498.4800`	`48.41990000`
`fo8_ar25_1`	`7372.1000`	`41.63040000`
`fo8_ar3_1`	`7329.2200`	`40.79120000`
`fo8_ar4_1`	`7294.2400`	`33.46530000`
`fo8_ar5_1`	`7299.6800`	`45.65780000`
`fo8`	`7381.7800`	`41.06960000`
`fo9_ar5_1`	`7263.1100`	`41.66030000`
`fo9`	`7344.6400`	`49.96150000`
`m7_ar3_1`	`7479.4900`	`143.58500000`
`m7_ar5_1`	`7336.1600`	`106.46000000`
`m7`	`7448.1800`	`106.75700000`
`netmod_dol1`	`7214.8800`	`-0.55139800`
`no7_ar2_1`	`7471.5700`	`151.86000000`
`no7_ar25_1`	`7380.7300`	`148.78600000`
`no7_ar3_1`	`7374.7100`	`134.42700000`
`no7_ar4_1`	`7367.5900`	`120.70100000`
`no7_ar5_1`	`7343.6400`	`118.38200000`
`o7_2`	`7409.9700`	`122.35300000`
`o7_ar2_1`	`7458.1000`	`177.94600000`
`o7_ar25_1`	`7424.6000`	`180.92200000`
`o7_ar3_1`	`7369.9300`	`163.97700000`
`o7_ar4_1`	`7346.2800`	`183.00000000`
`o7_ar5_1`	`7350.2000`	`129.23900000`
`o7`	`7424.4200`	`165.39600000`
`o8_ar4_1`	`7302.2300`	`304.80900000`
`tls4`	`15208.6000`	`13.70000000`
`tls5`	`10552.2000`	`15.60000000`
`tls6`	`9148.5200`	`21.40000000`

SBB_sbb: fail:

Modelname	Time (SBB_sbb)	Status (SBB_sbb)
`clay0303m`	`--`	`mstat(13)sstat( 1)`
`FLay05H`	`--`	`mstat(13)sstat( 1)`
`FLay06M`	`--`	`mstat(13)sstat( 1)`
`fo9_ar2_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar25_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar3_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar4_1`	`--`	`mstat(14)sstat( 3)`
`netmod_dol2`	`--`	`mstat(13)sstat(13)`
`o9_ar4_1`	`--`	`mstat(14)sstat( 3)`
`tls12`	`--`	`mstat(14)sstat( 3)`
`tls7`	`--`	`mstat(14)sstat( 3)`

BONMIN_bonmin-oa-cpx: all -- SBB_sbb: all

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (19374.50 seconds). The shift is 10s.

Modelname	Time (BONMIN_bonmin-oa-cpx)	Time (SBB_sbb)	Ratio (BONMIN_bonmin-oa-cpx/ SBB_sbb)	Obj (BONMIN_bonmin-oa-cpx)	Obj (SBB_sbb)	ObjEst (BONMIN_bonmin-oa-cpx)	ObjEst (SBB_sbb)	Gap (BONMIN_bonmin-oa-cpx)	Gap (SBB_sbb)
`BatchS101006M`	`5.7990`	`81.6070`	`0.071`	`769440.00000000`	`769440.00000000`	`769440.00000000`	`769440.00000000`	`0.0000`	`0.0000`
`BatchS121208M`	`5.6200`	`99.3970`	`0.057`	`1241130.00000000`	`1241130.00000000`	`1241130.00000000`	`1241130.00000000`	`0.0000`	`0.0000`
`BatchS151208M`	`9.5070`	`123.5030`	`0.077`	`1543470.00000000`	`1543470.00000000`	`1543470.00000000`	`1543470.00000000`	`0.0000`	`0.0000`
`BatchS201210M`	`18.8690`	`517.8210`	`0.036`	`2295350.00000000`	`2295350.00000000`	`2295350.00000000`	`2295350.00000000`	`0.0000`	`0.0000`
`clay0203h`	`1.1870`	`3.9370`	`0.301`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`0.0000`	`0.0000`
`clay0203m`	`0.8400`	`1.8450`	`0.455`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`0.0000`	`0.0000`
`clay0204h`	`1.1220`	`43.6850`	`0.026`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`0.0000`	`0.0000`
`clay0204m`	`0.8370`	`10.9330`	`0.077`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`0.0000`	`0.0000`
`clay0205h`	`13.7010`	`688.0400`	`0.020`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0205m`	`6.8530`	`231.4940`	`0.030`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0303h`	`1.6610`	`6.9610`	`0.239`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`0.0000`	`0.0000`
`clay0303m`	`1.2750`	`1.7160`	---	`26669.10000000`	`mstat(13) sstat(1)`	`26669.10000000`	---	`0.0000`	`---`
`clay0304h`	`7.5810`	`510.2070`	`0.015`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`0.0000`	`0.0000`
`clay0304m`	`2.9740`	`94.4630`	`0.031`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`0.0000`	`0.0000`
`clay0305h`	`19.0080`	`1521.9900`	`0.012`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0305m`	`10.1620`	`186.2620`	`0.055`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`FLay03H`	`0.9280`	`1.0190`	`0.911`	`48.98980000`	`48.98980000`	`48.98980000`	`48.98980000`	`0.0000`	`0.0000`
`FLay03M`	`0.3870`	`0.6440`	`0.601`	`48.98980000`	`48.98980000`	`48.98980000`	`48.98980000`	`0.0000`	`0.0000`
`FLay04H`	`24.4840`	`25.2120`	`0.971`	`54.40590000`	`54.40590000`	`54.40590000`	`54.40590000`	`0.0000`	`0.0000`
`FLay04M`	`6.1940`	`10.0850`	`0.614`	`54.40590000`	`54.40590000`	`54.40590000`	`54.40590000`	`0.0000`	`0.0000`
`FLay05H`	`5798.8800`	`2611.9300`	---	`64.49810000`	`mstat(13) sstat(1)`	`64.49810000`	---	`0.0000`	`---`
`FLay05M`	`3181.8400`	`504.3070`	`6.309`	`64.49810000`	`64.49810000`	`64.49810000`	`64.49810000`	`0.0000`	`0.0000`
`FLay06H`	`7228.5900`	`7451.7700`	---	`mstat(14) sstat(3)`	`66.93280000`	---	`51.70410000`	`---`	`0.2945`
`FLay06M`	`7261.9600`	`11788.9000`	---	`mstat(14) sstat(3)`	`mstat(13) sstat(1)`	---	---	---	---
`RSyn0810H (max)`	`0.3240`	`2.9460`	`0.110`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`0.0000`	`0.0000`
`RSyn0810M02H (max)`	`1.0490`	`20.7120`	`0.051`	`1741.39000000`	`1741.39000000`	`1741.39000000`	`1741.39000000`	`0.0000`	`0.0000`
`RSyn0810M02M (max)`	`5.9170`	`8679.9900`	`0.001`	`1741.39000000`	`1592.16000000`	`1741.39000000`	`3137.64000000`	`0.0000`	`0.4926`
`RSyn0810M03H (max)`	`1.7340`	`106.6050`	`0.016`	`2722.45000000`	`2722.45000000`	`2722.45000000`	`2722.45000000`	`0.0000`	`0.0000`
`RSyn0810M03M (max)`	`12.4870`	`7569.2100`	`0.002`	`2722.45000000`	`2368.77000000`	`2722.45000000`	`5509.95000000`	`0.0000`	`0.5701`
`RSyn0810M04H (max)`	`1.6210`	`30.6420`	`0.053`	`6581.94000000`	`6581.94000000`	`6581.94000000`	`6581.94000000`	`0.0000`	`0.0000`
`RSyn0810M04M (max)`	`8.0370`	`7495.6000`	`0.001`	`6581.93000000`	`5433.33000000`	`6581.93000000`	`10821.10000000`	`0.0000`	`0.4979`
`RSyn0810M (max)`	`0.5910`	`788.8410`	`0.001`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`0.0000`	`0.0000`
`RSyn0820H (max)`	`0.6790`	`4.6940`	`0.145`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`0.0000`	`0.0000`
`RSyn0820M02H (max)`	`1.5050`	`58.5700`	`0.026`	`1092.09000000`	`1092.09000000`	`1092.09000000`	`1092.09000000`	`0.0000`	`0.0000`
`RSyn0820M02M (max)`	`6.6110`	`7627.2200`	`0.001`	`1092.09000000`	`669.53700000`	`1092.09000000`	`4051.07000000`	`0.0000`	`0.8347`
`RSyn0820M03H (max)`	`1.3970`	`514.5710`	`0.003`	`2028.81000000`	`2028.81000000`	`2028.81000000`	`2028.81000000`	`0.0000`	`0.0000`
`RSyn0820M03M (max)`	`18.6970`	`7451.4200`	`0.003`	`2028.81000000`	`1439.77000000`	`2028.81000000`	`5861.88000000`	`0.0000`	`0.7544`
`RSyn0820M04H (max)`	`2.8380`	`427.0530`	`0.007`	`2450.77000000`	`2450.77000000`	`2450.77000000`	`2450.77000000`	`0.0000`	`0.0000`
`RSyn0820M04M (max)`	`53.8340`	`7396.6400`	`0.007`	`2450.77000000`	`1563.83000000`	`2450.77000000`	`8372.19000000`	`0.0000`	`0.8132`
`RSyn0820M (max)`	`0.7180`	`7190.5900`	`0.000`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`0.0000`	`0.0000`
`RSyn0840H (max)`	`0.6410`	`2.1890`	`0.293`	`325.55500000`	`325.55500000`	`325.55500000`	`325.55500000`	`0.0000`	`0.0000`
`RSyn0840M02H (max)`	`1.5210`	`18.9290`	`0.080`	`734.98400000`	`734.98400000`	`734.98400000`	`734.98400000`	`0.0000`	`0.0000`
`RSyn0840M02M (max)`	`3.4070`	`8159.1100`	`0.000`	`734.98400000`	`191.12600000`	`734.98400000`	`4639.90000000`	`0.0000`	`0.9588`
`RSyn0840M03H (max)`	`1.8420`	`113.8710`	`0.016`	`2742.65000000`	`2742.65000000`	`2742.65000000`	`2742.65000000`	`0.0000`	`0.0000`
`RSyn0840M03M (max)`	`7.1000`	`7609.5000`	`0.001`	`2742.65000000`	`2241.35000000`	`2742.65000000`	`7850.66000000`	`0.0000`	`0.7145`
`RSyn0840M04H (max)`	`2.2560`	`740.9130`	`0.003`	`2564.50000000`	`2564.50000000`	`2564.50000000`	`2564.50000000`	`0.0000`	`0.0000`
`RSyn0840M04M (max)`	`25.2500`	`7575.0000`	`0.003`	`2564.50000000`	`2301.43000000`	`2564.50000000`	`12846.10000000`	`0.0000`	`0.8208`
`RSyn0840M (max)`	`0.9470`	`11688.7000`	`0.000`	`325.55500000`	`247.39700000`	`325.55500000`	`1497.16000000`	`0.0000`	`0.8348`
`SLay05H`	`0.8580`	`22.2240`	`0.039`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`0.0000`	`0.0000`
`SLay05M`	`0.2550`	`2.3020`	`0.111`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`0.0000`	`0.0000`
`SLay06H`	`3.3740`	`387.8510`	`0.009`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`0.0000`	`0.0000`
`SLay06M`	`0.7360`	`1.1210`	`0.657`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`0.0000`	`0.0000`
`SLay07H`	`10.1450`	`7383.1600`	`0.001`	`64748.80000000`	`64748.80000000`	`64748.80000000`	`64698.40000000`	`0.0000`	`0.0008`
`SLay07M`	`1.2450`	`13.6680`	`0.091`	`64748.80000000`	`64748.80000000`	`64748.80000000`	`64748.80000000`	`0.0000`	`0.0000`
`SLay08H`	`35.0140`	`7413.2200`	`0.005`	`84960.20000000`	`85115.00000000`	`84960.20000000`	`82023.90000000`	`0.0000`	`0.0377`
`SLay08M`	`4.0190`	`4.8160`	`0.835`	`84960.20000000`	`84960.20000000`	`84960.20000000`	`84960.20000000`	`0.0000`	`0.0000`
`SLay09H`	`164.5140`	`7412.7900`	`0.022`	`107806.00000000`	`122507.00000000`	`107806.00000000`	`103264.00000000`	`0.0000`	`0.1863`
`SLay09M`	`23.3270`	`330.1600`	`0.071`	`107806.00000000`	`107806.00000000`	`107806.00000000`	`107806.00000000`	`0.0000`	`0.0000`
`SLay10H`	`7226.3200`	`7356.2200`	---	`mstat(14) sstat(3)`	`153256.00000000`	---	`119326.00000000`	`---`	`0.2843`
`SLay10M`	`1865.1800`	`538.4240`	`3.464`	`129580.00000000`	`129580.00000000`	`129580.00000000`	`129580.00000000`	`0.0000`	`0.0000`
`Syn10H (max)`	`0.0790`	`0.1120`	`0.705`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`0.0000`	`0.0000`
`Syn10M02H (max)`	`0.1040`	`0.2850`	`0.365`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`0.0000`	`0.0000`
`Syn10M02M (max)`	`0.0870`	`3.3410`	`0.026`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`0.0000`	`0.0000`
`Syn10M03H (max)`	`0.2390`	`0.4480`	`0.533`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`0.0000`	`0.0000`
`Syn10M03M (max)`	`0.0940`	`13.2780`	`0.007`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`0.0000`	`0.0000`
`Syn10M04H (max)`	`0.2800`	`0.5910`	`0.474`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`0.0000`	`0.0000`
`Syn10M04M (max)`	`0.2310`	`58.3070`	`0.004`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`0.0000`	`0.0000`
`Syn10M (max)`	`0.0730`	`0.2170`	`0.336`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`0.0000`	`0.0000`
`Syn20H (max)`	`0.1130`	`0.2040`	`0.554`	`924.26300000`	`924.26300000`	`924.26300000`	`924.26300000`	`0.0000`	`0.0000`
`Syn20M02H (max)`	`0.2350`	`0.9990`	`0.235`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`0.0000`	`0.0000`
`Syn20M02M (max)`	`0.2670`	`819.5300`	`0.000`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`0.0000`	`0.0000`
`Syn20M03H (max)`	`0.4420`	`1.1720`	`0.377`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`0.0000`	`0.0000`
`Syn20M03M (max)`	`0.3560`	`7954.4200`	`0.000`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`2658.98000000`	`0.0000`	`0.0045`
`Syn20M04H (max)`	`0.5890`	`1.7440`	`0.338`	`3532.74000000`	`3532.74000000`	`3532.74000000`	`3532.74000000`	`0.0000`	`0.0000`
`Syn20M04M (max)`	`0.4250`	`7781.6900`	`0.000`	`3532.74000000`	`3500.74000000`	`3532.74000000`	`4698.66000000`	`0.0000`	`0.2549`
`Syn20M (max)`	`0.1580`	`3.3160`	`0.048`	`924.26300000`	`924.26300000`	`924.26300000`	`924.26300000`	`0.0000`	`0.0000`
`Syn40H (max)`	`0.7120`	`0.8680`	`0.820`	`67.71340000`	`67.71340000`	`67.71340000`	`67.71340000`	`0.0000`	`0.0000`
`Syn40M02H (max)`	`0.6510`	`3.8970`	`0.167`	`388.77300000`	`388.77300000`	`388.77300000`	`388.77300000`	`0.0000`	`0.0000`
`Syn40M02M (max)`	`0.5770`	`8804.5400`	`0.000`	`388.77200000`	`344.48700000`	`388.77200000`	`1726.45000000`	`0.0000`	`0.8005`
`Syn40M03H (max)`	`1.2760`	`16.2270`	`0.079`	`395.14900000`	`395.14900000`	`395.14900000`	`395.14900000`	`0.0000`	`0.0000`
`Syn40M03M (max)`	`1.0780`	`7548.5800`	`0.000`	`395.14800000`	`294.29000000`	`395.14800000`	`4342.80000000`	`0.0000`	`0.9322`
`Syn40M04H (max)`	`1.8580`	`60.9210`	`0.030`	`901.75200000`	`901.75200000`	`901.75200000`	`901.75200000`	`0.0000`	`0.0000`
`Syn40M04M (max)`	`1.2810`	`7557.2600`	`0.000`	`901.75100000`	`831.89600000`	`901.75100000`	`5965.61000000`	`0.0000`	`0.8606`
`Syn40M (max)`	`0.2920`	`10415.2000`	`0.000`	`67.71330000`	`67.71330000`	`67.71330000`	`257.14600000`	`0.0000`	`0.7367`
`sssd-8-4-3`	`1.2580`	`931.0760`	`0.001`	`197181.00000000`	`197181.00000000`	`197181.00000000`	`197181.00000000`	`0.0000`	`0.0000`
`sssd-10-4-3`	`1.7300`	`12944.6000`	`0.000`	`152710.00000000`	`159329.00000000`	`152710.00000000`	`143244.00000000`	`0.0000`	`0.1123`
`sssd-12-5-3`	`10.4130`	`19374.5000`	`0.001`	`261143.00000000`	`330320.00000000`	`261143.00000000`	`101530.00000000`	`0.0000`	`2.2534`
`sssd-15-6-3`	`41.0080`	`15779.7000`	`0.003`	`440711.00000000`	`513871.00000000`	`440711.00000000`	`155381.00000000`	`0.0000`	`2.3072`
`sssd-16-8-3`	`338.5340`	`13118.5000`	`0.026`	`615763.00000000`	`709652.00000000`	`615763.00000000`	`223552.00000000`	`0.0000`	`2.1744`
`sssd-18-8-3`	`1244.5200`	`12851.3000`	`0.097`	`524063.00000000`	`637320.00000000`	`524063.00000000`	`192178.00000000`	`0.0000`	`2.3163`
`sssd-20-9-3`	`7279.6900`	`11853.3000`	---	`mstat(14) sstat(3)`	`510261.00000000`	---	`180409.00000000`	`---`	`1.8284`
`sssd-22-8-3`	`7307.2200`	`12055.5000`	---	`mstat(14) sstat(3)`	`730203.00000000`	---	`216626.00000000`	`---`	`2.3708`
`uflquad-15-60`	`1331.2400`	`15.8290`	`84.101`	`1063.19000000`	`1063.19000000`	`1063.19000000`	`1063.19000000`	`0.0000`	`0.0000`
`uflquad-15-80`	`6321.9900`	`37.1940`	`169.973`	`1217.99000000`	`1217.99000000`	`1217.99000000`	`1217.99000000`	`0.0000`	`0.0000`
`uflquad-20-40`	`1139.1300`	`19.0030`	`59.945`	`860.96100000`	`860.96100000`	`860.96100000`	`860.96100000`	`0.0000`	`0.0000`
`uflquad-20-50`	`7220.7100`	`1623.3800`	---	`mstat(14) sstat(3)`	`375.91900000`	---	`375.91900000`	`---`	`0.0000`
`uflquad-25-25`	`187.6740`	`5.7650`	`32.554`	`673.69700000`	`673.69700000`	`673.69700000`	`673.69700000`	`0.0000`	`0.0000`
`uflquad-25-30`	`177.6590`	`4.6730`	`38.018`	`669.84000000`	`669.84000000`	`669.84000000`	`669.84000000`	`0.0000`	`0.0000`
`uflquad-25-40`	`2968.5600`	`27.5040`	`107.932`	`828.16500000`	`828.16500000`	`828.16500000`	`828.16500000`	`0.0000`	`0.0000`
`nd-10`	`34.4900`	`472.2360`	`0.073`	`52.46110000`	`52.46110000`	`52.46110000`	`52.46110000`	`0.0000`	`0.0000`
`nd-12`	`12.4500`	`2721.8200`	`0.005`	`56.66960000`	`56.66960000`	`56.66960000`	`56.66960000`	`0.0000`	`0.0000`
`nd-13`	`969.3710`	`7251.3700`	`0.134`	`63.00510000`	`65.90790000`	`63.00510000`	`54.66070000`	`0.0000`	`0.2058`
`nd-15`	`1715.8700`	`7230.4100`	---	`mstat(13) sstat(1)`	`86.92650000`	---	`65.11490000`	`---`	`0.3350`
`nd-16`	`1511.5300`	`7227.5800`	`0.209`	`97.97920000`	`102.09800000`	`97.97920000`	`78.22420000`	`0.0000`	`0.3052`
`fo7_2`	`12.2390`	`7403.9100`	`0.002`	`17.74930000`	`17.74930000`	`17.74930000`	`11.09430000`	`0.0000`	`0.5999`
`fo7_ar2_1`	`9.6780`	`7545.5400`	`0.001`	`24.83980000`	`34.87130000`	`24.83980000`	`19.42240000`	`0.0000`	`0.7954`
`fo7_ar25_1`	`12.1740`	`7414.1500`	`0.002`	`23.09360000`	`25.67840000`	`23.09360000`	`17.25980000`	`0.0000`	`0.4878`
`fo7_ar3_1`	`15.4120`	`7413.0500`	`0.002`	`22.51750000`	`23.12100000`	`22.51750000`	`15.69890000`	`0.0000`	`0.4728`
`fo7_ar4_1`	`11.5850`	`7368.0300`	`0.002`	`20.72980000`	`29.47550000`	`20.72980000`	`14.72570000`	`0.0000`	`1.0016`
`fo7_ar5_1`	`4.2450`	`7340.0900`	`0.001`	`17.74930000`	`19.01200000`	`17.74930000`	`14.63770000`	`0.0000`	`0.2988`
`fo7`	`37.0670`	`7431.2200`	`0.005`	`20.72980000`	`28.45230000`	`20.72980000`	`10.19240000`	`0.0000`	`1.7915`
`fo8_ar2_1`	`52.4780`	`7498.4800`	`0.007`	`30.34060000`	`48.41990000`	`30.34060000`	`16.71750000`	`0.0000`	`1.8964`
`fo8_ar25_1`	`87.1140`	`7372.1000`	`0.012`	`28.04520000`	`41.63040000`	`28.04520000`	`14.27250000`	`0.0000`	`1.9168`
`fo8_ar3_1`	`12.0520`	`7329.2200`	`0.002`	`23.91010000`	`40.79120000`	`23.91010000`	`11.67870000`	`0.0000`	`2.4928`
`fo8_ar4_1`	`6.9970`	`7294.2400`	`0.001`	`22.38190000`	`33.46530000`	`22.38190000`	`11.17020000`	`0.0000`	`1.9959`
`fo8_ar5_1`	`22.0040`	`7299.6800`	`0.003`	`22.38190000`	`45.65780000`	`22.38190000`	`12.09400000`	`0.0000`	`2.7752`
`fo8`	`130.2710`	`7381.7800`	`0.018`	`22.38190000`	`41.06960000`	`22.38190000`	`7.74500000`	`0.0000`	`4.3027`
`fo9_ar2_1`	`277.8710`	`7424.3900`	---	`32.62500000`	`mstat(14) sstat(3)`	`32.62500000`	---	`0.0000`	`---`
`fo9_ar25_1`	`1307.2300`	`7375.1300`	---	`32.18640000`	`mstat(14) sstat(3)`	`32.18640000`	---	`0.0000`	`---`
`fo9_ar3_1`	`41.5170`	`7292.3500`	---	`24.81550000`	`mstat(14) sstat(3)`	`24.81550000`	---	`0.0000`	`---`
`fo9_ar4_1`	`31.7720`	`7268.4700`	---	`23.46430000`	`mstat(14) sstat(3)`	`23.46430000`	---	`0.0000`	`---`
`fo9_ar5_1`	`104.1320`	`7263.1100`	`0.014`	`23.46430000`	`41.66030000`	`23.46430000`	`7.82468000`	`0.0000`	`4.3242`
`fo9`	`475.5770`	`7344.6400`	`0.065`	`23.46430000`	`49.96150000`	`23.46430000`	`6.50795000`	`0.0000`	`6.6770`
`m3`	`0.1210`	`0.4660`	`0.260`	`37.80000000`	`37.80000000`	`37.80000000`	`37.80000000`	`0.0000`	`0.0000`
`m6`	`0.3750`	`1321.2900`	`0.000`	`82.25690000`	`82.25690000`	`82.25690000`	`82.25690000`	`0.0000`	`0.0000`
`m7_ar2_1`	`2.4430`	`2283.0700`	`0.001`	`190.23500000`	`190.23500000`	`190.23500000`	`190.23500000`	`0.0000`	`0.0000`
`m7_ar25_1`	`0.7410`	`4391.6700`	`0.000`	`143.58500000`	`143.58500000`	`143.58500000`	`143.58500000`	`0.0000`	`0.0000`
`m7_ar3_1`	`2.2540`	`7479.4900`	`0.000`	`143.58500000`	`143.58500000`	`143.58500000`	`119.94100000`	`0.0000`	`0.1971`
`m7_ar4_1`	`0.2950`	`7134.8100`	`0.000`	`106.75700000`	`106.75700000`	`106.75700000`	`106.75700000`	`0.0000`	`0.0000`
`m7_ar5_1`	`1.5140`	`7336.1600`	`0.000`	`106.46000000`	`106.46000000`	`106.46000000`	`94.28920000`	`0.0000`	`0.1291`
`m7`	`0.9230`	`7448.1800`	`0.000`	`106.75700000`	`106.75700000`	`106.75700000`	`98.71500000`	`0.0000`	`0.0815`
`netmod_dol1`	`7220.1600`	`7214.8800`	---	`mstat(14) sstat(3)`	`-0.55139800`	---	`-0.65233400`	`---`	`0.1547`
`netmod_dol2`	`235.5120`	`5.3840`	---	`-0.56000800`	`mstat(13) sstat(13)`	`-0.56000800`	---	`0.0000`	`---`
`netmod_kar1`	`80.3490`	`204.3500`	`0.393`	`-0.41979000`	`-0.41979000`	`-0.41979000`	`-0.41979000`	`0.0000`	`0.0000`
`netmod_kar2`	`80.1860`	`202.6730`	`0.396`	`-0.41979000`	`-0.41979000`	`-0.41979000`	`-0.41979000`	`0.0000`	`0.0000`
`no7_ar2_1`	`7.2730`	`7471.5700`	`0.001`	`107.81500000`	`151.86000000`	`107.81500000`	`71.94960000`	`0.0000`	`1.1106`
`no7_ar25_1`	`23.0790`	`7380.7300`	`0.003`	`107.81500000`	`148.78600000`	`107.81500000`	`60.32300000`	`0.0000`	`1.4665`
`no7_ar3_1`	`77.2440`	`7374.7100`	`0.010`	`107.81500000`	`134.42700000`	`107.81500000`	`56.45360000`	`0.0000`	`1.3812`
`no7_ar4_1`	`74.2580`	`7367.5900`	`0.010`	`98.51840000`	`120.70100000`	`98.51840000`	`55.14560000`	`0.0000`	`1.1888`
`no7_ar5_1`	`70.2040`	`7343.6400`	`0.010`	`90.62270000`	`118.38200000`	`90.62270000`	`50.43270000`	`0.0000`	`1.3473`
`o7_2`	`518.8520`	`7409.9700`	`0.070`	`116.94600000`	`122.35300000`	`116.94600000`	`59.31550000`	`0.0000`	`1.0627`
`o7_ar2_1`	`52.5910`	`7458.1000`	`0.007`	`140.41200000`	`177.94600000`	`140.41200000`	`81.91440000`	`0.0000`	`1.1723`
`o7_ar25_1`	`239.0250`	`7424.6000`	`0.032`	`140.41200000`	`180.92200000`	`140.41200000`	`78.99120000`	`0.0000`	`1.2904`
`o7_ar3_1`	`477.7380`	`7369.9300`	`0.065`	`137.93200000`	`163.97700000`	`137.93200000`	`77.16780000`	`0.0000`	`1.1249`
`o7_ar4_1`	`1632.0700`	`7346.2800`	`0.222`	`131.65300000`	`183.00000000`	`131.65300000`	`69.24490000`	`0.0000`	`1.6428`
`o7_ar5_1`	`333.8150`	`7350.2000`	`0.045`	`116.94600000`	`129.23900000`	`116.94600000`	`74.41120000`	`0.0000`	`0.7368`
`o7`	`2462.8400`	`7424.4200`	`0.332`	`131.65300000`	`165.39600000`	`131.65300000`	`51.96060000`	`0.0000`	`2.1831`
`o8_ar4_1`	`5426.3700`	`7302.2300`	`0.743`	`243.07100000`	`304.80900000`	`243.07100000`	`108.77000000`	`0.0000`	`1.8023`
`o9_ar4_1`	`7245.7900`	`7297.6900`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`tls12`	`7221.1400`	`7667.1300`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`tls2`	`0.3770`	`4.2320`	`0.089`	`5.30000000`	`5.30000000`	`5.30000000`	`5.30000000`	`0.0000`	`0.0000`
`tls4`	`236.7010`	`15208.6000`	`0.016`	`8.30000000`	`13.70000000`	`8.30000000`	`2.27539000`	`0.0000`	`5.0209`
`tls5`	`7225.8400`	`10552.2000`	---	`mstat(14) sstat(3)`	`15.60000000`	---	`1.81080000`	`---`	`7.6150`
`tls6`	`7223.9800`	`9148.5200`	---	`mstat(14) sstat(3)`	`21.40000000`	---	`1.92937000`	`---`	`10.0917`
`tls7`	`7224.8500`	`8474.5600`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
Shifted Geometric Mean (Solved)	50.43	1170.83
% Unsolved	8.39%	49.68%