Solver Square Comparison

Solver Square Comparison: Considers all models.

Results created on 09/14/12 19:33:53 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver BONMIN_bonmin-oa is represented on the left (rows) and solver BONMIN_bonmin-bb on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number	Filename
Tracefile 1:	minlpconvex_bonmin-oa.pav
Tracefile 2:	minlpconvex_bonmin-bb.pav
Solvers used :	BONMIN_bonmin-oa
	BONMIN_bonmin-bb
Modeltype(s)	`MINLP`

	BONMIN_bonmin-bb: optimal	BONMIN_bonmin-bb: locally optimal	BONMIN_bonmin-bb: feasible	BONMIN_bonmin-bb: infeasible	BONMIN_bonmin-bb: unbounded	BONMIN_bonmin-bb: fail	BONMIN_bonmin-bb: no data	total BONMIN_bonmin-oa
BONMIN_bonmin-oa: optimal	`71`	-	`9`	-	-	`2`	-	`82`
BONMIN_bonmin-oa: locally optimal	-	-	-	-	-	-	-	`-`
BONMIN_bonmin-oa: feasible	-	-	-	-	-	-	-	`-`
BONMIN_bonmin-oa: infeasible	-	-	-	-	-	-	-	`-`
BONMIN_bonmin-oa: unbounded	-	-	-	-	-	-	-	`-`
BONMIN_bonmin-oa: fail	`19`	-	`43`	-	-	`11`	-	`73`
BONMIN_bonmin-oa: no data	-	-	-	-	-	-	-	`-`
total BONMIN_bonmin-bb	`90`	`-`	`52`	`-`	`-`	`13`	`-`	`155`

Solver return definitions:

Outcome	Model Status	Solver Status
optimal	1 or 15	1
locally optimal	2	any
feasible	8 or 16	1 or 2 or 3 or 4 or 5
infeasible	4 or 5 or 10 or 19	1
unbounded	3 or 18	1
fail	all other	all other

Solver Resource Times

Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.50E-04. If both solutions are less than 1e-1, we use the absolute difference.
Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

BONMIN_bonmin-oa: optimal -- BONMIN_bonmin-bb: optimal

Modelname	Time (BONMIN_bonmin-oa)	Time (BONMIN_bonmin-bb)	Ratio (BONMIN_bonmin-oa/BONMIN_bonmin-bb)	Obj (BONMIN_bonmin-oa)	Obj (BONMIN_bonmin-bb)
`BatchS101006M`	`443.5540`	`18.3460`	`24.177`	`769440.00000000`	`769440.00000000`
`BatchS121208M`	`655.4940`	`37.3690`	`17.541`	`1241130.00000000`	`1241130.00000000`
`BatchS151208M`	`4421.2200`	`110.9250`	`39.858`	`1543470.00000000`	`1543470.00000000`
`clay0203h`	`3.1620`	`6.8740`	`0.460`	`41573.30000000`	`41573.30000000`
`clay0203m`	`2.1970`	`4.2890`	`0.512`	`41573.30000000`	`41573.30000000`
`clay0204h`	`7.6910`	`52.7820`	`0.146`	`6545.00000000`	`6545.00000000`
`clay0204m`	`3.3410`	`9.1500`	`0.365`	`6545.00000000`	`6545.00000000`
`clay0205h`	`1044.7000`	`1775.5400`	`0.588`	`8092.50000000`	`8092.50000000`
`clay0205m`	`122.4660`	`708.5470`	`0.173`	`8092.50000000`	`8092.50000000`
`clay0303h`	`5.9620`	`18.6050`	`0.320`	`26669.10000000`	`26669.10000000`
`clay0303m`	`5.6360`	`5.5580`	`1.014`	`26669.10000000`	`26669.10000000`
`clay0304h`	`263.1000`	`208.0350`	`1.265`	`40262.40000000`	`40262.40000000`
`clay0304m`	`304.5220`	`61.5350`	`4.949`	`40262.40000000`	`40262.40000000`
`clay0305h`	`3838.3900`	`1662.5000`	`2.309`	`8092.50000000`	`8092.50000000`
`clay0305m`	`258.4510`	`250.6350`	`1.031`	`8092.50000000`	`8092.50000000`
`FLay03H`	`1.9810`	`2.2550`	`0.878`	`48.98980000`	`48.98980000`
`FLay03M`	`0.7030`	`0.8650`	`0.813`	`48.98980000`	`48.98980000`
`FLay04H`	`188.1580`	`38.9700`	`4.828`	`54.40590000`	`54.40590000`
`FLay04M`	`21.4410`	`12.8400`	`1.670`	`54.40590000`	`54.40590000`
`RSyn0810H`	`0.3760`	`3.0840`	`0.122`	`1721.45000000`	`1721.45000000`
`RSyn0810M02H`	`3.1690`	`18.2470`	`0.174`	`1741.39000000`	`1741.39000000`
`RSyn0810M03H`	`16.1540`	`53.8100`	`0.300`	`2722.45000000`	`2722.45000000`
`RSyn0810M04H`	`5.9150`	`30.9780`	`0.191`	`6581.94000000`	`6581.94000000`
`RSyn0810M`	`5.4510`	`450.3500`	`0.012`	`1721.45000000`	`1721.45000000`
`RSyn0820H`	`2.8310`	`5.5110`	`0.514`	`1150.30000000`	`1150.30000000`
`RSyn0820M02H`	`4.7770`	`22.9370`	`0.208`	`1092.09000000`	`1092.09000000`
`RSyn0820M03H`	`40.6240`	`75.2470`	`0.540`	`2028.81000000`	`2028.81000000`
`RSyn0820M04H`	`23.8390`	`91.3950`	`0.261`	`2450.77000000`	`2450.77000000`
`RSyn0820M`	`26.1020`	`3363.6400`	`0.008`	`1150.30000000`	`1150.30000000`
`RSyn0840H`	`0.9380`	`3.7300`	`0.251`	`325.55500000`	`325.55500000`
`RSyn0840M02H`	`2.6350`	`23.3200`	`0.113`	`734.98400000`	`734.98400000`
`RSyn0840M03H`	`16.8210`	`66.9090`	`0.251`	`2742.65000000`	`2742.65000000`
`RSyn0840M04H`	`20.5300`	`240.4630`	`0.085`	`2564.50000000`	`2564.50000000`
`SLay05H`	`17.2600`	`4.4500`	`3.879`	`22664.70000000`	`22664.70000000`
`SLay05M`	`2.3100`	`2.5770`	`0.896`	`22664.70000000`	`22664.70000000`
`SLay06H`	`1071.9600`	`54.5440`	`19.653`	`32757.00000000`	`32757.00000000`
`SLay06M`	`5.9020`	`27.4070`	`0.215`	`32757.00000000`	`32757.00000000`
`SLay07M`	`75.2940`	`66.4610`	`1.133`	`64748.80000000`	`64748.80000000`
`SLay08M`	`4354.4900`	`67.5310`	`64.481`	`84960.20000000`	`84960.20000000`
`Syn10H`	`0.1470`	`0.3520`	`0.418`	`1267.35000000`	`1267.35000000`
`Syn10M02H`	`0.2170`	`0.3180`	`0.682`	`2310.30000000`	`2310.30000000`
`Syn10M02M`	`0.3820`	`4.5530`	`0.084`	`2310.30000000`	`2310.30000000`
`Syn10M03H`	`0.2580`	`0.7190`	`0.359`	`3354.68000000`	`3354.68000000`
`Syn10M03M`	`1.2110`	`19.6690`	`0.062`	`3354.68000000`	`3354.68000000`
`Syn10M04H`	`0.2430`	`1.0620`	`0.229`	`4557.06000000`	`4557.06000000`
`Syn10M04M`	`1.1090`	`56.4720`	`0.020`	`4557.06000000`	`4557.06000000`
`Syn10M`	`0.1230`	`0.6270`	`0.196`	`1267.35000000`	`1267.35000000`
`Syn20H`	`0.2340`	`0.4150`	`0.564`	`924.26300000`	`924.26300000`
`Syn20M02H`	`0.5260`	`2.2460`	`0.234`	`1752.13000000`	`1752.13000000`
`Syn20M02M`	`1.7920`	`458.7050`	`0.004`	`1752.13000000`	`1752.13000000`
`Syn20M03H`	`0.3970`	`4.2170`	`0.094`	`2646.95000000`	`2646.95000000`
`Syn20M04H`	`0.6710`	`7.6110`	`0.088`	`3532.74000000`	`3532.74000000`
`Syn20M`	`0.3360`	`4.8100`	`0.070`	`924.26300000`	`924.26300000`
`Syn40H`	`0.9220`	`1.5330`	`0.601`	`67.71340000`	`67.71340000`
`Syn40M02H`	`1.4350`	`3.5190`	`0.408`	`388.77300000`	`388.77300000`
`Syn40M03H`	`5.6220`	`17.1110`	`0.329`	`395.14900000`	`395.14900000`
`Syn40M04H`	`16.9830`	`53.4430`	`0.318`	`901.75200000`	`901.75200000`
`Syn40M`	`1.7210`	`973.0320`	`0.002`	`67.71330000`	`67.71330000`
`sssd-8-4-3`	`24.5310`	`9.6910`	`2.531`	`197181.00000000`	`197181.00000000`
`sssd-10-4-3`	`295.4730`	`12.5650`	`23.516`	`152710.00000000`	`152710.00000000`
`uflquad-25-25`	`3815.8500`	`10.5160`	`362.861`	`673.69700000`	`673.69700000`
`uflquad-25-30`	`3352.3800`	`12.5240`	`267.676`	`669.84000000`	`669.84000000`
`nd-10`	`448.2020`	`1189.2800`	`0.377`	`52.46110000`	`52.46110000`
`fo7_2`	`2450.5400`	`2031.2700`	`1.206`	`17.74930000`	`17.74930000`
`fo7_ar5_1`	`3347.9200`	`4544.9200`	`0.737`	`17.74930000`	`17.74930000`
`m3`	`0.1970`	`1.3530`	`0.146`	`37.80000000`	`37.80000000`
`m6`	`19.7720`	`46.2730`	`0.427`	`82.25690000`	`82.25690000`
`m7_ar2_1`	`150.4520`	`2569.7700`	`0.059`	`190.23500000`	`190.23500000`
`m7_ar25_1`	`51.6280`	`166.4970`	`0.310`	`143.58500000`	`143.58500000`
`m7`	`140.0070`	`507.3050`	`0.276`	`106.75700000`	`106.75700000`
`tls2`	`0.9500`	`5.9730`	`0.159`	`5.30000000`	`5.30000000`

BONMIN_bonmin-oa: optimal -- BONMIN_bonmin-bb: feasible

Modelname	Time (BONMIN_bonmin-oa)	Time (BONMIN_bonmin-bb)	Ratio (BONMIN_bonmin-oa/BONMIN_bonmin-bb)	Obj (BONMIN_bonmin-oa)	Obj (BONMIN_bonmin-bb)
`RSyn0810M02M`	`1576.3700`	`7375.6600`	`0.214`	`1741.39000000`	`1712.69000000`
`RSyn0840M02M`	`4692.2000`	`7321.5600`	`0.641`	`734.98400000`	`636.57100000`
`RSyn0840M`	`71.2250`	`7448.0700`	`0.010`	`325.55500000`	`318.55500000`
`Syn40M02M`	`255.9740`	`7384.0100`	`0.035`	`388.77200000`	`360.41500000`
`nd-12`	`660.6810`	`7239.3100`	`0.091`	`56.66960000`	`58.30360000`
`fo7_ar2_1`	`7014.3900`	`7489.7600`	`0.937`	`24.83980000`	`24.83980000`
`m7_ar3_1`	`726.3280`	`7483.3400`	`0.097`	`143.58500000`	`143.58500000`
`m7_ar4_1`	`864.4930`	`7488.2500`	`0.115`	`106.75700000`	`148.62000000`
`m7_ar5_1`	`1070.7000`	`7487.6700`	`0.143`	`106.46000000`	`106.46000000`

BONMIN_bonmin-oa: optimal -- BONMIN_bonmin-bb: fail

Modelname	Time (BONMIN_bonmin-oa)	Time (BONMIN_bonmin-bb)	Ratio (BONMIN_bonmin-oa/BONMIN_bonmin-bb)	Obj (BONMIN_bonmin-oa)	Status (BONMIN_bonmin-bb)
`Syn20M03M`	`11.1250`	`4346.9500`	---	`2646.95000000`	`mstat(13)sstat( 1)`
`Syn20M04M`	`8.8990`	`12.8750`	---	`3532.74000000`	`mstat(13)sstat( 1)`

BONMIN_bonmin-oa: fail -- BONMIN_bonmin-bb: optimal

Modelname	Time (BONMIN_bonmin-oa)	Time (BONMIN_bonmin-bb)	Ratio (BONMIN_bonmin-oa/BONMIN_bonmin-bb)	Status (BONMIN_bonmin-oa)	Obj (BONMIN_bonmin-bb)
`BatchS201210M`	`7325.7400`	`144.9750`	---	`mstat(14)sstat( 3)`	`2295350.00000000`
`FLay05H`	`7414.4400`	`3506.4800`	---	`mstat(14)sstat( 3)`	`64.49810000`
`FLay05M`	`7392.0500`	`617.4280`	---	`mstat(14)sstat( 3)`	`64.49810000`
`SLay07H`	`7358.1300`	`67.9740`	---	`mstat(14)sstat( 3)`	`64748.80000000`
`SLay08H`	`7392.2500`	`69.2590`	---	`mstat(14)sstat( 3)`	`84960.20000000`
`SLay09H`	`7457.6700`	`79.2830`	---	`mstat(14)sstat( 3)`	`107806.00000000`
`SLay09M`	`7497.8700`	`69.8780`	---	`mstat(14)sstat( 3)`	`107806.00000000`
`SLay10H`	`7430.0300`	`336.6470`	---	`mstat(14)sstat( 3)`	`129580.00000000`
`SLay10M`	`7590.3000`	`144.9750`	---	`mstat(14)sstat( 3)`	`129580.00000000`
`sssd-12-5-3`	`7644.0900`	`52.5360`	---	`mstat(14)sstat( 3)`	`261143.00000000`
`sssd-15-6-3`	`7652.2600`	`231.9490`	---	`mstat(14)sstat( 3)`	`440711.00000000`
`uflquad-15-60`	`7313.5200`	`12.4560`	---	`mstat(14)sstat( 3)`	`1063.19000000`
`uflquad-15-80`	`7304.0200`	`22.6090`	---	`mstat(14)sstat( 3)`	`1217.99000000`
`uflquad-20-40`	`7323.5200`	`17.2550`	---	`mstat(14)sstat( 3)`	`860.96100000`
`uflquad-20-50`	`7309.2200`	`225.1360`	---	`mstat(14)sstat( 3)`	`375.91900000`
`uflquad-25-40`	`7311.1900`	`23.3470`	---	`mstat(14)sstat( 3)`	`828.16500000`
`netmod_dol2`	`7226.8800`	`1936.8100`	---	`mstat(14)sstat( 3)`	`-0.56000800`
`netmod_kar1`	`7342.0500`	`15.0230`	---	`mstat(14)sstat( 3)`	`-0.41979000`
`netmod_kar2`	`7340.4800`	`15.0430`	---	`mstat(14)sstat( 3)`	`-0.41979000`

BONMIN_bonmin-oa: fail -- BONMIN_bonmin-bb: feasible

Modelname	Time (BONMIN_bonmin-oa)	Time (BONMIN_bonmin-bb)	Ratio (BONMIN_bonmin-oa/BONMIN_bonmin-bb)	Status (BONMIN_bonmin-oa)	Obj (BONMIN_bonmin-bb)
`FLay06H`	`7444.9700`	`7394.3800`	---	`mstat(14)sstat( 3)`	`66.93280000`
`FLay06M`	`7509.8000`	`7661.7800`	---	`mstat(14)sstat( 3)`	`66.93280000`
`RSyn0810M03M`	`7502.6900`	`7323.3200`	---	`mstat(14)sstat( 3)`	`2712.25000000`
`RSyn0810M04M`	`7287.3300`	`7294.0800`	---	`mstat(14)sstat( 3)`	`6511.67000000`
`RSyn0820M02M`	`7628.2600`	`7354.5600`	---	`mstat(14)sstat( 3)`	`973.26200000`
`RSyn0820M03M`	`7489.7400`	`7306.8100`	---	`mstat(14)sstat( 3)`	`1952.37000000`
`RSyn0820M04M`	`7390.2200`	`7273.8100`	---	`mstat(14)sstat( 3)`	`2347.74000000`
`RSyn0840M03M`	`7529.0700`	`7282.9700`	---	`mstat(14)sstat( 3)`	`2643.92000000`
`RSyn0840M04M`	`7386.2300`	`7267.4400`	---	`mstat(14)sstat( 3)`	`2293.65000000`
`Syn40M03M`	`7316.0000`	`7331.7900`	---	`mstat(14)sstat( 3)`	`331.14400000`
`Syn40M04M`	`7366.7500`	`7295.7900`	---	`mstat(14)sstat( 3)`	`808.85200000`
`sssd-16-8-3`	`7560.7900`	`7649.9500`	---	`mstat(14)sstat( 3)`	`616043.00000000`
`sssd-18-8-3`	`7563.5400`	`7643.5000`	---	`mstat(14)sstat( 3)`	`524139.00000000`
`sssd-20-9-3`	`7579.0800`	`7616.2900`	---	`mstat(14)sstat( 3)`	`478924.00000000`
`sssd-22-8-3`	`7595.1700`	`7614.5400`	---	`mstat(14)sstat( 3)`	`596139.00000000`
`nd-13`	`7242.2500`	`7237.1500`	---	`mstat(14)sstat( 3)`	`64.98350000`
`nd-15`	`7317.9200`	`7227.0400`	---	`mstat(14)sstat( 3)`	`83.33530000`
`nd-16`	`7310.7200`	`7227.7000`	---	`mstat(14)sstat( 3)`	`99.04390000`
`fo7_ar25_1`	`7344.8200`	`7485.8900`	---	`mstat(14)sstat( 3)`	`25.58910000`
`fo7_ar3_1`	`7348.9900`	`7504.2700`	---	`mstat(14)sstat( 3)`	`24.19550000`
`fo7_ar4_1`	`7356.0500`	`7491.1600`	---	`mstat(14)sstat( 3)`	`20.72980000`
`fo7`	`7533.0200`	`7510.0700`	---	`mstat(14)sstat( 3)`	`20.72980000`
`fo8_ar2_1`	`7337.5900`	`7456.9100`	---	`mstat(14)sstat( 3)`	`48.68170000`
`fo8_ar3_1`	`7385.6400`	`7454.6600`	---	`mstat(14)sstat( 3)`	`39.65250000`
`fo8_ar4_1`	`7376.7900`	`7459.2200`	---	`mstat(14)sstat( 3)`	`28.46650000`
`fo8_ar5_1`	`7363.1100`	`7462.5000`	---	`mstat(14)sstat( 3)`	`24.42260000`
`fo8`	`7461.6700`	`7478.3600`	---	`mstat(14)sstat( 3)`	`26.86260000`
`fo9`	`7389.2400`	`7445.8100`	---	`mstat(14)sstat( 3)`	`30.46430000`
`netmod_dol1`	`7246.7400`	`7250.5400`	---	`mstat(14)sstat( 3)`	`-0.56000800`
`no7_ar2_1`	`7416.5100`	`7503.1200`	---	`mstat(14)sstat( 3)`	`125.58900000`
`no7_ar25_1`	`7478.8100`	`7492.9500`	---	`mstat(14)sstat( 3)`	`115.10000000`
`no7_ar3_1`	`7346.9800`	`7500.7900`	---	`mstat(14)sstat( 3)`	`117.22400000`
`no7_ar4_1`	`7509.2500`	`7496.5500`	---	`mstat(14)sstat( 3)`	`100.41900000`
`no7_ar5_1`	`7520.3100`	`7486.4200`	---	`mstat(14)sstat( 3)`	`90.62270000`
`o7_2`	`7491.1900`	`7514.5300`	---	`mstat(14)sstat( 3)`	`116.94600000`
`o7_ar2_1`	`7377.7100`	`7480.0300`	---	`mstat(14)sstat( 3)`	`153.24900000`
`o7_ar25_1`	`7508.8200`	`7497.6300`	---	`mstat(14)sstat( 3)`	`151.01400000`
`o7_ar3_1`	`7447.6000`	`7488.1600`	---	`mstat(14)sstat( 3)`	`146.09600000`
`o7_ar4_1`	`7486.9600`	`7482.3300`	---	`mstat(14)sstat( 3)`	`136.73100000`
`o7_ar5_1`	`7509.7000`	`7488.1200`	---	`mstat(14)sstat( 3)`	`118.76700000`
`o7`	`7602.1300`	`7521.1600`	---	`mstat(14)sstat( 3)`	`131.65300000`
`o8_ar4_1`	`7422.9300`	`7450.2100`	---	`mstat(14)sstat( 3)`	`298.51200000`
`tls4`	`7444.0400`	`7676.4700`	---	`mstat(14)sstat( 3)`	`8.30000000`

BONMIN_bonmin-oa: fail -- BONMIN_bonmin-bb: fail

Modelname	Time (BONMIN_bonmin-oa)	Time (BONMIN_bonmin-bb)	Ratio (BONMIN_bonmin-oa/BONMIN_bonmin-bb)	Status (BONMIN_bonmin-oa)	Status (BONMIN_bonmin-bb)
`fo8_ar25_1`	`7368.5500`	`7466.7000`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`fo9_ar2_1`	`7319.4100`	`7427.4000`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`fo9_ar25_1`	`7320.8600`	`7422.6000`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`fo9_ar3_1`	`7355.2500`	`7423.6500`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`fo9_ar4_1`	`7367.7300`	`7424.4900`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`fo9_ar5_1`	`7366.9600`	`7424.9100`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`o9_ar4_1`	`7408.1400`	`7422.0700`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`tls12`	`7447.2500`	`7370.2300`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`tls5`	`7519.4400`	`7597.7300`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`tls6`	`7442.1800`	`7535.5100`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`
`tls7`	`7301.9600`	`7489.1300`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`

BONMIN_bonmin-oa: optimal:

Modelname	Time (BONMIN_bonmin-oa)	Obj (BONMIN_bonmin-oa)
`BatchS101006M`	`443.5540`	`769440.00000000`
`BatchS121208M`	`655.4940`	`1241130.00000000`
`BatchS151208M`	`4421.2200`	`1543470.00000000`
`clay0203h`	`3.1620`	`41573.30000000`
`clay0203m`	`2.1970`	`41573.30000000`
`clay0204h`	`7.6910`	`6545.00000000`
`clay0204m`	`3.3410`	`6545.00000000`
`clay0205h`	`1044.7000`	`8092.50000000`
`clay0205m`	`122.4660`	`8092.50000000`
`clay0303h`	`5.9620`	`26669.10000000`
`clay0303m`	`5.6360`	`26669.10000000`
`clay0304h`	`263.1000`	`40262.40000000`
`clay0304m`	`304.5220`	`40262.40000000`
`clay0305h`	`3838.3900`	`8092.50000000`
`clay0305m`	`258.4510`	`8092.50000000`
`FLay03H`	`1.9810`	`48.98980000`
`FLay03M`	`0.7030`	`48.98980000`
`FLay04H`	`188.1580`	`54.40590000`
`FLay04M`	`21.4410`	`54.40590000`
`RSyn0810H`	`0.3760`	`1721.45000000`
`RSyn0810M02H`	`3.1690`	`1741.39000000`
`RSyn0810M02M`	`1576.3700`	`1741.39000000`
`RSyn0810M03H`	`16.1540`	`2722.45000000`
`RSyn0810M04H`	`5.9150`	`6581.94000000`
`RSyn0810M`	`5.4510`	`1721.45000000`
`RSyn0820H`	`2.8310`	`1150.30000000`
`RSyn0820M02H`	`4.7770`	`1092.09000000`
`RSyn0820M03H`	`40.6240`	`2028.81000000`
`RSyn0820M04H`	`23.8390`	`2450.77000000`
`RSyn0820M`	`26.1020`	`1150.30000000`
`RSyn0840H`	`0.9380`	`325.55500000`
`RSyn0840M02H`	`2.6350`	`734.98400000`
`RSyn0840M02M`	`4692.2000`	`734.98400000`
`RSyn0840M03H`	`16.8210`	`2742.65000000`
`RSyn0840M04H`	`20.5300`	`2564.50000000`
`RSyn0840M`	`71.2250`	`325.55500000`
`SLay05H`	`17.2600`	`22664.70000000`
`SLay05M`	`2.3100`	`22664.70000000`
`SLay06H`	`1071.9600`	`32757.00000000`
`SLay06M`	`5.9020`	`32757.00000000`
`SLay07M`	`75.2940`	`64748.80000000`
`SLay08M`	`4354.4900`	`84960.20000000`
`Syn10H`	`0.1470`	`1267.35000000`
`Syn10M02H`	`0.2170`	`2310.30000000`
`Syn10M02M`	`0.3820`	`2310.30000000`
`Syn10M03H`	`0.2580`	`3354.68000000`
`Syn10M03M`	`1.2110`	`3354.68000000`
`Syn10M04H`	`0.2430`	`4557.06000000`
`Syn10M04M`	`1.1090`	`4557.06000000`
`Syn10M`	`0.1230`	`1267.35000000`
`Syn20H`	`0.2340`	`924.26300000`
`Syn20M02H`	`0.5260`	`1752.13000000`
`Syn20M02M`	`1.7920`	`1752.13000000`
`Syn20M03H`	`0.3970`	`2646.95000000`
`Syn20M03M`	`11.1250`	`2646.95000000`
`Syn20M04H`	`0.6710`	`3532.74000000`
`Syn20M04M`	`8.8990`	`3532.74000000`
`Syn20M`	`0.3360`	`924.26300000`
`Syn40H`	`0.9220`	`67.71340000`
`Syn40M02H`	`1.4350`	`388.77300000`
`Syn40M02M`	`255.9740`	`388.77200000`
`Syn40M03H`	`5.6220`	`395.14900000`
`Syn40M04H`	`16.9830`	`901.75200000`
`Syn40M`	`1.7210`	`67.71330000`
`sssd-8-4-3`	`24.5310`	`197181.00000000`
`sssd-10-4-3`	`295.4730`	`152710.00000000`
`uflquad-25-25`	`3815.8500`	`673.69700000`
`uflquad-25-30`	`3352.3800`	`669.84000000`
`nd-10`	`448.2020`	`52.46110000`
`nd-12`	`660.6810`	`56.66960000`
`fo7_2`	`2450.5400`	`17.74930000`
`fo7_ar2_1`	`7014.3900`	`24.83980000`
`fo7_ar5_1`	`3347.9200`	`17.74930000`
`m3`	`0.1970`	`37.80000000`
`m6`	`19.7720`	`82.25690000`
`m7_ar2_1`	`150.4520`	`190.23500000`
`m7_ar25_1`	`51.6280`	`143.58500000`
`m7_ar3_1`	`726.3280`	`143.58500000`
`m7_ar4_1`	`864.4930`	`106.75700000`
`m7_ar5_1`	`1070.7000`	`106.46000000`
`m7`	`140.0070`	`106.75700000`
`tls2`	`0.9500`	`5.30000000`

BONMIN_bonmin-oa: fail:

Modelname	Time (BONMIN_bonmin-oa)	Status (BONMIN_bonmin-oa)
`BatchS201210M`	`--`	`mstat(14) sstat( 3)`
`FLay05H`	`--`	`mstat(14) sstat( 3)`
`FLay05M`	`--`	`mstat(14) sstat( 3)`
`FLay06H`	`--`	`mstat(14) sstat( 3)`
`FLay06M`	`--`	`mstat(14) sstat( 3)`
`RSyn0810M03M`	`--`	`mstat(14) sstat( 3)`
`RSyn0810M04M`	`--`	`mstat(14) sstat( 3)`
`RSyn0820M02M`	`--`	`mstat(14) sstat( 3)`
`RSyn0820M03M`	`--`	`mstat(14) sstat( 3)`
`RSyn0820M04M`	`--`	`mstat(14) sstat( 3)`
`RSyn0840M03M`	`--`	`mstat(14) sstat( 3)`
`RSyn0840M04M`	`--`	`mstat(14) sstat( 3)`
`SLay07H`	`--`	`mstat(14) sstat( 3)`
`SLay08H`	`--`	`mstat(14) sstat( 3)`
`SLay09H`	`--`	`mstat(14) sstat( 3)`
`SLay09M`	`--`	`mstat(14) sstat( 3)`
`SLay10H`	`--`	`mstat(14) sstat( 3)`
`SLay10M`	`--`	`mstat(14) sstat( 3)`
`Syn40M03M`	`--`	`mstat(14) sstat( 3)`
`Syn40M04M`	`--`	`mstat(14) sstat( 3)`
`sssd-12-5-3`	`--`	`mstat(14) sstat( 3)`
`sssd-15-6-3`	`--`	`mstat(14) sstat( 3)`
`sssd-16-8-3`	`--`	`mstat(14) sstat( 3)`
`sssd-18-8-3`	`--`	`mstat(14) sstat( 3)`
`sssd-20-9-3`	`--`	`mstat(14) sstat( 3)`
`sssd-22-8-3`	`--`	`mstat(14) sstat( 3)`
`uflquad-15-60`	`--`	`mstat(14) sstat( 3)`
`uflquad-15-80`	`--`	`mstat(14) sstat( 3)`
`uflquad-20-40`	`--`	`mstat(14) sstat( 3)`
`uflquad-20-50`	`--`	`mstat(14) sstat( 3)`
`uflquad-25-40`	`--`	`mstat(14) sstat( 3)`
`nd-13`	`--`	`mstat(14) sstat( 3)`
`nd-15`	`--`	`mstat(14) sstat( 3)`
`nd-16`	`--`	`mstat(14) sstat( 3)`
`fo7_ar25_1`	`--`	`mstat(14) sstat( 3)`
`fo7_ar3_1`	`--`	`mstat(14) sstat( 3)`
`fo7_ar4_1`	`--`	`mstat(14) sstat( 3)`
`fo7`	`--`	`mstat(14) sstat( 3)`
`fo8_ar2_1`	`--`	`mstat(14) sstat( 3)`
`fo8_ar25_1`	`--`	`mstat(14) sstat( 3)`
`fo8_ar3_1`	`--`	`mstat(14) sstat( 3)`
`fo8_ar4_1`	`--`	`mstat(14) sstat( 3)`
`fo8_ar5_1`	`--`	`mstat(14) sstat( 3)`
`fo8`	`--`	`mstat(14) sstat( 3)`
`fo9_ar2_1`	`--`	`mstat(14) sstat( 3)`
`fo9_ar25_1`	`--`	`mstat(14) sstat( 3)`
`fo9_ar3_1`	`--`	`mstat(14) sstat( 3)`
`fo9_ar4_1`	`--`	`mstat(14) sstat( 3)`
`fo9_ar5_1`	`--`	`mstat(14) sstat( 3)`
`fo9`	`--`	`mstat(14) sstat( 3)`
`netmod_dol1`	`--`	`mstat(14) sstat( 3)`
`netmod_dol2`	`--`	`mstat(14) sstat( 3)`
`netmod_kar1`	`--`	`mstat(14) sstat( 3)`
`netmod_kar2`	`--`	`mstat(14) sstat( 3)`
`no7_ar2_1`	`--`	`mstat(14) sstat( 3)`
`no7_ar25_1`	`--`	`mstat(14) sstat( 3)`
`no7_ar3_1`	`--`	`mstat(14) sstat( 3)`
`no7_ar4_1`	`--`	`mstat(14) sstat( 3)`
`no7_ar5_1`	`--`	`mstat(14) sstat( 3)`
`o7_2`	`--`	`mstat(14) sstat( 3)`
`o7_ar2_1`	`--`	`mstat(14) sstat( 3)`
`o7_ar25_1`	`--`	`mstat(14) sstat( 3)`
`o7_ar3_1`	`--`	`mstat(14) sstat( 3)`
`o7_ar4_1`	`--`	`mstat(14) sstat( 3)`
`o7_ar5_1`	`--`	`mstat(14) sstat( 3)`
`o7`	`--`	`mstat(14) sstat( 3)`
`o8_ar4_1`	`--`	`mstat(14) sstat( 3)`
`o9_ar4_1`	`--`	`mstat(14) sstat( 3)`
`tls12`	`--`	`mstat(14) sstat( 3)`
`tls4`	`--`	`mstat(14) sstat( 3)`
`tls5`	`--`	`mstat(14) sstat( 3)`
`tls6`	`--`	`mstat(14) sstat( 3)`
`tls7`	`--`	`mstat(14) sstat( 3)`

BONMIN_bonmin-bb: optimal:

Modelname	Time (BONMIN_bonmin-bb)	Obj (BONMIN_bonmin-bb)
`BatchS101006M`	`18.3460`	`769440.00000000`
`BatchS121208M`	`37.3690`	`1241130.00000000`
`BatchS151208M`	`110.9250`	`1543470.00000000`
`BatchS201210M`	`144.9750`	`2295350.00000000`
`clay0203h`	`6.8740`	`41573.30000000`
`clay0203m`	`4.2890`	`41573.30000000`
`clay0204h`	`52.7820`	`6545.00000000`
`clay0204m`	`9.1500`	`6545.00000000`
`clay0205h`	`1775.5400`	`8092.50000000`
`clay0205m`	`708.5470`	`8092.50000000`
`clay0303h`	`18.6050`	`26669.10000000`
`clay0303m`	`5.5580`	`26669.10000000`
`clay0304h`	`208.0350`	`40262.40000000`
`clay0304m`	`61.5350`	`40262.40000000`
`clay0305h`	`1662.5000`	`8092.50000000`
`clay0305m`	`250.6350`	`8092.50000000`
`FLay03H`	`2.2550`	`48.98980000`
`FLay03M`	`0.8650`	`48.98980000`
`FLay04H`	`38.9700`	`54.40590000`
`FLay04M`	`12.8400`	`54.40590000`
`FLay05H`	`3506.4800`	`64.49810000`
`FLay05M`	`617.4280`	`64.49810000`
`RSyn0810H`	`3.0840`	`1721.45000000`
`RSyn0810M02H`	`18.2470`	`1741.39000000`
`RSyn0810M03H`	`53.8100`	`2722.45000000`
`RSyn0810M04H`	`30.9780`	`6581.94000000`
`RSyn0810M`	`450.3500`	`1721.45000000`
`RSyn0820H`	`5.5110`	`1150.30000000`
`RSyn0820M02H`	`22.9370`	`1092.09000000`
`RSyn0820M03H`	`75.2470`	`2028.81000000`
`RSyn0820M04H`	`91.3950`	`2450.77000000`
`RSyn0820M`	`3363.6400`	`1150.30000000`
`RSyn0840H`	`3.7300`	`325.55500000`
`RSyn0840M02H`	`23.3200`	`734.98400000`
`RSyn0840M03H`	`66.9090`	`2742.65000000`
`RSyn0840M04H`	`240.4630`	`2564.50000000`
`SLay05H`	`4.4500`	`22664.70000000`
`SLay05M`	`2.5770`	`22664.70000000`
`SLay06H`	`54.5440`	`32757.00000000`
`SLay06M`	`27.4070`	`32757.00000000`
`SLay07H`	`67.9740`	`64748.80000000`
`SLay07M`	`66.4610`	`64748.80000000`
`SLay08H`	`69.2590`	`84960.20000000`
`SLay08M`	`67.5310`	`84960.20000000`
`SLay09H`	`79.2830`	`107806.00000000`
`SLay09M`	`69.8780`	`107806.00000000`
`SLay10H`	`336.6470`	`129580.00000000`
`SLay10M`	`144.9750`	`129580.00000000`
`Syn10H`	`0.3520`	`1267.35000000`
`Syn10M02H`	`0.3180`	`2310.30000000`
`Syn10M02M`	`4.5530`	`2310.30000000`
`Syn10M03H`	`0.7190`	`3354.68000000`
`Syn10M03M`	`19.6690`	`3354.68000000`
`Syn10M04H`	`1.0620`	`4557.06000000`
`Syn10M04M`	`56.4720`	`4557.06000000`
`Syn10M`	`0.6270`	`1267.35000000`
`Syn20H`	`0.4150`	`924.26300000`
`Syn20M02H`	`2.2460`	`1752.13000000`
`Syn20M02M`	`458.7050`	`1752.13000000`
`Syn20M03H`	`4.2170`	`2646.95000000`
`Syn20M04H`	`7.6110`	`3532.74000000`
`Syn20M`	`4.8100`	`924.26300000`
`Syn40H`	`1.5330`	`67.71340000`
`Syn40M02H`	`3.5190`	`388.77300000`
`Syn40M03H`	`17.1110`	`395.14900000`
`Syn40M04H`	`53.4430`	`901.75200000`
`Syn40M`	`973.0320`	`67.71330000`
`sssd-8-4-3`	`9.6910`	`197181.00000000`
`sssd-10-4-3`	`12.5650`	`152710.00000000`
`sssd-12-5-3`	`52.5360`	`261143.00000000`
`sssd-15-6-3`	`231.9490`	`440711.00000000`
`uflquad-15-60`	`12.4560`	`1063.19000000`
`uflquad-15-80`	`22.6090`	`1217.99000000`
`uflquad-20-40`	`17.2550`	`860.96100000`
`uflquad-20-50`	`225.1360`	`375.91900000`
`uflquad-25-25`	`10.5160`	`673.69700000`
`uflquad-25-30`	`12.5240`	`669.84000000`
`uflquad-25-40`	`23.3470`	`828.16500000`
`nd-10`	`1189.2800`	`52.46110000`
`fo7_2`	`2031.2700`	`17.74930000`
`fo7_ar5_1`	`4544.9200`	`17.74930000`
`m3`	`1.3530`	`37.80000000`
`m6`	`46.2730`	`82.25690000`
`m7_ar2_1`	`2569.7700`	`190.23500000`
`m7_ar25_1`	`166.4970`	`143.58500000`
`m7`	`507.3050`	`106.75700000`
`netmod_dol2`	`1936.8100`	`-0.56000800`
`netmod_kar1`	`15.0230`	`-0.41979000`
`netmod_kar2`	`15.0430`	`-0.41979000`
`tls2`	`5.9730`	`5.30000000`

BONMIN_bonmin-bb: feasible:

Modelname	Time (BONMIN_bonmin-bb)	Obj (BONMIN_bonmin-bb)
`FLay06H`	`7394.3800`	`66.93280000`
`FLay06M`	`7661.7800`	`66.93280000`
`RSyn0810M02M`	`7375.6600`	`1712.69000000`
`RSyn0810M03M`	`7323.3200`	`2712.25000000`
`RSyn0810M04M`	`7294.0800`	`6511.67000000`
`RSyn0820M02M`	`7354.5600`	`973.26200000`
`RSyn0820M03M`	`7306.8100`	`1952.37000000`
`RSyn0820M04M`	`7273.8100`	`2347.74000000`
`RSyn0840M02M`	`7321.5600`	`636.57100000`
`RSyn0840M03M`	`7282.9700`	`2643.92000000`
`RSyn0840M04M`	`7267.4400`	`2293.65000000`
`RSyn0840M`	`7448.0700`	`318.55500000`
`Syn40M02M`	`7384.0100`	`360.41500000`
`Syn40M03M`	`7331.7900`	`331.14400000`
`Syn40M04M`	`7295.7900`	`808.85200000`
`sssd-16-8-3`	`7649.9500`	`616043.00000000`
`sssd-18-8-3`	`7643.5000`	`524139.00000000`
`sssd-20-9-3`	`7616.2900`	`478924.00000000`
`sssd-22-8-3`	`7614.5400`	`596139.00000000`
`nd-12`	`7239.3100`	`58.30360000`
`nd-13`	`7237.1500`	`64.98350000`
`nd-15`	`7227.0400`	`83.33530000`
`nd-16`	`7227.7000`	`99.04390000`
`fo7_ar2_1`	`7489.7600`	`24.83980000`
`fo7_ar25_1`	`7485.8900`	`25.58910000`
`fo7_ar3_1`	`7504.2700`	`24.19550000`
`fo7_ar4_1`	`7491.1600`	`20.72980000`
`fo7`	`7510.0700`	`20.72980000`
`fo8_ar2_1`	`7456.9100`	`48.68170000`
`fo8_ar3_1`	`7454.6600`	`39.65250000`
`fo8_ar4_1`	`7459.2200`	`28.46650000`
`fo8_ar5_1`	`7462.5000`	`24.42260000`
`fo8`	`7478.3600`	`26.86260000`
`fo9`	`7445.8100`	`30.46430000`
`m7_ar3_1`	`7483.3400`	`143.58500000`
`m7_ar4_1`	`7488.2500`	`148.62000000`
`m7_ar5_1`	`7487.6700`	`106.46000000`
`netmod_dol1`	`7250.5400`	`-0.56000800`
`no7_ar2_1`	`7503.1200`	`125.58900000`
`no7_ar25_1`	`7492.9500`	`115.10000000`
`no7_ar3_1`	`7500.7900`	`117.22400000`
`no7_ar4_1`	`7496.5500`	`100.41900000`
`no7_ar5_1`	`7486.4200`	`90.62270000`
`o7_2`	`7514.5300`	`116.94600000`
`o7_ar2_1`	`7480.0300`	`153.24900000`
`o7_ar25_1`	`7497.6300`	`151.01400000`
`o7_ar3_1`	`7488.1600`	`146.09600000`
`o7_ar4_1`	`7482.3300`	`136.73100000`
`o7_ar5_1`	`7488.1200`	`118.76700000`
`o7`	`7521.1600`	`131.65300000`
`o8_ar4_1`	`7450.2100`	`298.51200000`
`tls4`	`7676.4700`	`8.30000000`

BONMIN_bonmin-bb: fail:

Modelname	Time (BONMIN_bonmin-bb)	Status (BONMIN_bonmin-bb)
`Syn20M03M`	`--`	`mstat(13)sstat( 1)`
`Syn20M04M`	`--`	`mstat(13)sstat( 1)`
`fo8_ar25_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar2_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar25_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar3_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar4_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar5_1`	`--`	`mstat(14)sstat( 3)`
`o9_ar4_1`	`--`	`mstat(14)sstat( 3)`
`tls12`	`--`	`mstat(14)sstat( 3)`
`tls5`	`--`	`mstat(14)sstat( 3)`
`tls6`	`--`	`mstat(14)sstat( 3)`
`tls7`	`--`	`mstat(14)sstat( 3)`

BONMIN_bonmin-oa: all -- BONMIN_bonmin-bb: all

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (7676.47 seconds). The shift is 10s.

Modelname	Time (BONMIN_bonmin-oa)	Time (BONMIN_bonmin-bb)	Ratio (BONMIN_bonmin-oa/ BONMIN_bonmin-bb)	Obj (BONMIN_bonmin-oa)	Obj (BONMIN_bonmin-bb)	ObjEst (BONMIN_bonmin-oa)	ObjEst (BONMIN_bonmin-bb)	Gap (BONMIN_bonmin-oa)	Gap (BONMIN_bonmin-bb)
`BatchS101006M`	`443.5540`	`18.3460`	`24.177`	`769440.00000000`	`769440.00000000`	`769440.00000000`	`769440.00000000`	`0.0000`	`0.0000`
`BatchS121208M`	`655.4940`	`37.3690`	`17.541`	`1241130.00000000`	`1241130.00000000`	`1241130.00000000`	`1241130.00000000`	`0.0000`	`0.0000`
`BatchS151208M`	`4421.2200`	`110.9250`	`39.858`	`1543470.00000000`	`1543470.00000000`	`1543470.00000000`	`1543470.00000000`	`0.0000`	`0.0000`
`BatchS201210M`	`7325.7400`	`144.9750`	---	`mstat(14) sstat(3)`	`2295350.00000000`	---	`2295350.00000000`	`---`	`0.0000`
`clay0203h`	`3.1620`	`6.8740`	`0.460`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`0.0000`	`0.0000`
`clay0203m`	`2.1970`	`4.2890`	`0.512`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`0.0000`	`0.0000`
`clay0204h`	`7.6910`	`52.7820`	`0.146`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`0.0000`	`0.0000`
`clay0204m`	`3.3410`	`9.1500`	`0.365`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`0.0000`	`0.0000`
`clay0205h`	`1044.7000`	`1775.5400`	`0.588`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0205m`	`122.4660`	`708.5470`	`0.173`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0303h`	`5.9620`	`18.6050`	`0.320`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`0.0000`	`0.0000`
`clay0303m`	`5.6360`	`5.5580`	`1.014`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`0.0000`	`0.0000`
`clay0304h`	`263.1000`	`208.0350`	`1.265`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`0.0000`	`0.0000`
`clay0304m`	`304.5220`	`61.5350`	`4.949`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`0.0000`	`0.0000`
`clay0305h`	`3838.3900`	`1662.5000`	`2.309`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0305m`	`258.4510`	`250.6350`	`1.031`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`FLay03H`	`1.9810`	`2.2550`	`0.878`	`48.98980000`	`48.98980000`	`48.98980000`	`48.98980000`	`0.0000`	`0.0000`
`FLay03M`	`0.7030`	`0.8650`	`0.813`	`48.98980000`	`48.98980000`	`48.98980000`	`48.98980000`	`0.0000`	`0.0000`
`FLay04H`	`188.1580`	`38.9700`	`4.828`	`54.40590000`	`54.40590000`	`54.40590000`	`54.40590000`	`0.0000`	`0.0000`
`FLay04M`	`21.4410`	`12.8400`	`1.670`	`54.40590000`	`54.40590000`	`54.40590000`	`54.40590000`	`0.0000`	`0.0000`
`FLay05H`	`7414.4400`	`3506.4800`	---	`mstat(14) sstat(3)`	`64.49810000`	---	`64.49810000`	`---`	`0.0000`
`FLay05M`	`7392.0500`	`617.4280`	---	`mstat(14) sstat(3)`	`64.49810000`	---	`64.49810000`	`---`	`0.0000`
`FLay06H`	`7444.9700`	`7394.3800`	---	`mstat(14) sstat(3)`	`66.93280000`	---	`60.00000000`	`---`	`0.1155`
`FLay06M`	`7509.8000`	`7661.7800`	---	`mstat(14) sstat(3)`	`66.93280000`	---	`64.49810000`	`---`	`0.0377`
`RSyn0810H (max)`	`0.3760`	`3.0840`	`0.122`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`0.0000`	`0.0000`
`RSyn0810M02H (max)`	`3.1690`	`18.2470`	`0.174`	`1741.39000000`	`1741.39000000`	`1741.39000000`	`1741.39000000`	`0.0000`	`0.0000`
`RSyn0810M02M (max)`	`1576.3700`	`7375.6600`	`0.214`	`1741.39000000`	`1712.69000000`	`1741.39000000`	`2660.89000000`	`0.0000`	`0.3563`
`RSyn0810M03H (max)`	`16.1540`	`53.8100`	`0.300`	`2722.45000000`	`2722.45000000`	`2722.45000000`	`2722.45000000`	`0.0000`	`0.0000`
`RSyn0810M03M (max)`	`7502.6900`	`7323.3200`	---	`mstat(14) sstat(3)`	`2712.25000000`	---	`3758.91000000`	`---`	`0.2784`
`RSyn0810M04H (max)`	`5.9150`	`30.9780`	`0.191`	`6581.94000000`	`6581.94000000`	`6581.94000000`	`6581.94000000`	`0.0000`	`0.0000`
`RSyn0810M04M (max)`	`7287.3300`	`7294.0800`	---	`mstat(14) sstat(3)`	`6511.67000000`	---	`8852.77000000`	`---`	`0.2644`
`RSyn0810M (max)`	`5.4510`	`450.3500`	`0.012`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`0.0000`	`0.0000`
`RSyn0820H (max)`	`2.8310`	`5.5110`	`0.514`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`0.0000`	`0.0000`
`RSyn0820M02H (max)`	`4.7770`	`22.9370`	`0.208`	`1092.09000000`	`1092.09000000`	`1092.09000000`	`1092.09000000`	`0.0000`	`0.0000`
`RSyn0820M02M (max)`	`7628.2600`	`7354.5600`	---	`mstat(14) sstat(3)`	`973.26200000`	---	`2383.29000000`	`---`	`0.5916`
`RSyn0820M03H (max)`	`40.6240`	`75.2470`	`0.540`	`2028.81000000`	`2028.81000000`	`2028.81000000`	`2028.81000000`	`0.0000`	`0.0000`
`RSyn0820M03M (max)`	`7489.7400`	`7306.8100`	---	`mstat(14) sstat(3)`	`1952.37000000`	---	`4591.76000000`	`---`	`0.5748`
`RSyn0820M04H (max)`	`23.8390`	`91.3950`	`0.261`	`2450.77000000`	`2450.77000000`	`2450.77000000`	`2450.77000000`	`0.0000`	`0.0000`
`RSyn0820M04M (max)`	`7390.2200`	`7273.8100`	---	`mstat(14) sstat(3)`	`2347.74000000`	---	`6735.90000000`	`---`	`0.6515`
`RSyn0820M (max)`	`26.1020`	`3363.6400`	`0.008`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`0.0000`	`0.0000`
`RSyn0840H (max)`	`0.9380`	`3.7300`	`0.251`	`325.55500000`	`325.55500000`	`325.55500000`	`325.55500000`	`0.0000`	`0.0000`
`RSyn0840M02H (max)`	`2.6350`	`23.3200`	`0.113`	`734.98400000`	`734.98400000`	`734.98400000`	`734.98400000`	`0.0000`	`0.0000`
`RSyn0840M02M (max)`	`4692.2000`	`7321.5600`	`0.641`	`734.98400000`	`636.57100000`	`734.98400000`	`3524.62000000`	`0.0000`	`0.8194`
`RSyn0840M03H (max)`	`16.8210`	`66.9090`	`0.251`	`2742.65000000`	`2742.65000000`	`2742.65000000`	`2742.65000000`	`0.0000`	`0.0000`
`RSyn0840M03M (max)`	`7529.0700`	`7282.9700`	---	`mstat(14) sstat(3)`	`2643.92000000`	---	`6439.72000000`	`---`	`0.5894`
`RSyn0840M04H (max)`	`20.5300`	`240.4630`	`0.085`	`2564.50000000`	`2564.50000000`	`2564.50000000`	`2564.50000000`	`0.0000`	`0.0000`
`RSyn0840M04M (max)`	`7386.2300`	`7267.4400`	---	`mstat(14) sstat(3)`	`2293.65000000`	---	`10426.00000000`	`---`	`0.7800`
`RSyn0840M (max)`	`71.2250`	`7448.0700`	`0.010`	`325.55500000`	`318.55500000`	`325.55500000`	`628.57700000`	`0.0000`	`0.4932`
`SLay05H`	`17.2600`	`4.4500`	`3.879`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`0.0000`	`0.0000`
`SLay05M`	`2.3100`	`2.5770`	`0.896`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`0.0000`	`0.0000`
`SLay06H`	`1071.9600`	`54.5440`	`19.653`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`0.0000`	`0.0000`
`SLay06M`	`5.9020`	`27.4070`	`0.215`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`0.0000`	`0.0000`
`SLay07H`	`7358.1300`	`67.9740`	---	`mstat(14) sstat(3)`	`64748.80000000`	---	`64748.80000000`	`---`	`0.0000`
`SLay07M`	`75.2940`	`66.4610`	`1.133`	`64748.80000000`	`64748.80000000`	`64748.80000000`	`64748.80000000`	`0.0000`	`0.0000`
`SLay08H`	`7392.2500`	`69.2590`	---	`mstat(14) sstat(3)`	`84960.20000000`	---	`84960.20000000`	`---`	`0.0000`
`SLay08M`	`4354.4900`	`67.5310`	`64.481`	`84960.20000000`	`84960.20000000`	`84960.20000000`	`84960.20000000`	`0.0000`	`0.0000`
`SLay09H`	`7457.6700`	`79.2830`	---	`mstat(14) sstat(3)`	`107806.00000000`	---	`107806.00000000`	`---`	`0.0000`
`SLay09M`	`7497.8700`	`69.8780`	---	`mstat(14) sstat(3)`	`107806.00000000`	---	`107806.00000000`	`---`	`0.0000`
`SLay10H`	`7430.0300`	`336.6470`	---	`mstat(14) sstat(3)`	`129580.00000000`	---	`129580.00000000`	`---`	`0.0000`
`SLay10M`	`7590.3000`	`144.9750`	---	`mstat(14) sstat(3)`	`129580.00000000`	---	`129580.00000000`	`---`	`0.0000`
`Syn10H (max)`	`0.1470`	`0.3520`	`0.418`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`0.0000`	`0.0000`
`Syn10M02H (max)`	`0.2170`	`0.3180`	`0.682`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`0.0000`	`0.0000`
`Syn10M02M (max)`	`0.3820`	`4.5530`	`0.084`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`0.0000`	`0.0000`
`Syn10M03H (max)`	`0.2580`	`0.7190`	`0.359`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`0.0000`	`0.0000`
`Syn10M03M (max)`	`1.2110`	`19.6690`	`0.062`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`0.0000`	`0.0000`
`Syn10M04H (max)`	`0.2430`	`1.0620`	`0.229`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`0.0000`	`0.0000`
`Syn10M04M (max)`	`1.1090`	`56.4720`	`0.020`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`0.0000`	`0.0000`
`Syn10M (max)`	`0.1230`	`0.6270`	`0.196`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`0.0000`	`0.0000`
`Syn20H (max)`	`0.2340`	`0.4150`	`0.564`	`924.26300000`	`924.26300000`	`924.26300000`	`924.26300000`	`0.0000`	`0.0000`
`Syn20M02H (max)`	`0.5260`	`2.2460`	`0.234`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`0.0000`	`0.0000`
`Syn20M02M (max)`	`1.7920`	`458.7050`	`0.004`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`0.0000`	`0.0000`
`Syn20M03H (max)`	`0.3970`	`4.2170`	`0.094`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`0.0000`	`0.0000`
`Syn20M03M (max)`	`11.1250`	`4346.9500`	---	`2646.95000000`	`mstat(13) sstat(1)`	`2646.95000000`	---	`0.0000`	`---`
`Syn20M04H (max)`	`0.6710`	`7.6110`	`0.088`	`3532.74000000`	`3532.74000000`	`3532.74000000`	`3532.74000000`	`0.0000`	`0.0000`
`Syn20M04M (max)`	`8.8990`	`12.8750`	---	`3532.74000000`	`mstat(13) sstat(1)`	`3532.74000000`	---	`0.0000`	`---`
`Syn20M (max)`	`0.3360`	`4.8100`	`0.070`	`924.26300000`	`924.26300000`	`924.26300000`	`924.26300000`	`0.0000`	`0.0000`
`Syn40H (max)`	`0.9220`	`1.5330`	`0.601`	`67.71340000`	`67.71340000`	`67.71340000`	`67.71340000`	`0.0000`	`0.0000`
`Syn40M02H (max)`	`1.4350`	`3.5190`	`0.408`	`388.77300000`	`388.77300000`	`388.77300000`	`388.77300000`	`0.0000`	`0.0000`
`Syn40M02M (max)`	`255.9740`	`7384.0100`	`0.035`	`388.77200000`	`360.41500000`	`388.77200000`	`838.70100000`	`0.0000`	`0.5703`
`Syn40M03H (max)`	`5.6220`	`17.1110`	`0.329`	`395.14900000`	`395.14900000`	`395.14900000`	`395.14900000`	`0.0000`	`0.0000`
`Syn40M03M (max)`	`7316.0000`	`7331.7900`	---	`mstat(14) sstat(3)`	`331.14400000`	---	`2046.18000000`	`---`	`0.8382`
`Syn40M04H (max)`	`16.9830`	`53.4430`	`0.318`	`901.75200000`	`901.75200000`	`901.75200000`	`901.75200000`	`0.0000`	`0.0000`
`Syn40M04M (max)`	`7366.7500`	`7295.7900`	---	`mstat(14) sstat(3)`	`808.85200000`	---	`3468.91000000`	`---`	`0.7668`
`Syn40M (max)`	`1.7210`	`973.0320`	`0.002`	`67.71330000`	`67.71330000`	`67.71330000`	`67.71330000`	`0.0000`	`0.0000`
`sssd-8-4-3`	`24.5310`	`9.6910`	`2.531`	`197181.00000000`	`197181.00000000`	`197181.00000000`	`197181.00000000`	`0.0000`	`0.0000`
`sssd-10-4-3`	`295.4730`	`12.5650`	`23.516`	`152710.00000000`	`152710.00000000`	`152710.00000000`	`152710.00000000`	`0.0000`	`0.0000`
`sssd-12-5-3`	`7644.0900`	`52.5360`	---	`mstat(14) sstat(3)`	`261143.00000000`	---	`261143.00000000`	`---`	`0.0000`
`sssd-15-6-3`	`7652.2600`	`231.9490`	---	`mstat(14) sstat(3)`	`440711.00000000`	---	`440711.00000000`	`---`	`0.0000`
`sssd-16-8-3`	`7560.7900`	`7649.9500`	---	`mstat(14) sstat(3)`	`616043.00000000`	---	`615229.00000000`	`---`	`0.0013`
`sssd-18-8-3`	`7563.5400`	`7643.5000`	---	`mstat(14) sstat(3)`	`524139.00000000`	---	`523745.00000000`	`---`	`0.0008`
`sssd-20-9-3`	`7579.0800`	`7616.2900`	---	`mstat(14) sstat(3)`	`478924.00000000`	---	`477253.00000000`	`---`	`0.0035`
`sssd-22-8-3`	`7595.1700`	`7614.5400`	---	`mstat(14) sstat(3)`	`596139.00000000`	---	`595726.00000000`	`---`	`0.0007`
`uflquad-15-60`	`7313.5200`	`12.4560`	---	`mstat(14) sstat(3)`	`1063.19000000`	---	`1063.19000000`	`---`	`0.0000`
`uflquad-15-80`	`7304.0200`	`22.6090`	---	`mstat(14) sstat(3)`	`1217.99000000`	---	`1217.99000000`	`---`	`0.0000`
`uflquad-20-40`	`7323.5200`	`17.2550`	---	`mstat(14) sstat(3)`	`860.96100000`	---	`860.96100000`	`---`	`0.0000`
`uflquad-20-50`	`7309.2200`	`225.1360`	---	`mstat(14) sstat(3)`	`375.91900000`	---	`375.91900000`	`---`	`0.0000`
`uflquad-25-25`	`3815.8500`	`10.5160`	`362.861`	`673.69700000`	`673.69700000`	`673.69700000`	`673.69700000`	`0.0000`	`0.0000`
`uflquad-25-30`	`3352.3800`	`12.5240`	`267.676`	`669.84000000`	`669.84000000`	`669.84000000`	`669.84000000`	`0.0000`	`0.0000`
`uflquad-25-40`	`7311.1900`	`23.3470`	---	`mstat(14) sstat(3)`	`828.16500000`	---	`828.16500000`	`---`	`0.0000`
`nd-10`	`448.2020`	`1189.2800`	`0.377`	`52.46110000`	`52.46110000`	`52.46110000`	`52.46110000`	`0.0000`	`0.0000`
`nd-12`	`660.6810`	`7239.3100`	`0.091`	`56.66960000`	`58.30360000`	`56.66960000`	`54.74920000`	`0.0000`	`0.0649`
`nd-13`	`7242.2500`	`7237.1500`	---	`mstat(14) sstat(3)`	`64.98350000`	---	`50.34500000`	`---`	`0.2908`
`nd-15`	`7317.9200`	`7227.0400`	---	`mstat(14) sstat(3)`	`83.33530000`	---	`60.07600000`	`---`	`0.3872`
`nd-16`	`7310.7200`	`7227.7000`	---	`mstat(14) sstat(3)`	`99.04390000`	---	`81.15100000`	`---`	`0.2205`
`fo7_2`	`2450.5400`	`2031.2700`	`1.206`	`17.74930000`	`17.74930000`	`17.74930000`	`17.74930000`	`0.0000`	`0.0000`
`fo7_ar2_1`	`7014.3900`	`7489.7600`	`0.937`	`24.83980000`	`24.83980000`	`24.83980000`	`24.24210000`	`0.0000`	`0.0247`
`fo7_ar25_1`	`7344.8200`	`7485.8900`	---	`mstat(14) sstat(3)`	`25.58910000`	---	`20.66020000`	`---`	`0.2386`
`fo7_ar3_1`	`7348.9900`	`7504.2700`	---	`mstat(14) sstat(3)`	`24.19550000`	---	`19.48500000`	`---`	`0.2418`
`fo7_ar4_1`	`7356.0500`	`7491.1600`	---	`mstat(14) sstat(3)`	`20.72980000`	---	`20.20060000`	`---`	`0.0262`
`fo7_ar5_1`	`3347.9200`	`4544.9200`	`0.737`	`17.74930000`	`17.74930000`	`17.74930000`	`17.74930000`	`0.0000`	`0.0000`
`fo7`	`7533.0200`	`7510.0700`	---	`mstat(14) sstat(3)`	`20.72980000`	---	`20.65930000`	`---`	`0.0034`
`fo8_ar2_1`	`7337.5900`	`7456.9100`	---	`mstat(14) sstat(3)`	`48.68170000`	---	`23.75590000`	`---`	`1.0492`
`fo8_ar25_1`	`7368.5500`	`7466.7000`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`fo8_ar3_1`	`7385.6400`	`7454.6600`	---	`mstat(14) sstat(3)`	`39.65250000`	---	`21.45650000`	`---`	`0.8480`
`fo8_ar4_1`	`7376.7900`	`7459.2200`	---	`mstat(14) sstat(3)`	`28.46650000`	---	`19.75000000`	`---`	`0.4413`
`fo8_ar5_1`	`7363.1100`	`7462.5000`	---	`mstat(14) sstat(3)`	`24.42260000`	---	`17.50910000`	`---`	`0.3949`
`fo8`	`7461.6700`	`7478.3600`	---	`mstat(14) sstat(3)`	`26.86260000`	---	`19.65960000`	`---`	`0.3664`
`fo9_ar2_1`	`7319.4100`	`7427.4000`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`fo9_ar25_1`	`7320.8600`	`7422.6000`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`fo9_ar3_1`	`7355.2500`	`7423.6500`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`fo9_ar4_1`	`7367.7300`	`7424.4900`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`fo9_ar5_1`	`7366.9600`	`7424.9100`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`fo9`	`7389.2400`	`7445.8100`	---	`mstat(14) sstat(3)`	`30.46430000`	---	`15.34770000`	`---`	`0.9849`
`m3`	`0.1970`	`1.3530`	`0.146`	`37.80000000`	`37.80000000`	`37.80000000`	`37.80000000`	`0.0000`	`0.0000`
`m6`	`19.7720`	`46.2730`	`0.427`	`82.25690000`	`82.25690000`	`82.25690000`	`82.25690000`	`0.0000`	`0.0000`
`m7_ar2_1`	`150.4520`	`2569.7700`	`0.059`	`190.23500000`	`190.23500000`	`190.23500000`	`190.23500000`	`0.0000`	`0.0000`
`m7_ar25_1`	`51.6280`	`166.4970`	`0.310`	`143.58500000`	`143.58500000`	`143.58500000`	`143.58500000`	`0.0000`	`0.0000`
`m7_ar3_1`	`726.3280`	`7483.3400`	`0.097`	`143.58500000`	`143.58500000`	`143.58500000`	`132.58100000`	`0.0000`	`0.0830`
`m7_ar4_1`	`864.4930`	`7488.2500`	`0.115`	`106.75700000`	`148.62000000`	`106.75700000`	`93.12320000`	`0.0000`	`0.5960`
`m7_ar5_1`	`1070.7000`	`7487.6700`	`0.143`	`106.46000000`	`106.46000000`	`106.46000000`	`95.02320000`	`0.0000`	`0.1204`
`m7`	`140.0070`	`507.3050`	`0.276`	`106.75700000`	`106.75700000`	`106.75700000`	`106.75700000`	`0.0000`	`0.0000`
`netmod_dol1`	`7246.7400`	`7250.5400`	---	`mstat(14) sstat(3)`	`-0.56000800`	---	`-0.61127200`	`---`	`0.0839`
`netmod_dol2`	`7226.8800`	`1936.8100`	---	`mstat(14) sstat(3)`	`-0.56000800`	---	`-0.56000800`	`---`	`0.0000`
`netmod_kar1`	`7342.0500`	`15.0230`	---	`mstat(14) sstat(3)`	`-0.41979000`	---	`-0.41979000`	`---`	`0.0000`
`netmod_kar2`	`7340.4800`	`15.0430`	---	`mstat(14) sstat(3)`	`-0.41979000`	---	`-0.41979000`	`---`	`0.0000`
`no7_ar2_1`	`7416.5100`	`7503.1200`	---	`mstat(14) sstat(3)`	`125.58900000`	---	`84.26260000`	`---`	`0.4904`
`no7_ar25_1`	`7478.8100`	`7492.9500`	---	`mstat(14) sstat(3)`	`115.10000000`	---	`86.25610000`	`---`	`0.3344`
`no7_ar3_1`	`7346.9800`	`7500.7900`	---	`mstat(14) sstat(3)`	`117.22400000`	---	`81.15050000`	`---`	`0.4445`
`no7_ar4_1`	`7509.2500`	`7496.5500`	---	`mstat(14) sstat(3)`	`100.41900000`	---	`82.50910000`	`---`	`0.2171`
`no7_ar5_1`	`7520.3100`	`7486.4200`	---	`mstat(14) sstat(3)`	`90.62270000`	---	`86.93780000`	`---`	`0.0424`
`o7_2`	`7491.1900`	`7514.5300`	---	`mstat(14) sstat(3)`	`116.94600000`	---	`90.89210000`	`---`	`0.2866`
`o7_ar2_1`	`7377.7100`	`7480.0300`	---	`mstat(14) sstat(3)`	`153.24900000`	---	`106.53200000`	`---`	`0.4385`
`o7_ar25_1`	`7508.8200`	`7497.6300`	---	`mstat(14) sstat(3)`	`151.01400000`	---	`98.40300000`	`---`	`0.5346`
`o7_ar3_1`	`7447.6000`	`7488.1600`	---	`mstat(14) sstat(3)`	`146.09600000`	---	`99.94000000`	`---`	`0.4618`
`o7_ar4_1`	`7486.9600`	`7482.3300`	---	`mstat(14) sstat(3)`	`136.73100000`	---	`97.48570000`	`---`	`0.4026`
`o7_ar5_1`	`7509.7000`	`7488.1200`	---	`mstat(14) sstat(3)`	`118.76700000`	---	`92.16150000`	`---`	`0.2887`
`o7`	`7602.1300`	`7521.1600`	---	`mstat(14) sstat(3)`	`131.65300000`	---	`96.09110000`	`---`	`0.3701`
`o8_ar4_1`	`7422.9300`	`7450.2100`	---	`mstat(14) sstat(3)`	`298.51200000`	---	`133.62500000`	`---`	`1.2340`
`o9_ar4_1`	`7408.1400`	`7422.0700`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`tls12`	`7447.2500`	`7370.2300`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`tls2`	`0.9500`	`5.9730`	`0.159`	`5.30000000`	`5.30000000`	`5.30000000`	`5.30000000`	`0.0000`	`0.0000`
`tls4`	`7444.0400`	`7676.4700`	---	`mstat(14) sstat(3)`	`8.30000000`	---	`5.65847000`	`---`	`0.4668`
`tls5`	`7519.4400`	`7597.7300`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`tls6`	`7442.1800`	`7535.5100`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`tls7`	`7301.9600`	`7489.1300`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
Shifted Geometric Mean (Solved)	602.40	470.42
% Unsolved	47.10%	41.94%