Solver Square Comparison

Solver Square Comparison: Considers all models.

Results created on 09/14/12 19:33:52 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver ALPHAECP_alphaecp-minlpconvex2 is represented on the left (rows) and solver BONMIN_bonmin-oa on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number	Filename
Tracefile 1:	minlpconvex_alphaecp.pav
Tracefile 2:	minlpconvex_bonmin-oa.pav
Solvers used :	ALPHAECP_alphaecp-minlpconvex2
	BONMIN_bonmin-oa
Modeltype(s)	`MINLP`

	BONMIN_bonmin-oa: optimal	BONMIN_bonmin-oa: locally optimal	BONMIN_bonmin-oa: feasible	BONMIN_bonmin-oa: infeasible	BONMIN_bonmin-oa: unbounded	BONMIN_bonmin-oa: fail	BONMIN_bonmin-oa: no data	total ALPHAECP_alphaecp-minlpconvex2
ALPHAECP_alphaecp-minlpconvex2: optimal	`80`	-	-	-	-	`47`	-	`127`
ALPHAECP_alphaecp-minlpconvex2: locally optimal	-	-	-	-	-	-	-	`-`
ALPHAECP_alphaecp-minlpconvex2: feasible	`2`	-	-	-	-	`24`	-	`26`
ALPHAECP_alphaecp-minlpconvex2: infeasible	-	-	-	-	-	-	-	`-`
ALPHAECP_alphaecp-minlpconvex2: unbounded	-	-	-	-	-	-	-	`-`
ALPHAECP_alphaecp-minlpconvex2: fail	-	-	-	-	-	`2`	-	`2`
ALPHAECP_alphaecp-minlpconvex2: no data	-	-	-	-	-	-	-	`-`
total BONMIN_bonmin-oa	`82`	`-`	`-`	`-`	`-`	`73`	`-`	`155`

Solver return definitions:

Outcome	Model Status	Solver Status
optimal	1 or 15	1
locally optimal	2	any
feasible	8 or 16	1 or 2 or 3 or 4 or 5
infeasible	4 or 5 or 10 or 19	1
unbounded	3 or 18	1
fail	all other	all other

Solver Resource Times

Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.50E-04. If both solutions are less than 1e-1, we use the absolute difference.
Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

ALPHAECP_alphaecp-minlpconvex2: optimal -- BONMIN_bonmin-oa: optimal

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Time (BONMIN_bonmin-oa)	Ratio (ALPHAECP_alphaecp-minlpconvex2/BONMIN_bonmin-oa)	Obj (ALPHAECP_alphaecp-minlpconvex2)	Obj (BONMIN_bonmin-oa)
`BatchS101006M`	`46.3370`	`443.5540`	`0.104`	`769440.00000000`	`769440.00000000`
`BatchS121208M`	`887.7220`	`655.4940`	`1.354`	`1241130.00000000`	`1241130.00000000`
`BatchS151208M`	`1088.1000`	`4421.2200`	`0.246`	`1543470.00000000`	`1543470.00000000`
`clay0203h`	`3.0090`	`3.1620`	`0.952`	`41573.30000000`	`41573.30000000`
`clay0203m`	`2.0080`	`2.1970`	`0.914`	`41573.30000000`	`41573.30000000`
`clay0204h`	`11.3170`	`7.6910`	`1.471`	`6545.00000000`	`6545.00000000`
`clay0204m`	`6.1480`	`3.3410`	`1.840`	`6545.00000000`	`6545.00000000`
`clay0205h`	`38.3660`	`1044.7000`	`0.037`	`8092.50000000`	`8092.50000000`
`clay0205m`	`22.6960`	`122.4660`	`0.185`	`8092.50000000`	`8092.50000000`
`clay0303h`	`3.9740`	`5.9620`	`0.667`	`26669.10000000`	`26669.10000000`
`clay0303m`	`3.0000`	`5.6360`	`0.532`	`26669.10000000`	`26669.10000000`
`clay0304h`	`16.5760`	`263.1000`	`0.063`	`40262.40000000`	`40262.40000000`
`clay0304m`	`7.2770`	`304.5220`	`0.024`	`40262.40000000`	`40262.40000000`
`clay0305h`	`43.1620`	`3838.3900`	`0.011`	`8092.50000000`	`8092.50000000`
`clay0305m`	`24.5400`	`258.4510`	`0.095`	`8092.50000000`	`8092.50000000`
`FLay03H`	`8.6170`	`1.9810`	`4.350`	`48.98980000`	`48.98980000`
`FLay03M`	`3.3270`	`0.7030`	`4.733`	`48.98980000`	`48.98980000`
`FLay04H`	`147.2640`	`188.1580`	`0.783`	`54.40590000`	`54.40590000`
`FLay04M`	`118.6470`	`21.4410`	`5.534`	`54.40590000`	`54.40590000`
`RSyn0810H`	`0.6630`	`0.3760`	`1.763`	`1721.45000000`	`1721.45000000`
`RSyn0810M02H`	`6.3970`	`3.1690`	`2.019`	`1741.39000000`	`1741.39000000`
`RSyn0810M02M`	`29.5920`	`1576.3700`	`0.019`	`1741.39000000`	`1741.39000000`
`RSyn0810M03H`	`11.5210`	`16.1540`	`0.713`	`2722.45000000`	`2722.45000000`
`RSyn0810M04H`	`16.9230`	`5.9150`	`2.861`	`6581.94000000`	`6581.94000000`
`RSyn0810M`	`1.1460`	`5.4510`	`0.210`	`1721.45000000`	`1721.45000000`
`RSyn0820H`	`1.3090`	`2.8310`	`0.462`	`1150.30000000`	`1150.30000000`
`RSyn0820M02H`	`4.4300`	`4.7770`	`0.927`	`1092.09000000`	`1092.09000000`
`RSyn0820M03H`	`7.7190`	`40.6240`	`0.190`	`2028.81000000`	`2028.81000000`
`RSyn0820M04H`	`11.6270`	`23.8390`	`0.488`	`2450.77000000`	`2450.77000000`
`RSyn0820M`	`2.3010`	`26.1020`	`0.088`	`1150.30000000`	`1150.30000000`
`RSyn0840H`	`2.4300`	`0.9380`	`2.591`	`325.55500000`	`325.55500000`
`RSyn0840M02H`	`13.8590`	`2.6350`	`5.260`	`734.98400000`	`734.98400000`
`RSyn0840M02M`	`29.1150`	`4692.2000`	`0.006`	`734.98300000`	`734.98400000`
`RSyn0840M03H`	`30.3690`	`16.8210`	`1.805`	`2742.65000000`	`2742.65000000`
`RSyn0840M04H`	`77.1670`	`20.5300`	`3.759`	`2564.50000000`	`2564.50000000`
`RSyn0840M`	`2.5790`	`71.2250`	`0.036`	`325.55500000`	`325.55500000`
`SLay05H`	`118.8330`	`17.2600`	`6.885`	`22664.70000000`	`22664.70000000`
`SLay05M`	`77.8080`	`2.3100`	`33.683`	`22664.70000000`	`22664.70000000`
`SLay06H`	`244.1010`	`1071.9600`	`0.228`	`32757.00000000`	`32757.00000000`
`SLay06M`	`157.3150`	`5.9020`	`26.655`	`32757.00000000`	`32757.00000000`
`SLay07M`	`431.6340`	`75.2940`	`5.733`	`64748.80000000`	`64748.80000000`
`SLay08M`	`821.5290`	`4354.4900`	`0.189`	`84960.20000000`	`84960.20000000`
`Syn10H`	`0.0950`	`0.1470`	`0.646`	`1267.35000000`	`1267.35000000`
`Syn10M02H`	`1.0430`	`0.2170`	`4.806`	`2310.30000000`	`2310.30000000`
`Syn10M02M`	`0.7600`	`0.3820`	`1.990`	`2310.30000000`	`2310.30000000`
`Syn10M03H`	`1.1770`	`0.2580`	`4.562`	`3354.68000000`	`3354.68000000`
`Syn10M03M`	`1.0970`	`1.2110`	`0.906`	`3354.68000000`	`3354.68000000`
`Syn10M04H`	`2.1200`	`0.2430`	`8.724`	`4557.06000000`	`4557.06000000`
`Syn10M04M`	`1.9320`	`1.1090`	`1.742`	`4557.06000000`	`4557.06000000`
`Syn10M`	`0.1580`	`0.1230`	`1.285`	`1267.35000000`	`1267.35000000`
`Syn20H`	`0.8670`	`0.2340`	`3.705`	`924.26300000`	`924.26300000`
`Syn20M02H`	`1.2090`	`0.5260`	`2.298`	`1752.13000000`	`1752.13000000`
`Syn20M02M`	`0.9900`	`1.7920`	`0.552`	`1752.13000000`	`1752.13000000`
`Syn20M03H`	`2.2050`	`0.3970`	`5.554`	`2646.95000000`	`2646.95000000`
`Syn20M03M`	`1.5200`	`11.1250`	`0.137`	`2646.95000000`	`2646.95000000`
`Syn20M04H`	`3.0560`	`0.6710`	`4.554`	`3532.74000000`	`3532.74000000`
`Syn20M04M`	`2.5290`	`8.8990`	`0.284`	`3532.74000000`	`3532.74000000`
`Syn20M`	`1.1480`	`0.3360`	`3.417`	`924.26300000`	`924.26300000`
`Syn40H`	`2.2640`	`0.9220`	`2.456`	`67.71340000`	`67.71340000`
`Syn40M02H`	`4.9100`	`1.4350`	`3.422`	`388.77300000`	`388.77300000`
`Syn40M02M`	`4.3890`	`255.9740`	`0.017`	`388.77200000`	`388.77200000`
`Syn40M03H`	`10.8970`	`5.6220`	`1.938`	`395.14900000`	`395.14900000`
`Syn40M04H`	`21.2340`	`16.9830`	`1.250`	`901.75200000`	`901.75200000`
`Syn40M`	`2.2290`	`1.7210`	`1.295`	`67.71330000`	`67.71330000`
`sssd-8-4-3`	`3.1510`	`24.5310`	`0.128`	`197181.00000000`	`197181.00000000`
`sssd-10-4-3`	`6.8130`	`295.4730`	`0.023`	`152710.00000000`	`152710.00000000`
`nd-10`	`5943.3000`	`448.2020`	`13.260`	`52.46110000`	`52.46110000`
`nd-12`	`684.6800`	`660.6810`	`1.036`	`56.66960000`	`56.66960000`
`fo7_2`	`16.2510`	`2450.5400`	`0.007`	`17.74930000`	`17.74930000`
`fo7_ar2_1`	`71.6920`	`7014.3900`	`0.010`	`24.83980000`	`24.83980000`
`fo7_ar5_1`	`26.7280`	`3347.9200`	`0.008`	`17.74930000`	`17.74930000`
`m3`	`0.4270`	`0.1970`	`2.168`	`37.80000000`	`37.80000000`
`m6`	`1.4800`	`19.7720`	`0.075`	`82.25690000`	`82.25690000`
`m7_ar2_1`	`6.8390`	`150.4520`	`0.045`	`190.23500000`	`190.23500000`
`m7_ar25_1`	`1.0600`	`51.6280`	`0.021`	`143.58500000`	`143.58500000`
`m7_ar3_1`	`10.8580`	`726.3280`	`0.015`	`143.58500000`	`143.58500000`
`m7_ar4_1`	`0.9760`	`864.4930`	`0.001`	`106.75700000`	`106.75700000`
`m7_ar5_1`	`3.7390`	`1070.7000`	`0.003`	`106.46000000`	`106.46000000`
`m7`	`2.8200`	`140.0070`	`0.020`	`106.75700000`	`106.75700000`
`tls2`	`0.3030`	`0.9500`	`0.319`	`5.30000000`	`5.30000000`

ALPHAECP_alphaecp-minlpconvex2: optimal -- BONMIN_bonmin-oa: fail

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Time (BONMIN_bonmin-oa)	Ratio (ALPHAECP_alphaecp-minlpconvex2/BONMIN_bonmin-oa)	Obj (ALPHAECP_alphaecp-minlpconvex2)	Status (BONMIN_bonmin-oa)
`BatchS201210M`	`127.0950`	`7325.7400`	---	`2295350.00000000`	`mstat(14)sstat( 3)`
`RSyn0810M03M`	`35.6170`	`7502.6900`	---	`2722.45000000`	`mstat(14)sstat( 3)`
`RSyn0810M04M`	`32.5020`	`7287.3300`	---	`6581.93000000`	`mstat(14)sstat( 3)`
`RSyn0820M02M`	`28.0010`	`7628.2600`	---	`1092.09000000`	`mstat(14)sstat( 3)`
`RSyn0820M03M`	`23.0700`	`7489.7400`	---	`2028.81000000`	`mstat(14)sstat( 3)`
`RSyn0820M04M`	`26.0200`	`7390.2200`	---	`2450.77000000`	`mstat(14)sstat( 3)`
`RSyn0840M03M`	`50.1770`	`7529.0700`	---	`2742.65000000`	`mstat(14)sstat( 3)`
`RSyn0840M04M`	`543.7590`	`7386.2300`	---	`2564.50000000`	`mstat(14)sstat( 3)`
`SLay07H`	`746.2320`	`7358.1300`	---	`64748.80000000`	`mstat(14)sstat( 3)`
`SLay08H`	`1579.8000`	`7392.2500`	---	`84960.20000000`	`mstat(14)sstat( 3)`
`SLay09M`	`2096.7000`	`7497.8700`	---	`107806.00000000`	`mstat(14)sstat( 3)`
`Syn40M03M`	`10.4170`	`7316.0000`	---	`395.14800000`	`mstat(14)sstat( 3)`
`Syn40M04M`	`20.9420`	`7366.7500`	---	`901.75100000`	`mstat(14)sstat( 3)`
`sssd-12-5-3`	`24.2350`	`7644.0900`	---	`261143.00000000`	`mstat(14)sstat( 3)`
`sssd-15-6-3`	`118.7660`	`7652.2600`	---	`440711.00000000`	`mstat(14)sstat( 3)`
`sssd-16-8-3`	`3710.8100`	`7560.7900`	---	`615763.00000000`	`mstat(14)sstat( 3)`
`sssd-18-8-3`	`5649.0100`	`7563.5400`	---	`524063.00000000`	`mstat(14)sstat( 3)`
`fo7_ar25_1`	`68.7200`	`7344.8200`	---	`23.09360000`	`mstat(14)sstat( 3)`
`fo7_ar3_1`	`143.0130`	`7348.9900`	---	`22.51750000`	`mstat(14)sstat( 3)`
`fo7_ar4_1`	`129.5990`	`7356.0500`	---	`20.72980000`	`mstat(14)sstat( 3)`
`fo7`	`158.3240`	`7533.0200`	---	`20.72980000`	`mstat(14)sstat( 3)`
`fo8_ar2_1`	`416.7040`	`7337.5900`	---	`30.34060000`	`mstat(14)sstat( 3)`
`fo8_ar25_1`	`432.2920`	`7368.5500`	---	`28.04520000`	`mstat(14)sstat( 3)`
`fo8_ar3_1`	`175.8330`	`7385.6400`	---	`23.91010000`	`mstat(14)sstat( 3)`
`fo8_ar4_1`	`130.3020`	`7376.7900`	---	`22.38190000`	`mstat(14)sstat( 3)`
`fo8_ar5_1`	`469.2460`	`7363.1100`	---	`22.38190000`	`mstat(14)sstat( 3)`
`fo8`	`532.1980`	`7461.6700`	---	`22.38190000`	`mstat(14)sstat( 3)`
`fo9_ar2_1`	`1938.4500`	`7319.4100`	---	`32.62500000`	`mstat(14)sstat( 3)`
`fo9_ar3_1`	`1033.5200`	`7355.2500`	---	`24.81550000`	`mstat(14)sstat( 3)`
`fo9_ar4_1`	`1274.7400`	`7367.7300`	---	`23.46430000`	`mstat(14)sstat( 3)`
`fo9_ar5_1`	`2653.3400`	`7366.9600`	---	`23.46430000`	`mstat(14)sstat( 3)`
`fo9`	`3049.9300`	`7389.2400`	---	`23.46430000`	`mstat(14)sstat( 3)`
`netmod_dol2`	`408.5090`	`7226.8800`	---	`-0.56000800`	`mstat(14)sstat( 3)`
`netmod_kar1`	`81.9920`	`7342.0500`	---	`-0.41979000`	`mstat(14)sstat( 3)`
`netmod_kar2`	`82.5560`	`7340.4800`	---	`-0.41979000`	`mstat(14)sstat( 3)`
`no7_ar2_1`	`131.1430`	`7416.5100`	---	`107.81500000`	`mstat(14)sstat( 3)`
`no7_ar25_1`	`221.2130`	`7478.8100`	---	`107.81500000`	`mstat(14)sstat( 3)`
`no7_ar3_1`	`361.9430`	`7346.9800`	---	`107.81500000`	`mstat(14)sstat( 3)`
`no7_ar4_1`	`308.8270`	`7509.2500`	---	`98.51840000`	`mstat(14)sstat( 3)`
`no7_ar5_1`	`197.2660`	`7520.3100`	---	`90.62270000`	`mstat(14)sstat( 3)`
`o7_2`	`1225.8300`	`7491.1900`	---	`116.94600000`	`mstat(14)sstat( 3)`
`o7_ar2_1`	`164.5370`	`7377.7100`	---	`140.41200000`	`mstat(14)sstat( 3)`
`o7_ar25_1`	`876.7070`	`7508.8200`	---	`140.41200000`	`mstat(14)sstat( 3)`
`o7_ar3_1`	`689.1960`	`7447.6000`	---	`137.93200000`	`mstat(14)sstat( 3)`
`o7_ar4_1`	`4416.5100`	`7486.9600`	---	`131.65300000`	`mstat(14)sstat( 3)`
`o7_ar5_1`	`645.0260`	`7509.7000`	---	`116.94600000`	`mstat(14)sstat( 3)`
`tls4`	`224.4940`	`7444.0400`	---	`8.30000000`	`mstat(14)sstat( 3)`

ALPHAECP_alphaecp-minlpconvex2: feasible -- BONMIN_bonmin-oa: optimal

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Time (BONMIN_bonmin-oa)	Ratio (ALPHAECP_alphaecp-minlpconvex2/BONMIN_bonmin-oa)	Obj (ALPHAECP_alphaecp-minlpconvex2)	Obj (BONMIN_bonmin-oa)
`uflquad-25-25`	`7202.1900`	`3815.8500`	`1.887`	`673.69700000`	`673.69700000`
`uflquad-25-30`	`7202.1900`	`3352.3800`	`2.148`	`669.84000000`	`669.84000000`

ALPHAECP_alphaecp-minlpconvex2: feasible -- BONMIN_bonmin-oa: fail

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Time (BONMIN_bonmin-oa)	Ratio (ALPHAECP_alphaecp-minlpconvex2/BONMIN_bonmin-oa)	Obj (ALPHAECP_alphaecp-minlpconvex2)	Status (BONMIN_bonmin-oa)
`FLay05H`	`7202.2400`	`7414.4400`	---	`64.49810000`	`mstat(14)sstat( 3)`
`FLay05M`	`7202.2100`	`7392.0500`	---	`64.49810000`	`mstat(14)sstat( 3)`
`FLay06H`	`7202.2200`	`7444.9700`	---	`66.93280000`	`mstat(14)sstat( 3)`
`FLay06M`	`7202.3700`	`7509.8000`	---	`66.93280000`	`mstat(14)sstat( 3)`
`SLay09H`	`7202.2300`	`7457.6700`	---	`107983.00000000`	`mstat(14)sstat( 3)`
`SLay10H`	`7202.0600`	`7430.0300`	---	`129876.00000000`	`mstat(14)sstat( 3)`
`SLay10M`	`7202.2800`	`7590.3000`	---	`129796.00000000`	`mstat(14)sstat( 3)`
`sssd-20-9-3`	`7202.5300`	`7579.0800`	---	`489487.00000000`	`mstat(14)sstat( 3)`
`sssd-22-8-3`	`7202.7000`	`7595.1700`	---	`602410.00000000`	`mstat(14)sstat( 3)`
`uflquad-15-60`	`7202.2100`	`7313.5200`	---	`1063.19000000`	`mstat(14)sstat( 3)`
`uflquad-15-80`	`7202.2300`	`7304.0200`	---	`1217.99000000`	`mstat(14)sstat( 3)`
`uflquad-20-40`	`7202.1600`	`7323.5200`	---	`860.96100000`	`mstat(14)sstat( 3)`
`uflquad-20-50`	`7202.1300`	`7309.2200`	---	`394.98200000`	`mstat(14)sstat( 3)`
`uflquad-25-40`	`7202.2000`	`7311.1900`	---	`828.16500000`	`mstat(14)sstat( 3)`
`nd-13`	`7202.3300`	`7242.2500`	---	`63.00510000`	`mstat(14)sstat( 3)`
`nd-16`	`7202.3300`	`7310.7200`	---	`98.19780000`	`mstat(14)sstat( 3)`
`fo9_ar25_1`	`7202.1900`	`7320.8600`	---	`32.18640000`	`mstat(14)sstat( 3)`
`netmod_dol1`	`7202.1700`	`7246.7400`	---	`-0.55976000`	`mstat(14)sstat( 3)`
`o7`	`7202.2300`	`7602.1300`	---	`131.65300000`	`mstat(14)sstat( 3)`
`o8_ar4_1`	`7202.4500`	`7422.9300`	---	`243.07100000`	`mstat(14)sstat( 3)`
`o9_ar4_1`	`7202.6900`	`7408.1400`	---	`266.02800000`	`mstat(14)sstat( 3)`
`tls5`	`7202.2800`	`7519.4400`	---	`14.60000000`	`mstat(14)sstat( 3)`
`tls6`	`7202.2800`	`7442.1800`	---	`39.10000000`	`mstat(14)sstat( 3)`
`tls7`	`7202.3400`	`7301.9600`	---	`53.80000000`	`mstat(14)sstat( 3)`

ALPHAECP_alphaecp-minlpconvex2: fail -- BONMIN_bonmin-oa: fail

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Time (BONMIN_bonmin-oa)	Ratio (ALPHAECP_alphaecp-minlpconvex2/BONMIN_bonmin-oa)	Status (ALPHAECP_alphaecp-minlpconvex2)	Status (BONMIN_bonmin-oa)
`nd-15`	`7202.2600`	`7317.9200`	---	`mstat(13)sstat( 1)`	`mstat(14)sstat( 3)`
`tls12`	`7202.3000`	`7447.2500`	---	`mstat(14)sstat( 3)`	`mstat(14)sstat( 3)`

ALPHAECP_alphaecp-minlpconvex2: optimal:

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Obj (ALPHAECP_alphaecp-minlpconvex2)
`BatchS101006M`	`46.3370`	`769440.00000000`
`BatchS121208M`	`887.7220`	`1241130.00000000`
`BatchS151208M`	`1088.1000`	`1543470.00000000`
`BatchS201210M`	`127.0950`	`2295350.00000000`
`clay0203h`	`3.0090`	`41573.30000000`
`clay0203m`	`2.0080`	`41573.30000000`
`clay0204h`	`11.3170`	`6545.00000000`
`clay0204m`	`6.1480`	`6545.00000000`
`clay0205h`	`38.3660`	`8092.50000000`
`clay0205m`	`22.6960`	`8092.50000000`
`clay0303h`	`3.9740`	`26669.10000000`
`clay0303m`	`3.0000`	`26669.10000000`
`clay0304h`	`16.5760`	`40262.40000000`
`clay0304m`	`7.2770`	`40262.40000000`
`clay0305h`	`43.1620`	`8092.50000000`
`clay0305m`	`24.5400`	`8092.50000000`
`FLay03H`	`8.6170`	`48.98980000`
`FLay03M`	`3.3270`	`48.98980000`
`FLay04H`	`147.2640`	`54.40590000`
`FLay04M`	`118.6470`	`54.40590000`
`RSyn0810H`	`0.6630`	`1721.45000000`
`RSyn0810M02H`	`6.3970`	`1741.39000000`
`RSyn0810M02M`	`29.5920`	`1741.39000000`
`RSyn0810M03H`	`11.5210`	`2722.45000000`
`RSyn0810M03M`	`35.6170`	`2722.45000000`
`RSyn0810M04H`	`16.9230`	`6581.94000000`
`RSyn0810M04M`	`32.5020`	`6581.93000000`
`RSyn0810M`	`1.1460`	`1721.45000000`
`RSyn0820H`	`1.3090`	`1150.30000000`
`RSyn0820M02H`	`4.4300`	`1092.09000000`
`RSyn0820M02M`	`28.0010`	`1092.09000000`
`RSyn0820M03H`	`7.7190`	`2028.81000000`
`RSyn0820M03M`	`23.0700`	`2028.81000000`
`RSyn0820M04H`	`11.6270`	`2450.77000000`
`RSyn0820M04M`	`26.0200`	`2450.77000000`
`RSyn0820M`	`2.3010`	`1150.30000000`
`RSyn0840H`	`2.4300`	`325.55500000`
`RSyn0840M02H`	`13.8590`	`734.98400000`
`RSyn0840M02M`	`29.1150`	`734.98300000`
`RSyn0840M03H`	`30.3690`	`2742.65000000`
`RSyn0840M03M`	`50.1770`	`2742.65000000`
`RSyn0840M04H`	`77.1670`	`2564.50000000`
`RSyn0840M04M`	`543.7590`	`2564.50000000`
`RSyn0840M`	`2.5790`	`325.55500000`
`SLay05H`	`118.8330`	`22664.70000000`
`SLay05M`	`77.8080`	`22664.70000000`
`SLay06H`	`244.1010`	`32757.00000000`
`SLay06M`	`157.3150`	`32757.00000000`
`SLay07H`	`746.2320`	`64748.80000000`
`SLay07M`	`431.6340`	`64748.80000000`
`SLay08H`	`1579.8000`	`84960.20000000`
`SLay08M`	`821.5290`	`84960.20000000`
`SLay09M`	`2096.7000`	`107806.00000000`
`Syn10H`	`0.0950`	`1267.35000000`
`Syn10M02H`	`1.0430`	`2310.30000000`
`Syn10M02M`	`0.7600`	`2310.30000000`
`Syn10M03H`	`1.1770`	`3354.68000000`
`Syn10M03M`	`1.0970`	`3354.68000000`
`Syn10M04H`	`2.1200`	`4557.06000000`
`Syn10M04M`	`1.9320`	`4557.06000000`
`Syn10M`	`0.1580`	`1267.35000000`
`Syn20H`	`0.8670`	`924.26300000`
`Syn20M02H`	`1.2090`	`1752.13000000`
`Syn20M02M`	`0.9900`	`1752.13000000`
`Syn20M03H`	`2.2050`	`2646.95000000`
`Syn20M03M`	`1.5200`	`2646.95000000`
`Syn20M04H`	`3.0560`	`3532.74000000`
`Syn20M04M`	`2.5290`	`3532.74000000`
`Syn20M`	`1.1480`	`924.26300000`
`Syn40H`	`2.2640`	`67.71340000`
`Syn40M02H`	`4.9100`	`388.77300000`
`Syn40M02M`	`4.3890`	`388.77200000`
`Syn40M03H`	`10.8970`	`395.14900000`
`Syn40M03M`	`10.4170`	`395.14800000`
`Syn40M04H`	`21.2340`	`901.75200000`
`Syn40M04M`	`20.9420`	`901.75100000`
`Syn40M`	`2.2290`	`67.71330000`
`sssd-8-4-3`	`3.1510`	`197181.00000000`
`sssd-10-4-3`	`6.8130`	`152710.00000000`
`sssd-12-5-3`	`24.2350`	`261143.00000000`
`sssd-15-6-3`	`118.7660`	`440711.00000000`
`sssd-16-8-3`	`3710.8100`	`615763.00000000`
`sssd-18-8-3`	`5649.0100`	`524063.00000000`
`nd-10`	`5943.3000`	`52.46110000`
`nd-12`	`684.6800`	`56.66960000`
`fo7_2`	`16.2510`	`17.74930000`
`fo7_ar2_1`	`71.6920`	`24.83980000`
`fo7_ar25_1`	`68.7200`	`23.09360000`
`fo7_ar3_1`	`143.0130`	`22.51750000`
`fo7_ar4_1`	`129.5990`	`20.72980000`
`fo7_ar5_1`	`26.7280`	`17.74930000`
`fo7`	`158.3240`	`20.72980000`
`fo8_ar2_1`	`416.7040`	`30.34060000`
`fo8_ar25_1`	`432.2920`	`28.04520000`
`fo8_ar3_1`	`175.8330`	`23.91010000`
`fo8_ar4_1`	`130.3020`	`22.38190000`
`fo8_ar5_1`	`469.2460`	`22.38190000`
`fo8`	`532.1980`	`22.38190000`
`fo9_ar2_1`	`1938.4500`	`32.62500000`
`fo9_ar3_1`	`1033.5200`	`24.81550000`
`fo9_ar4_1`	`1274.7400`	`23.46430000`
`fo9_ar5_1`	`2653.3400`	`23.46430000`
`fo9`	`3049.9300`	`23.46430000`
`m3`	`0.4270`	`37.80000000`
`m6`	`1.4800`	`82.25690000`
`m7_ar2_1`	`6.8390`	`190.23500000`
`m7_ar25_1`	`1.0600`	`143.58500000`
`m7_ar3_1`	`10.8580`	`143.58500000`
`m7_ar4_1`	`0.9760`	`106.75700000`
`m7_ar5_1`	`3.7390`	`106.46000000`
`m7`	`2.8200`	`106.75700000`
`netmod_dol2`	`408.5090`	`-0.56000800`
`netmod_kar1`	`81.9920`	`-0.41979000`
`netmod_kar2`	`82.5560`	`-0.41979000`
`no7_ar2_1`	`131.1430`	`107.81500000`
`no7_ar25_1`	`221.2130`	`107.81500000`
`no7_ar3_1`	`361.9430`	`107.81500000`
`no7_ar4_1`	`308.8270`	`98.51840000`
`no7_ar5_1`	`197.2660`	`90.62270000`
`o7_2`	`1225.8300`	`116.94600000`
`o7_ar2_1`	`164.5370`	`140.41200000`
`o7_ar25_1`	`876.7070`	`140.41200000`
`o7_ar3_1`	`689.1960`	`137.93200000`
`o7_ar4_1`	`4416.5100`	`131.65300000`
`o7_ar5_1`	`645.0260`	`116.94600000`
`tls2`	`0.3030`	`5.30000000`
`tls4`	`224.4940`	`8.30000000`

ALPHAECP_alphaecp-minlpconvex2: feasible:

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Obj (ALPHAECP_alphaecp-minlpconvex2)
`FLay05H`	`7202.2400`	`64.49810000`
`FLay05M`	`7202.2100`	`64.49810000`
`FLay06H`	`7202.2200`	`66.93280000`
`FLay06M`	`7202.3700`	`66.93280000`
`SLay09H`	`7202.2300`	`107983.00000000`
`SLay10H`	`7202.0600`	`129876.00000000`
`SLay10M`	`7202.2800`	`129796.00000000`
`sssd-20-9-3`	`7202.5300`	`489487.00000000`
`sssd-22-8-3`	`7202.7000`	`602410.00000000`
`uflquad-15-60`	`7202.2100`	`1063.19000000`
`uflquad-15-80`	`7202.2300`	`1217.99000000`
`uflquad-20-40`	`7202.1600`	`860.96100000`
`uflquad-20-50`	`7202.1300`	`394.98200000`
`uflquad-25-25`	`7202.1900`	`673.69700000`
`uflquad-25-30`	`7202.1900`	`669.84000000`
`uflquad-25-40`	`7202.2000`	`828.16500000`
`nd-13`	`7202.3300`	`63.00510000`
`nd-16`	`7202.3300`	`98.19780000`
`fo9_ar25_1`	`7202.1900`	`32.18640000`
`netmod_dol1`	`7202.1700`	`-0.55976000`
`o7`	`7202.2300`	`131.65300000`
`o8_ar4_1`	`7202.4500`	`243.07100000`
`o9_ar4_1`	`7202.6900`	`266.02800000`
`tls5`	`7202.2800`	`14.60000000`
`tls6`	`7202.2800`	`39.10000000`
`tls7`	`7202.3400`	`53.80000000`

ALPHAECP_alphaecp-minlpconvex2: fail:

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Status (ALPHAECP_alphaecp-minlpconvex2)
`nd-15`	`--`	`mstat(13) sstat( 1)`
`tls12`	`--`	`mstat(14) sstat( 3)`

BONMIN_bonmin-oa: optimal:

Modelname	Time (BONMIN_bonmin-oa)	Obj (BONMIN_bonmin-oa)
`BatchS101006M`	`443.5540`	`769440.00000000`
`BatchS121208M`	`655.4940`	`1241130.00000000`
`BatchS151208M`	`4421.2200`	`1543470.00000000`
`clay0203h`	`3.1620`	`41573.30000000`
`clay0203m`	`2.1970`	`41573.30000000`
`clay0204h`	`7.6910`	`6545.00000000`
`clay0204m`	`3.3410`	`6545.00000000`
`clay0205h`	`1044.7000`	`8092.50000000`
`clay0205m`	`122.4660`	`8092.50000000`
`clay0303h`	`5.9620`	`26669.10000000`
`clay0303m`	`5.6360`	`26669.10000000`
`clay0304h`	`263.1000`	`40262.40000000`
`clay0304m`	`304.5220`	`40262.40000000`
`clay0305h`	`3838.3900`	`8092.50000000`
`clay0305m`	`258.4510`	`8092.50000000`
`FLay03H`	`1.9810`	`48.98980000`
`FLay03M`	`0.7030`	`48.98980000`
`FLay04H`	`188.1580`	`54.40590000`
`FLay04M`	`21.4410`	`54.40590000`
`RSyn0810H`	`0.3760`	`1721.45000000`
`RSyn0810M02H`	`3.1690`	`1741.39000000`
`RSyn0810M02M`	`1576.3700`	`1741.39000000`
`RSyn0810M03H`	`16.1540`	`2722.45000000`
`RSyn0810M04H`	`5.9150`	`6581.94000000`
`RSyn0810M`	`5.4510`	`1721.45000000`
`RSyn0820H`	`2.8310`	`1150.30000000`
`RSyn0820M02H`	`4.7770`	`1092.09000000`
`RSyn0820M03H`	`40.6240`	`2028.81000000`
`RSyn0820M04H`	`23.8390`	`2450.77000000`
`RSyn0820M`	`26.1020`	`1150.30000000`
`RSyn0840H`	`0.9380`	`325.55500000`
`RSyn0840M02H`	`2.6350`	`734.98400000`
`RSyn0840M02M`	`4692.2000`	`734.98400000`
`RSyn0840M03H`	`16.8210`	`2742.65000000`
`RSyn0840M04H`	`20.5300`	`2564.50000000`
`RSyn0840M`	`71.2250`	`325.55500000`
`SLay05H`	`17.2600`	`22664.70000000`
`SLay05M`	`2.3100`	`22664.70000000`
`SLay06H`	`1071.9600`	`32757.00000000`
`SLay06M`	`5.9020`	`32757.00000000`
`SLay07M`	`75.2940`	`64748.80000000`
`SLay08M`	`4354.4900`	`84960.20000000`
`Syn10H`	`0.1470`	`1267.35000000`
`Syn10M02H`	`0.2170`	`2310.30000000`
`Syn10M02M`	`0.3820`	`2310.30000000`
`Syn10M03H`	`0.2580`	`3354.68000000`
`Syn10M03M`	`1.2110`	`3354.68000000`
`Syn10M04H`	`0.2430`	`4557.06000000`
`Syn10M04M`	`1.1090`	`4557.06000000`
`Syn10M`	`0.1230`	`1267.35000000`
`Syn20H`	`0.2340`	`924.26300000`
`Syn20M02H`	`0.5260`	`1752.13000000`
`Syn20M02M`	`1.7920`	`1752.13000000`
`Syn20M03H`	`0.3970`	`2646.95000000`
`Syn20M03M`	`11.1250`	`2646.95000000`
`Syn20M04H`	`0.6710`	`3532.74000000`
`Syn20M04M`	`8.8990`	`3532.74000000`
`Syn20M`	`0.3360`	`924.26300000`
`Syn40H`	`0.9220`	`67.71340000`
`Syn40M02H`	`1.4350`	`388.77300000`
`Syn40M02M`	`255.9740`	`388.77200000`
`Syn40M03H`	`5.6220`	`395.14900000`
`Syn40M04H`	`16.9830`	`901.75200000`
`Syn40M`	`1.7210`	`67.71330000`
`sssd-8-4-3`	`24.5310`	`197181.00000000`
`sssd-10-4-3`	`295.4730`	`152710.00000000`
`uflquad-25-25`	`3815.8500`	`673.69700000`
`uflquad-25-30`	`3352.3800`	`669.84000000`
`nd-10`	`448.2020`	`52.46110000`
`nd-12`	`660.6810`	`56.66960000`
`fo7_2`	`2450.5400`	`17.74930000`
`fo7_ar2_1`	`7014.3900`	`24.83980000`
`fo7_ar5_1`	`3347.9200`	`17.74930000`
`m3`	`0.1970`	`37.80000000`
`m6`	`19.7720`	`82.25690000`
`m7_ar2_1`	`150.4520`	`190.23500000`
`m7_ar25_1`	`51.6280`	`143.58500000`
`m7_ar3_1`	`726.3280`	`143.58500000`
`m7_ar4_1`	`864.4930`	`106.75700000`
`m7_ar5_1`	`1070.7000`	`106.46000000`
`m7`	`140.0070`	`106.75700000`
`tls2`	`0.9500`	`5.30000000`

BONMIN_bonmin-oa: fail:

Modelname	Time (BONMIN_bonmin-oa)	Status (BONMIN_bonmin-oa)
`BatchS201210M`	`--`	`mstat(14)sstat( 3)`
`FLay05H`	`--`	`mstat(14)sstat( 3)`
`FLay05M`	`--`	`mstat(14)sstat( 3)`
`FLay06H`	`--`	`mstat(14)sstat( 3)`
`FLay06M`	`--`	`mstat(14)sstat( 3)`
`RSyn0810M03M`	`--`	`mstat(14)sstat( 3)`
`RSyn0810M04M`	`--`	`mstat(14)sstat( 3)`
`RSyn0820M02M`	`--`	`mstat(14)sstat( 3)`
`RSyn0820M03M`	`--`	`mstat(14)sstat( 3)`
`RSyn0820M04M`	`--`	`mstat(14)sstat( 3)`
`RSyn0840M03M`	`--`	`mstat(14)sstat( 3)`
`RSyn0840M04M`	`--`	`mstat(14)sstat( 3)`
`SLay07H`	`--`	`mstat(14)sstat( 3)`
`SLay08H`	`--`	`mstat(14)sstat( 3)`
`SLay09H`	`--`	`mstat(14)sstat( 3)`
`SLay09M`	`--`	`mstat(14)sstat( 3)`
`SLay10H`	`--`	`mstat(14)sstat( 3)`
`SLay10M`	`--`	`mstat(14)sstat( 3)`
`Syn40M03M`	`--`	`mstat(14)sstat( 3)`
`Syn40M04M`	`--`	`mstat(14)sstat( 3)`
`sssd-12-5-3`	`--`	`mstat(14)sstat( 3)`
`sssd-15-6-3`	`--`	`mstat(14)sstat( 3)`
`sssd-16-8-3`	`--`	`mstat(14)sstat( 3)`
`sssd-18-8-3`	`--`	`mstat(14)sstat( 3)`
`sssd-20-9-3`	`--`	`mstat(14)sstat( 3)`
`sssd-22-8-3`	`--`	`mstat(14)sstat( 3)`
`uflquad-15-60`	`--`	`mstat(14)sstat( 3)`
`uflquad-15-80`	`--`	`mstat(14)sstat( 3)`
`uflquad-20-40`	`--`	`mstat(14)sstat( 3)`
`uflquad-20-50`	`--`	`mstat(14)sstat( 3)`
`uflquad-25-40`	`--`	`mstat(14)sstat( 3)`
`nd-13`	`--`	`mstat(14)sstat( 3)`
`nd-15`	`--`	`mstat(14)sstat( 3)`
`nd-16`	`--`	`mstat(14)sstat( 3)`
`fo7_ar25_1`	`--`	`mstat(14)sstat( 3)`
`fo7_ar3_1`	`--`	`mstat(14)sstat( 3)`
`fo7_ar4_1`	`--`	`mstat(14)sstat( 3)`
`fo7`	`--`	`mstat(14)sstat( 3)`
`fo8_ar2_1`	`--`	`mstat(14)sstat( 3)`
`fo8_ar25_1`	`--`	`mstat(14)sstat( 3)`
`fo8_ar3_1`	`--`	`mstat(14)sstat( 3)`
`fo8_ar4_1`	`--`	`mstat(14)sstat( 3)`
`fo8_ar5_1`	`--`	`mstat(14)sstat( 3)`
`fo8`	`--`	`mstat(14)sstat( 3)`
`fo9_ar2_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar25_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar3_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar4_1`	`--`	`mstat(14)sstat( 3)`
`fo9_ar5_1`	`--`	`mstat(14)sstat( 3)`
`fo9`	`--`	`mstat(14)sstat( 3)`
`netmod_dol1`	`--`	`mstat(14)sstat( 3)`
`netmod_dol2`	`--`	`mstat(14)sstat( 3)`
`netmod_kar1`	`--`	`mstat(14)sstat( 3)`
`netmod_kar2`	`--`	`mstat(14)sstat( 3)`
`no7_ar2_1`	`--`	`mstat(14)sstat( 3)`
`no7_ar25_1`	`--`	`mstat(14)sstat( 3)`
`no7_ar3_1`	`--`	`mstat(14)sstat( 3)`
`no7_ar4_1`	`--`	`mstat(14)sstat( 3)`
`no7_ar5_1`	`--`	`mstat(14)sstat( 3)`
`o7_2`	`--`	`mstat(14)sstat( 3)`
`o7_ar2_1`	`--`	`mstat(14)sstat( 3)`
`o7_ar25_1`	`--`	`mstat(14)sstat( 3)`
`o7_ar3_1`	`--`	`mstat(14)sstat( 3)`
`o7_ar4_1`	`--`	`mstat(14)sstat( 3)`
`o7_ar5_1`	`--`	`mstat(14)sstat( 3)`
`o7`	`--`	`mstat(14)sstat( 3)`
`o8_ar4_1`	`--`	`mstat(14)sstat( 3)`
`o9_ar4_1`	`--`	`mstat(14)sstat( 3)`
`tls12`	`--`	`mstat(14)sstat( 3)`
`tls4`	`--`	`mstat(14)sstat( 3)`
`tls5`	`--`	`mstat(14)sstat( 3)`
`tls6`	`--`	`mstat(14)sstat( 3)`
`tls7`	`--`	`mstat(14)sstat( 3)`

ALPHAECP_alphaecp-minlpconvex2: all -- BONMIN_bonmin-oa: all

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (7652.26 seconds). The shift is 10s.

Modelname	Time (ALPHAECP_alphaecp-minlpconvex2)	Time (BONMIN_bonmin-oa)	Ratio (ALPHAECP_alphaecp-minlpconvex2/ BONMIN_bonmin-oa)	Obj (ALPHAECP_alphaecp-minlpconvex2)	Obj (BONMIN_bonmin-oa)	ObjEst (ALPHAECP_alphaecp-minlpconvex2)	ObjEst (BONMIN_bonmin-oa)	Gap (ALPHAECP_alphaecp-minlpconvex2)	Gap (BONMIN_bonmin-oa)
`BatchS101006M`	`46.3370`	`443.5540`	`0.104`	`769440.00000000`	`769440.00000000`	`769440.00000000`	`769440.00000000`	`0.0000`	`0.0000`
`BatchS121208M`	`887.7220`	`655.4940`	`1.354`	`1241130.00000000`	`1241130.00000000`	`1241130.00000000`	`1241130.00000000`	`0.0000`	`0.0000`
`BatchS151208M`	`1088.1000`	`4421.2200`	`0.246`	`1543470.00000000`	`1543470.00000000`	`1543470.00000000`	`1543470.00000000`	`0.0000`	`0.0000`
`BatchS201210M`	`127.0950`	`7325.7400`	---	`2295350.00000000`	`mstat(14) sstat(3)`	`2295350.00000000`	---	`0.0000`	`---`
`clay0203h`	`3.0090`	`3.1620`	`0.952`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`0.0000`	`0.0000`
`clay0203m`	`2.0080`	`2.1970`	`0.914`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`41573.30000000`	`0.0000`	`0.0000`
`clay0204h`	`11.3170`	`7.6910`	`1.471`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`0.0000`	`0.0000`
`clay0204m`	`6.1480`	`3.3410`	`1.840`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`6545.00000000`	`0.0000`	`0.0000`
`clay0205h`	`38.3660`	`1044.7000`	`0.037`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0205m`	`22.6960`	`122.4660`	`0.185`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0303h`	`3.9740`	`5.9620`	`0.667`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`0.0000`	`0.0000`
`clay0303m`	`3.0000`	`5.6360`	`0.532`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`26669.10000000`	`0.0000`	`0.0000`
`clay0304h`	`16.5760`	`263.1000`	`0.063`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`0.0000`	`0.0000`
`clay0304m`	`7.2770`	`304.5220`	`0.024`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`40262.40000000`	`0.0000`	`0.0000`
`clay0305h`	`43.1620`	`3838.3900`	`0.011`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`clay0305m`	`24.5400`	`258.4510`	`0.095`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`8092.50000000`	`0.0000`	`0.0000`
`FLay03H`	`8.6170`	`1.9810`	`4.350`	`48.98980000`	`48.98980000`	`48.98980000`	`48.98980000`	`0.0000`	`0.0000`
`FLay03M`	`3.3270`	`0.7030`	`4.733`	`48.98980000`	`48.98980000`	`48.98980000`	`48.98980000`	`0.0000`	`0.0000`
`FLay04H`	`147.2640`	`188.1580`	`0.783`	`54.40590000`	`54.40590000`	`54.40590000`	`54.40590000`	`0.0000`	`0.0000`
`FLay04M`	`118.6470`	`21.4410`	`5.534`	`54.40590000`	`54.40590000`	`54.40590000`	`54.40590000`	`0.0000`	`0.0000`
`FLay05H`	`7202.2400`	`7414.4400`	---	`64.49810000`	`mstat(14) sstat(3)`	`59.95990000`	---	`0.0757`	`---`
`FLay05M`	`7202.2100`	`7392.0500`	---	`64.49810000`	`mstat(14) sstat(3)`	`54.40540000`	---	`0.1855`	`---`
`FLay06H`	`7202.2200`	`7444.9700`	---	`66.93280000`	`mstat(14) sstat(3)`	`65.70550000`	---	`0.0187`	`---`
`FLay06M`	`7202.3700`	`7509.8000`	---	`66.93280000`	`mstat(14) sstat(3)`	`65.28080000`	---	`0.0253`	`---`
`RSyn0810H (max)`	`0.6630`	`0.3760`	`1.763`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`0.0000`	`0.0000`
`RSyn0810M02H (max)`	`6.3970`	`3.1690`	`2.019`	`1741.39000000`	`1741.39000000`	`1741.39000000`	`1741.39000000`	`0.0000`	`0.0000`
`RSyn0810M02M (max)`	`29.5920`	`1576.3700`	`0.019`	`1741.39000000`	`1741.39000000`	`1741.39000000`	`1741.39000000`	`0.0000`	`0.0000`
`RSyn0810M03H (max)`	`11.5210`	`16.1540`	`0.713`	`2722.45000000`	`2722.45000000`	`2722.45000000`	`2722.45000000`	`0.0000`	`0.0000`
`RSyn0810M03M (max)`	`35.6170`	`7502.6900`	---	`2722.45000000`	`mstat(14) sstat(3)`	`2722.45000000`	---	`0.0000`	`---`
`RSyn0810M04H (max)`	`16.9230`	`5.9150`	`2.861`	`6581.94000000`	`6581.94000000`	`6581.94000000`	`6581.94000000`	`0.0000`	`0.0000`
`RSyn0810M04M (max)`	`32.5020`	`7287.3300`	---	`6581.93000000`	`mstat(14) sstat(3)`	`6581.94000000`	---	`0.0000`	`---`
`RSyn0810M (max)`	`1.1460`	`5.4510`	`0.210`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`1721.45000000`	`0.0000`	`0.0000`
`RSyn0820H (max)`	`1.3090`	`2.8310`	`0.462`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`0.0000`	`0.0000`
`RSyn0820M02H (max)`	`4.4300`	`4.7770`	`0.927`	`1092.09000000`	`1092.09000000`	`1092.09000000`	`1092.09000000`	`0.0000`	`0.0000`
`RSyn0820M02M (max)`	`28.0010`	`7628.2600`	---	`1092.09000000`	`mstat(14) sstat(3)`	`1092.09000000`	---	`0.0000`	`---`
`RSyn0820M03H (max)`	`7.7190`	`40.6240`	`0.190`	`2028.81000000`	`2028.81000000`	`2028.81000000`	`2028.81000000`	`0.0000`	`0.0000`
`RSyn0820M03M (max)`	`23.0700`	`7489.7400`	---	`2028.81000000`	`mstat(14) sstat(3)`	`2028.81000000`	---	`0.0000`	`---`
`RSyn0820M04H (max)`	`11.6270`	`23.8390`	`0.488`	`2450.77000000`	`2450.77000000`	`2450.77000000`	`2450.77000000`	`0.0000`	`0.0000`
`RSyn0820M04M (max)`	`26.0200`	`7390.2200`	---	`2450.77000000`	`mstat(14) sstat(3)`	`2450.77000000`	---	`0.0000`	`---`
`RSyn0820M (max)`	`2.3010`	`26.1020`	`0.088`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`1150.30000000`	`0.0000`	`0.0000`
`RSyn0840H (max)`	`2.4300`	`0.9380`	`2.591`	`325.55500000`	`325.55500000`	`325.55500000`	`325.55500000`	`0.0000`	`0.0000`
`RSyn0840M02H (max)`	`13.8590`	`2.6350`	`5.260`	`734.98400000`	`734.98400000`	`734.98500000`	`734.98400000`	`0.0000`	`0.0000`
`RSyn0840M02M (max)`	`29.1150`	`4692.2000`	`0.006`	`734.98300000`	`734.98400000`	`734.98500000`	`734.98400000`	`0.0000`	`0.0000`
`RSyn0840M03H (max)`	`30.3690`	`16.8210`	`1.805`	`2742.65000000`	`2742.65000000`	`2742.65000000`	`2742.65000000`	`0.0000`	`0.0000`
`RSyn0840M03M (max)`	`50.1770`	`7529.0700`	---	`2742.65000000`	`mstat(14) sstat(3)`	`2742.65000000`	---	`0.0000`	`---`
`RSyn0840M04H (max)`	`77.1670`	`20.5300`	`3.759`	`2564.50000000`	`2564.50000000`	`2564.50000000`	`2564.50000000`	`0.0000`	`0.0000`
`RSyn0840M04M (max)`	`543.7590`	`7386.2300`	---	`2564.50000000`	`mstat(14) sstat(3)`	`2564.50000000`	---	`0.0000`	`---`
`RSyn0840M (max)`	`2.5790`	`71.2250`	`0.036`	`325.55500000`	`325.55500000`	`325.55500000`	`325.55500000`	`0.0000`	`0.0000`
`SLay05H`	`118.8330`	`17.2600`	`6.885`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`0.0000`	`0.0000`
`SLay05M`	`77.8080`	`2.3100`	`33.683`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`22664.70000000`	`0.0000`	`0.0000`
`SLay06H`	`244.1010`	`1071.9600`	`0.228`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`0.0000`	`0.0000`
`SLay06M`	`157.3150`	`5.9020`	`26.655`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`32757.00000000`	`0.0000`	`0.0000`
`SLay07H`	`746.2320`	`7358.1300`	---	`64748.80000000`	`mstat(14) sstat(3)`	`64748.80000000`	---	`0.0000`	`---`
`SLay07M`	`431.6340`	`75.2940`	`5.733`	`64748.80000000`	`64748.80000000`	`64748.80000000`	`64748.80000000`	`0.0000`	`0.0000`
`SLay08H`	`1579.8000`	`7392.2500`	---	`84960.20000000`	`mstat(14) sstat(3)`	`84960.20000000`	---	`0.0000`	`---`
`SLay08M`	`821.5290`	`4354.4900`	`0.189`	`84960.20000000`	`84960.20000000`	`84960.20000000`	`84960.20000000`	`0.0000`	`0.0000`
`SLay09H`	`7202.2300`	`7457.6700`	---	`107983.00000000`	`mstat(14) sstat(3)`	`98642.60000000`	---	`0.0947`	`---`
`SLay09M`	`2096.7000`	`7497.8700`	---	`107806.00000000`	`mstat(14) sstat(3)`	`107806.00000000`	---	`0.0000`	`---`
`SLay10H`	`7202.0600`	`7430.0300`	---	`129876.00000000`	`mstat(14) sstat(3)`	`118969.00000000`	---	`0.0917`	`---`
`SLay10M`	`7202.2800`	`7590.3000`	---	`129796.00000000`	`mstat(14) sstat(3)`	`112365.00000000`	---	`0.1551`	`---`
`Syn10H (max)`	`0.0950`	`0.1470`	`0.646`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`0.0000`	`0.0000`
`Syn10M02H (max)`	`1.0430`	`0.2170`	`4.806`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`0.0000`	`0.0000`
`Syn10M02M (max)`	`0.7600`	`0.3820`	`1.990`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`2310.30000000`	`0.0000`	`0.0000`
`Syn10M03H (max)`	`1.1770`	`0.2580`	`4.562`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`0.0000`	`0.0000`
`Syn10M03M (max)`	`1.0970`	`1.2110`	`0.906`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`3354.68000000`	`0.0000`	`0.0000`
`Syn10M04H (max)`	`2.1200`	`0.2430`	`8.724`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`0.0000`	`0.0000`
`Syn10M04M (max)`	`1.9320`	`1.1090`	`1.742`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`4557.06000000`	`0.0000`	`0.0000`
`Syn10M (max)`	`0.1580`	`0.1230`	`1.285`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`1267.35000000`	`0.0000`	`0.0000`
`Syn20H (max)`	`0.8670`	`0.2340`	`3.705`	`924.26300000`	`924.26300000`	`924.26500000`	`924.26300000`	`0.0000`	`0.0000`
`Syn20M02H (max)`	`1.2090`	`0.5260`	`2.298`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`0.0000`	`0.0000`
`Syn20M02M (max)`	`0.9900`	`1.7920`	`0.552`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`1752.13000000`	`0.0000`	`0.0000`
`Syn20M03H (max)`	`2.2050`	`0.3970`	`5.554`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`0.0000`	`0.0000`
`Syn20M03M (max)`	`1.5200`	`11.1250`	`0.137`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`2646.95000000`	`0.0000`	`0.0000`
`Syn20M04H (max)`	`3.0560`	`0.6710`	`4.554`	`3532.74000000`	`3532.74000000`	`3532.75000000`	`3532.74000000`	`0.0000`	`0.0000`
`Syn20M04M (max)`	`2.5290`	`8.8990`	`0.284`	`3532.74000000`	`3532.74000000`	`3532.74000000`	`3532.74000000`	`0.0000`	`0.0000`
`Syn20M (max)`	`1.1480`	`0.3360`	`3.417`	`924.26300000`	`924.26300000`	`924.26400000`	`924.26300000`	`0.0000`	`0.0000`
`Syn40H (max)`	`2.2640`	`0.9220`	`2.456`	`67.71340000`	`67.71340000`	`67.71360000`	`67.71340000`	`0.0000`	`0.0000`
`Syn40M02H (max)`	`4.9100`	`1.4350`	`3.422`	`388.77300000`	`388.77300000`	`388.77400000`	`388.77300000`	`0.0000`	`0.0000`
`Syn40M02M (max)`	`4.3890`	`255.9740`	`0.017`	`388.77200000`	`388.77200000`	`388.77300000`	`388.77200000`	`0.0000`	`0.0000`
`Syn40M03H (max)`	`10.8970`	`5.6220`	`1.938`	`395.14900000`	`395.14900000`	`395.15000000`	`395.14900000`	`0.0000`	`0.0000`
`Syn40M03M (max)`	`10.4170`	`7316.0000`	---	`395.14800000`	`mstat(14) sstat(3)`	`395.14900000`	---	`0.0000`	`---`
`Syn40M04H (max)`	`21.2340`	`16.9830`	`1.250`	`901.75200000`	`901.75200000`	`901.75500000`	`901.75200000`	`0.0000`	`0.0000`
`Syn40M04M (max)`	`20.9420`	`7366.7500`	---	`901.75100000`	`mstat(14) sstat(3)`	`901.75400000`	---	`0.0000`	`---`
`Syn40M (max)`	`2.2290`	`1.7210`	`1.295`	`67.71330000`	`67.71330000`	`67.71350000`	`67.71330000`	`0.0000`	`0.0000`
`sssd-8-4-3`	`3.1510`	`24.5310`	`0.128`	`197181.00000000`	`197181.00000000`	`197181.00000000`	`197181.00000000`	`0.0000`	`0.0000`
`sssd-10-4-3`	`6.8130`	`295.4730`	`0.023`	`152710.00000000`	`152710.00000000`	`152710.00000000`	`152710.00000000`	`0.0000`	`0.0000`
`sssd-12-5-3`	`24.2350`	`7644.0900`	---	`261143.00000000`	`mstat(14) sstat(3)`	`261142.00000000`	---	`0.0000`	`---`
`sssd-15-6-3`	`118.7660`	`7652.2600`	---	`440711.00000000`	`mstat(14) sstat(3)`	`440711.00000000`	---	`0.0000`	`---`
`sssd-16-8-3`	`3710.8100`	`7560.7900`	---	`615763.00000000`	`mstat(14) sstat(3)`	`615763.00000000`	---	`0.0000`	`---`
`sssd-18-8-3`	`5649.0100`	`7563.5400`	---	`524063.00000000`	`mstat(14) sstat(3)`	`524063.00000000`	---	`0.0000`	`---`
`sssd-20-9-3`	`7202.5300`	`7579.0800`	---	`489487.00000000`	`mstat(14) sstat(3)`	`467306.00000000`	---	`0.0475`	`---`
`sssd-22-8-3`	`7202.7000`	`7595.1700`	---	`602410.00000000`	`mstat(14) sstat(3)`	`585703.00000000`	---	`0.0285`	`---`
`uflquad-15-60`	`7202.2100`	`7313.5200`	---	`1063.19000000`	`mstat(14) sstat(3)`	`150.03600000`	---	`6.0862`	`---`
`uflquad-15-80`	`7202.2300`	`7304.0200`	---	`1217.99000000`	`mstat(14) sstat(3)`	`-56.14740000`	---	`22.6927`	`---`
`uflquad-20-40`	`7202.1600`	`7323.5200`	---	`860.96100000`	`mstat(14) sstat(3)`	`111.42300000`	---	`6.7270`	`---`
`uflquad-20-50`	`7202.1300`	`7309.2200`	---	`394.98200000`	`mstat(14) sstat(3)`	`-483.34100000`	---	`1.8172`	`---`
`uflquad-25-25`	`7202.1900`	`3815.8500`	`1.887`	`673.69700000`	`673.69700000`	`229.50000000`	`673.69700000`	`1.9355`	`0.0000`
`uflquad-25-30`	`7202.1900`	`3352.3800`	`2.148`	`669.84000000`	`669.84000000`	`22.43660000`	`669.84000000`	`28.8548`	`0.0000`
`uflquad-25-40`	`7202.2000`	`7311.1900`	---	`828.16500000`	`mstat(14) sstat(3)`	`193.96600000`	---	`3.2696`	`---`
`nd-10`	`5943.3000`	`448.2020`	`13.260`	`52.46110000`	`52.46110000`	`52.46110000`	`52.46110000`	`0.0000`	`0.0000`
`nd-12`	`684.6800`	`660.6810`	`1.036`	`56.66960000`	`56.66960000`	`56.66960000`	`56.66960000`	`0.0000`	`0.0000`
`nd-13`	`7202.3300`	`7242.2500`	---	`63.00510000`	`mstat(14) sstat(3)`	`53.17870000`	---	`0.1848`	`---`
`nd-15`	`7202.2600`	`7317.9200`	---	`mstat(13) sstat(1)`	`mstat(14) sstat(3)`	---	---	---	---
`nd-16`	`7202.3300`	`7310.7200`	---	`98.19780000`	`mstat(14) sstat(3)`	`89.58430000`	---	`0.0961`	`---`
`fo7_2`	`16.2510`	`2450.5400`	`0.007`	`17.74930000`	`17.74930000`	`17.74930000`	`17.74930000`	`0.0000`	`0.0000`
`fo7_ar2_1`	`71.6920`	`7014.3900`	`0.010`	`24.83980000`	`24.83980000`	`24.83980000`	`24.83980000`	`0.0000`	`0.0000`
`fo7_ar25_1`	`68.7200`	`7344.8200`	---	`23.09360000`	`mstat(14) sstat(3)`	`23.09360000`	---	`0.0000`	`---`
`fo7_ar3_1`	`143.0130`	`7348.9900`	---	`22.51750000`	`mstat(14) sstat(3)`	`22.51750000`	---	`0.0000`	`---`
`fo7_ar4_1`	`129.5990`	`7356.0500`	---	`20.72980000`	`mstat(14) sstat(3)`	`20.72980000`	---	`0.0000`	`---`
`fo7_ar5_1`	`26.7280`	`3347.9200`	`0.008`	`17.74930000`	`17.74930000`	`17.74930000`	`17.74930000`	`0.0000`	`0.0000`
`fo7`	`158.3240`	`7533.0200`	---	`20.72980000`	`mstat(14) sstat(3)`	`20.72980000`	---	`0.0000`	`---`
`fo8_ar2_1`	`416.7040`	`7337.5900`	---	`30.34060000`	`mstat(14) sstat(3)`	`30.34060000`	---	`0.0000`	`---`
`fo8_ar25_1`	`432.2920`	`7368.5500`	---	`28.04520000`	`mstat(14) sstat(3)`	`28.04520000`	---	`0.0000`	`---`
`fo8_ar3_1`	`175.8330`	`7385.6400`	---	`23.91010000`	`mstat(14) sstat(3)`	`23.91010000`	---	`0.0000`	`---`
`fo8_ar4_1`	`130.3020`	`7376.7900`	---	`22.38190000`	`mstat(14) sstat(3)`	`22.38190000`	---	`0.0000`	`---`
`fo8_ar5_1`	`469.2460`	`7363.1100`	---	`22.38190000`	`mstat(14) sstat(3)`	`22.38190000`	---	`0.0000`	`---`
`fo8`	`532.1980`	`7461.6700`	---	`22.38190000`	`mstat(14) sstat(3)`	`22.38190000`	---	`0.0000`	`---`
`fo9_ar2_1`	`1938.4500`	`7319.4100`	---	`32.62500000`	`mstat(14) sstat(3)`	`32.62500000`	---	`0.0000`	`---`
`fo9_ar25_1`	`7202.1900`	`7320.8600`	---	`32.18640000`	`mstat(14) sstat(3)`	`31.30790000`	---	`0.0281`	`---`
`fo9_ar3_1`	`1033.5200`	`7355.2500`	---	`24.81550000`	`mstat(14) sstat(3)`	`24.81550000`	---	`0.0000`	`---`
`fo9_ar4_1`	`1274.7400`	`7367.7300`	---	`23.46430000`	`mstat(14) sstat(3)`	`23.46430000`	---	`0.0000`	`---`
`fo9_ar5_1`	`2653.3400`	`7366.9600`	---	`23.46430000`	`mstat(14) sstat(3)`	`23.46430000`	---	`0.0000`	`---`
`fo9`	`3049.9300`	`7389.2400`	---	`23.46430000`	`mstat(14) sstat(3)`	`23.46430000`	---	`0.0000`	`---`
`m3`	`0.4270`	`0.1970`	`2.168`	`37.80000000`	`37.80000000`	`37.80000000`	`37.80000000`	`0.0000`	`0.0000`
`m6`	`1.4800`	`19.7720`	`0.075`	`82.25690000`	`82.25690000`	`82.25690000`	`82.25690000`	`0.0000`	`0.0000`
`m7_ar2_1`	`6.8390`	`150.4520`	`0.045`	`190.23500000`	`190.23500000`	`190.23500000`	`190.23500000`	`0.0000`	`0.0000`
`m7_ar25_1`	`1.0600`	`51.6280`	`0.021`	`143.58500000`	`143.58500000`	`143.58500000`	`143.58500000`	`0.0000`	`0.0000`
`m7_ar3_1`	`10.8580`	`726.3280`	`0.015`	`143.58500000`	`143.58500000`	`143.58500000`	`143.58500000`	`0.0000`	`0.0000`
`m7_ar4_1`	`0.9760`	`864.4930`	`0.001`	`106.75700000`	`106.75700000`	`106.75700000`	`106.75700000`	`0.0000`	`0.0000`
`m7_ar5_1`	`3.7390`	`1070.7000`	`0.003`	`106.46000000`	`106.46000000`	`106.46000000`	`106.46000000`	`0.0000`	`0.0000`
`m7`	`2.8200`	`140.0070`	`0.020`	`106.75700000`	`106.75700000`	`106.75700000`	`106.75700000`	`0.0000`	`0.0000`
`netmod_dol1`	`7202.1700`	`7246.7400`	---	`-0.55976000`	`mstat(14) sstat(3)`	`-0.64218600`	---	`0.1284`	`---`
`netmod_dol2`	`408.5090`	`7226.8800`	---	`-0.56000800`	`mstat(14) sstat(3)`	`-0.56000800`	---	`0.0000`	`---`
`netmod_kar1`	`81.9920`	`7342.0500`	---	`-0.41979000`	`mstat(14) sstat(3)`	`-0.41979000`	---	`0.0000`	`---`
`netmod_kar2`	`82.5560`	`7340.4800`	---	`-0.41979000`	`mstat(14) sstat(3)`	`-0.41979000`	---	`0.0000`	`---`
`no7_ar2_1`	`131.1430`	`7416.5100`	---	`107.81500000`	`mstat(14) sstat(3)`	`107.81500000`	---	`0.0000`	`---`
`no7_ar25_1`	`221.2130`	`7478.8100`	---	`107.81500000`	`mstat(14) sstat(3)`	`107.81500000`	---	`0.0000`	`---`
`no7_ar3_1`	`361.9430`	`7346.9800`	---	`107.81500000`	`mstat(14) sstat(3)`	`107.81500000`	---	`0.0000`	`---`
`no7_ar4_1`	`308.8270`	`7509.2500`	---	`98.51840000`	`mstat(14) sstat(3)`	`98.51840000`	---	`0.0000`	`---`
`no7_ar5_1`	`197.2660`	`7520.3100`	---	`90.62270000`	`mstat(14) sstat(3)`	`90.62270000`	---	`0.0000`	`---`
`o7_2`	`1225.8300`	`7491.1900`	---	`116.94600000`	`mstat(14) sstat(3)`	`116.94600000`	---	`0.0000`	`---`
`o7_ar2_1`	`164.5370`	`7377.7100`	---	`140.41200000`	`mstat(14) sstat(3)`	`140.41200000`	---	`0.0000`	`---`
`o7_ar25_1`	`876.7070`	`7508.8200`	---	`140.41200000`	`mstat(14) sstat(3)`	`140.41200000`	---	`0.0000`	`---`
`o7_ar3_1`	`689.1960`	`7447.6000`	---	`137.93200000`	`mstat(14) sstat(3)`	`137.93200000`	---	`0.0000`	`---`
`o7_ar4_1`	`4416.5100`	`7486.9600`	---	`131.65300000`	`mstat(14) sstat(3)`	`131.65300000`	---	`0.0000`	`---`
`o7_ar5_1`	`645.0260`	`7509.7000`	---	`116.94600000`	`mstat(14) sstat(3)`	`116.94600000`	---	`0.0000`	`---`
`o7`	`7202.2300`	`7602.1300`	---	`131.65300000`	`mstat(14) sstat(3)`	`97.11390000`	---	`0.3557`	`---`
`o8_ar4_1`	`7202.4500`	`7422.9300`	---	`243.07100000`	`mstat(14) sstat(3)`	`174.30600000`	---	`0.3945`	`---`
`o9_ar4_1`	`7202.6900`	`7408.1400`	---	`266.02800000`	`mstat(14) sstat(3)`	`210.81100000`	---	`0.2619`	`---`
`tls12`	`7202.3000`	`7447.2500`	---	`mstat(14) sstat(3)`	`mstat(14) sstat(3)`	---	---	---	---
`tls2`	`0.3030`	`0.9500`	`0.319`	`5.30000000`	`5.30000000`	`5.30000000`	`5.30000000`	`0.0000`	`0.0000`
`tls4`	`224.4940`	`7444.0400`	---	`8.30000000`	`mstat(14) sstat(3)`	`8.30000000`	---	`0.0000`	`---`
`tls5`	`7202.2800`	`7519.4400`	---	`14.60000000`	`mstat(14) sstat(3)`	`6.30000000`	---	`1.3175`	`---`
`tls6`	`7202.2800`	`7442.1800`	---	`39.10000000`	`mstat(14) sstat(3)`	`3.86909000`	---	`9.1057`	`---`
`tls7`	`7202.3400`	`7301.9600`	---	`53.80000000`	`mstat(14) sstat(3)`	`1.34735000`	---	`38.9302`	`---`
Shifted Geometric Mean (Solved)	145.95	601.49
% Unsolved	18.06%	47.10%