Resource Time Comparison

Resource Times:

Date / Time: 09/02/07 15:50:38

See the solver return definitions for optimal/feasible model and solve statuses. Solutions are not checked for how close they are to eachother. Resource times are considered the same, if they are within 10% of eachother. A solver is considered faster than another, if it is less than 50% faster than the other. A solver is considered much faster than another, if it is more than 50% faster than the other.

If a model was not solved optimal/feasible by both solvers, the resource time is considered the same. If a model was solved optimal/feasible by solver A but not by solver B, then solver A is considered infinitely faster than solver B. Similarly, if one solver has trace data and the other has no data, then the first solver is consideredinfinitely faster.

A solver is considered to have a better objective function value, if the relative objective value difference is greater than 1.00E-05 For objective values below 1e-1 we use absolute differences.

Tracefile 1 :	`1-SBB-1_noSOSsemicon.trc`
Tracefile 2 :	`2-AlphaECP-1_noSOSsemicon.trc`
Solvers used :	`SBB-CONOPT`
	`AlphaECP-CPLEX`
Modeltype(s)	`MINLP`
Threshold: Solver Faster	`10%`
Threshold: Solver Much Faster	`50%`
Threshold: Solver Infinitely Faster	`Other solver failed`

	Total	Obj SBB-CONOPT better	Obj same	Obj AlphaECP-CPLEX better
Solver SBB-CONOPT infinitely faster :	`36`	`36`	-	-
Solver SBB-CONOPT much faster :	`80`	`22`	`39`	`19`
Solver SBB-CONOPT faster :	`3`	-	`1`	`2`
Solvers perform the same :	`7`	`4`	`2`	`1`
Solver AlphaECP-CPLEX faster :	-	-	-	-
Solver AlphaECP-CPLEX much faster :	`17`	`11`	`1`	`5`
Solver AlphaECP-CPLEX infinitely faster :	`7`	-	-	`7`
Both solvers failed to solve optimally :	`11`	-	`11`	-
Total models: :	`161`	`73`	`54`	`34`

Solver return definition:

Outcome	Model Status	Solver Status
globally optimal	1 or 15	1
locally optimal/feasible	2 or 8 or 16	1 or 2 or 3 or 4 or 5

Resource Times:

Models for each resource time category. Listed are the solver resource times TIME(.) in seconds, as well as the ratio of resource times RATIO(.)for the two solvers if both solved optimally. Models not solved optimally by a solver have status listed instead of resource time.
Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05.
Solver resource time ratios for a particular model are listed only if both solvers are optimal and if one solver has resource time greater than 5.00E-02.

Solver SBB-CONOPT infinitely faster - Obj of SBB-CONOPT better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`4stufen`	`2.4000`	`infeasible`	--	`1.16340860E+05`	1.00000000E+20
`beuster`	`86.4000`	`infeasible`	--	`1.16431316E+05`	1.00000000E+20
`blendgap`	`0.0300`	`fail`	--	`0.00000000E+00`	1.00000000E+20
`deb10`	`0.2300`	`infeasible`	--	`2.09427812E+02`	1.00000000E+20
`deb6`	`6.9000`	`infeasible`	--	`2.01739305E+02`	1.00000000E+20
`deb9`	`22.7600`	`infeasible`	--	`1.16584559E+02`	1.00000000E+20
`enpro48`	`3.3900`	`fail`	--	`1.87277259E+05`	1.00000000E+20
`enpro56`	`31.5100`	`fail`	--	`2.63428301E+05`	1.00000000E+20
`ex1221`	`0.0100`	`fail`	--	`7.66718007E+00`	1.00000000E+20
`ex1252`	`1.3000`	`fail`	--	`1.28893741E+05`	1.00000000E+20
`ex1252a`	`0.7500`	`fail`	--	`1.28893741E+05`	1.00000000E+20
`ex3`	`0.1800`	`fail`	--	`6.80097441E+01`	1.00000000E+20
`feedtray`	`0.0300`	`infeasible`	--	`-1.34059977E+01`	1.00000000E+20
`gasnet`	`0.0900`	`fail`	--	`7.04532689E+06`	1.00000000E+20
`hda`	`10.1400`	`infeasible`	--	`-5.59804813E+03`	1.00000000E+20
`lop97icx`	`218.6000`	`fail`	--	`4.18494489E+03`	1.00000000E+20
`nous1`	`0.0300`	`fail`	--	`1.56707200E+00`	1.00000000E+20
`nous2`	`0.0300`	`fail`	--	`6.25967412E-01`	1.00000000E+20
`nuclear14a`	`1.3300`	`infeasible`	--	`-1.12821323E+00`	1.00000000E+20
`nuclear24a`	`1.3300`	`infeasible`	--	`-1.12821323E+00`	1.00000000E+20
`nuclearva`	`6.0200`	`infeasible`	--	`-1.01012730E+00`	1.00000000E+20
`nvs01`	`0.0100`	`fail`	--	`1.24696688E+01`	1.00000000E+20
`nvs02`	`0.0400`	`fail`	--	`5.96418452E+00`	1.00000000E+20
`nvs05`	`0.0500`	`fail`	--	`5.47093411E+00`	1.00000000E+20
`oil2`	`0.4500`	`infeasible`	--	`-7.33260012E-01`	1.00000000E+20
`pump`	`0.0200`	`fail`	--	`1.34263585E+05`	1.00000000E+20
`ravem`	`0.8800`	`fail`	--	`2.69590219E+05`	1.00000000E+20
`risk2b`	`0.3900`	`fail`	--	`-5.57361685E+01`	1.00000000E+20
`space25`	`85.4300`	`fail`	--	`4.84328644E+02`	1.00000000E+20
`space25a`	`9.5900`	`fail`	--	`4.84328644E+02`	1.00000000E+20
`spring`	`0.0700`	`infeasible`	--	`8.46245666E-01`	1.00000000E+20
`st_e32`	`0.1400`	`fail`	--	`-1.43040728E+00`	1.00000000E+20
`var_con10`	`1.5100`	`infeasible`	--	`4.44213954E+02`	1.00000000E+20
`var_con5`	`1.7800`	`infeasible`	--	`2.78144894E+02`	1.00000000E+20
`water4`	`51.3900`	`fail`	--	`9.13157068E+02`	1.00000000E+20
`windfac`	`0.0000`	`fail`	--	`2.54487298E-01`	1.00000000E+20

Solver SBB-CONOPT much faster - Obj of SBB-CONOPT better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`cecil_13`	`5.3000`	`78.0000`	`0.068`	`-1.15544840E+05`	`-1.05505796E+05`
`contvar`	`17.8400`	`3601.0000`	`0.005`	`8.09149827E+05`	`1.98647509E+06`
`csched1`	`0.7000`	`26.0000`	`0.027`	`-3.06392578E+04`	`-3.02885046E+04`
`csched2`	`29.9200`	`3600.0000`	`0.008`	`-1.65888736E+05`	`-1.55538614E+05`
`csched2a`	`5.3300`	`3600.0000`	`0.001`	`-1.65398701E+05`	`-1.50847174E+05`
`dosemin2d`	`666.9700`	`3600.0000`	`0.185`	`1.73980583E+02`	`5.10609279E+02`
`elf`	`0.5600`	`5.0000`	`0.112`	`4.34666666E-01`	`1.58568780E+00`
`ex1224`	`0.0800`	`2.0000`	`0.040`	`-9.43470500E-01`	`-7.19370688E-01`
`ex1243`	`0.1400`	`1.0000`	`0.140`	`8.34025064E+04`	`5.15069761E+05`
`ex1244`	`0.1700`	`1.0000`	`0.170`	`8.20429052E+04`	`9.54152333E+04`
`gastrans`	`0.5500`	`8.0000`	`0.069`	`8.90858400E+01`	`8.91353529E+01`
`hmittelman`	`0.5100`	`3600.0000`	`0.000`	`1.30000000E+01`	`2.10000000E+01`
`nvs04`	`0.0200`	`5.0000`	`---`	`7.20000000E-01`	`2.12000000E+00`
`ortez`	`0.1500`	`7.0000`	`0.021`	`-9.53203905E+03`	`-1.28489817E-02`
`parallel`	`0.4000`	`1.0000`	`0.400`	`9.24295551E+02`	`1.37168965E+04`
`qap`	`6.2000`	`14.0000`	`0.443`	`3.95738000E+05`	`3.99894000E+05`
`qapw`	`3.6700`	`635.0000`	`0.006`	`3.88870000E+05`	`3.99406000E+05`
`sep1`	`0.0100`	`2.0000`	`---`	`-5.10080984E+02`	`-4.65466997E+02`
`st_e29`	`0.0500`	`1.0000`	`0.050`	`-9.43470500E-01`	`-7.19370688E-01`
`stockcycle`	`98.0100`	`3600.0000`	`0.027`	`1.43295165E+05`	`4.36419130E+05`
`tln6`	`35.1900`	`495.0000`	`0.071`	`1.63000000E+01`	`1.71000000E+01`
`util`	`0.0800`	`7.0000`	`0.011`	`9.99897308E+02`	`1.00300239E+03`

Solver SBB-CONOPT much faster - Obj same for both solvers:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`alan`	`0.0100`	`1.0000`	`---`	`2.92500000E+00`	`2.92500000E+00`
`batch`	`0.2300`	`2.0000`	`0.115`	`2.85506508E+05`	`2.85506481E+05`
`batchdes`	`0.0400`	`2.0000`	`---`	`1.67427657E+05`	`1.67427656E+05`
`enpro48pb`	`3.1800`	`27.0000`	`0.118`	`1.87277259E+05`	`1.87277259E+05`
`ex1223`	`0.0600`	`3.0000`	`0.020`	`4.57958240E+00`	`4.57957678E+00`
`ex1223a`	`0.0100`	`3.0000`	`---`	`4.57958240E+00`	`4.57957997E+00`
`ex1223b`	`0.0000`	`3.0000`	`---`	`4.57958240E+00`	`4.57957678E+00`
`ex1265a`	`0.1100`	`1.0000`	`0.110`	`1.51000000E+01`	`1.51000000E+01`
`ex1266a`	`0.4500`	`1.0000`	`0.450`	`1.63000000E+01`	`1.63000000E+01`
`fac1`	`0.0100`	`83.0000`	`---`	`1.60912612E+08`	`1.60912612E+08`
`fac2`	`0.2100`	`88.0000`	`0.002`	`3.31837498E+08`	`3.31837498E+08`
`fac3`	`0.2900`	`8.0000`	`0.036`	`3.19823098E+07`	`3.19823098E+07`
`fuel`	`0.0100`	`4.0000`	`---`	`8.56611896E+03`	`8.56611451E+03`
`gbd`	`0.0000`	`1.0000`	`---`	`2.20000000E+00`	`2.20000000E+00`
`m3`	`0.4000`	`2.0000`	`0.200`	`3.78000000E+01`	`3.78000000E+01`
`minlphix`	`0.1100`	`3.0000`	`0.037`	`3.16692695E+02`	`3.16692380E+02`
`nvs03`	`0.0200`	`1.0000`	`---`	`1.60000000E+01`	`1.60000000E+01`
`nvs06`	`0.0000`	`1.0000`	`---`	`1.77031250E+00`	`1.77031250E+00`
`nvs07`	`0.0200`	`1.0000`	`---`	`4.00000000E+00`	`4.00000000E+00`
`nvs08`	`0.0400`	`4.0000`	`---`	`2.34497273E+01`	`2.34495073E+01`
`nvs09`	`0.0000`	`1.0000`	`---`	`-4.31343369E+01`	`-4.31343371E+01`
`nvs10`	`0.0200`	`2.0000`	`---`	`-3.10800000E+02`	`-3.10800000E+02`
`prob02`	`0.0100`	`1.0000`	`---`	`1.12235000E+05`	`1.12235000E+05`
`ravempb`	`0.6000`	`4.0000`	`0.150`	`2.69590219E+05`	`2.69590219E+05`
`st_e14`	`0.0200`	`2.0000`	`---`	`4.57958240E+00`	`4.57957678E+00`
`st_e27`	`0.0000`	`1.0000`	`---`	`2.00000000E+00`	`2.00000000E+00`
`st_e38`	`0.0000`	`1.0000`	`---`	`7.19772715E+03`	`7.19772715E+03`
`st_miqp1`	`0.0300`	`1.0000`	`---`	`2.81000000E+02`	`2.81000000E+02`
`st_miqp2`	`0.0300`	`1.0000`	`---`	`2.00000000E+00`	`2.00000000E+00`
`st_miqp3`	`0.0000`	`1.0000`	`---`	`-6.00000000E+00`	`-6.00000000E+00`
`st_miqp4`	`0.0000`	`1.0000`	`---`	`-4.57400000E+03`	`-4.57400000E+03`
`st_miqp5`	`0.0000`	`1.0000`	`---`	`-3.33888889E+02`	`-3.33889031E+02`
`st_test5`	`0.0600`	`1.0000`	`0.060`	`-1.10000000E+02`	`-1.10000000E+02`
`st_test6`	`0.0900`	`1.0000`	`0.090`	`4.71000000E+02`	`4.71000000E+02`
`st_test8`	`0.0100`	`1.0000`	`---`	`-2.96050000E+04`	`-2.96050000E+04`
`st_testph4`	`0.0200`	`1.0000`	`---`	`-8.05000000E+01`	`-8.05000000E+01`
`synheat`	`1.2200`	`28.0000`	`0.044`	`1.54997335E+05`	`1.54997335E+05`
`synthes3`	`0.1800`	`4.0000`	`0.045`	`6.80097405E+01`	`6.80093274E+01`
`tloss`	`0.4800`	`1.0000`	`0.480`	`1.63000000E+01`	`1.63000000E+01`

Solver SBB-CONOPT much faster - Obj of AlphaECP-CPLEX better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`csched1a`	`0.0400`	`2.0000`	`---`	`-3.02797471E+04`	`-3.04301771E+04`
`du-opt5`	`20.8200`	`453.0000`	`0.046`	`8.07365758E+00`	`8.07307759E+00`
`du-opt`	`1.7400`	`1124.0000`	`0.002`	`3.56108965E+00`	`3.55567908E+00`
`eniplac`	`12.8700`	`3600.0000`	`0.004`	`-1.30344370E+05`	`-1.31143926E+05`
`ex1222`	`0.0100`	`1.0000`	`---`	`1.07654308E+00`	`1.07611140E+00`
`ex1233`	`0.6700`	`686.0000`	`0.001`	`1.55522462E+05`	`1.55010670E+05`
`ex3pb`	`0.2400`	`19.0000`	`0.013`	`6.80097441E+01`	`6.78834858E+01`
`ex4`	`2.1700`	`6.0000`	`0.362`	`-8.06413616E+00`	`-8.06499026E+00`
`gkocis`	`0.0300`	`2.0000`	`---`	`-1.92309874E+00`	`-1.92904678E+00`
`meanvarx`	`0.0200`	`1.0000`	`---`	`1.44969830E+01`	`1.43690751E+01`
`oaer`	`0.0200`	`1.0000`	`---`	`-1.92309854E+00`	`-1.92622281E+00`
`prob10`	`0.0200`	`2.0000`	`---`	`3.44550379E+00`	`3.44472251E+00`
`procsel`	`0.0300`	`2.0000`	`---`	`-1.92309874E+00`	`-1.92405073E+00`
`risk2bpb`	`0.4200`	`2.0000`	`0.210`	`-5.57361685E+01`	`-5.58761394E+01`
`spectra2`	`1.3100`	`174.0000`	`0.008`	`1.39783059E+01`	`1.39722135E+01`
`st_testgr1`	`0.0400`	`2.0000`	`---`	`-1.27281000E+01`	`-1.28116000E+01`
`st_testgr3`	`0.0600`	`1.0000`	`0.060`	`-2.04688000E+01`	`-2.05900000E+01`
`synthes1`	`0.0300`	`1.0000`	`---`	`6.00975891E+00`	`6.00965002E+00`
`synthes2`	`0.0400`	`5.0000`	`---`	`7.30353125E+01`	`7.30345496E+01`

Solver SBB-CONOPT faster - Obj same for both solvers:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`enpro56pb`	`22.4800`	`33.0000`	`0.681`	`2.63428301E+05`	`2.63428274E+05`

Solver SBB-CONOPT faster - Obj of AlphaECP-CPLEX better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`gear`	`0.6400`	`1.0000`	`0.640`	`0.00000000E+00`	`-8.81687379E-04`
`gear3`	`0.6400`	`1.0000`	`0.640`	`0.00000000E+00`	`-8.81687379E-04`

Solvers perform the same - Obj of SBB-CONOPT better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`ex1225`	`0.0200`	`0.0000`	`---`	`3.10000000E+01`	`3.40000000E+01`
`ex1226`	`0.0000`	`0.0000`	`---`	`-1.70000000E+01`	`-8.33333333E+00`
`fuzzy`	`184.6600`	`186.0000`	`0.993`	`-4.88877286E-01`	`-3.97226190E-01`
`mbtd`	`3600.3200`	`3689.0000`	`0.976`	`5.91666000E+00`	`1.07500200E+01`

Solvers perform the same - Obj same for both solvers:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`johnall`	`1.9600`	`2.0000`	`0.980`	`-2.24730162E+02`	`-2.24730162E+02`
`prob03`	`0.0200`	`0.0000`	`---`	`1.00000000E+01`	`1.00000000E+01`

Solvers perform the same - Obj of AlphaECP-CPLEX better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`st_e35`	`0.0100`	`0.0000`	`---`	`1.17178934E+05`	`1.07419804E+05`

Solver AlphaECP-CPLEX much faster - Obj of SBB-CONOPT better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`eg_all_s`	`16.4400`	`1.0000`	`16.440`	`7.92018223E+00`	`1.59032891E+01`
`eg_disc_s`	`13.8100`	`2.0000`	`6.905`	`5.76053962E+00`	`1.20817980E+01`
`eg_disc2_s`	`6.2400`	`1.0000`	`6.240`	`5.93637221E+00`	`1.39407327E+01`
`eg_int_s`	`23.1100`	`1.0000`	`23.110`	`6.45310316E+00`	`1.54225990E+01`
`ex1263`	`29.4400`	`0.0000`	`---`	`1.96000000E+01`	`3.01000000E+01`
`ex1263a`	`3.6000`	`0.0000`	`---`	`1.96000000E+01`	`3.01000000E+01`
`ex1264`	`40.3000`	`1.0000`	`40.300`	`8.60000000E+00`	`1.11000000E+01`
`ex1264a`	`5.0800`	`0.0000`	`---`	`8.60000000E+00`	`1.11000000E+01`
`ex1265`	`1.5300`	`0.0000`	`---`	`1.13000000E+01`	`1.51000000E+01`
`gear4`	`33.5200`	`3.0000`	`11.173`	`1.64342847E+00`	`2.34384034E+03`
`pb351535`	`2345.6800`	`3.0000`	`781.893`	`4.48528800E+06`	`5.17505400E+06`

Solver AlphaECP-CPLEX much faster - Obj same for both solvers:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`ex1266`	`5.3300`	`2.0000`	`2.665`	`1.63000000E+01`	`1.63000000E+01`

Solver AlphaECP-CPLEX much faster - Obj of AlphaECP-CPLEX better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`gear2`	`14.9500`	`1.0000`	`14.950`	`9.74565345E-10`	`-5.37629908E-04`
`m6`	`196.7700`	`7.0000`	`28.110`	`1.29824936E+02`	`8.22568769E+01`
`m7`	`223.4600`	`33.0000`	`6.772`	`1.23964378E+02`	`1.06756877E+02`
`pb302035`	`3600.4800`	`2.0000`	`1800.240`	`3.80440300E+06`	`3.70914700E+06`
`waterx`	`112.8200`	`9.0000`	`12.536`	`9.38862849E+02`	`9.28092168E+02`

Solver AlphaECP-CPLEX infinitely faster - Obj of AlphaECP-CPLEX better:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`fo7`	`fail`	`504.0000`	--	`0.00000000E+00`	`2.07291844E+01`
`o7`	`fail`	`3606.0000`	--	`0.00000000E+00`	`1.53819887E+02`
`pb302095`	`fail`	`19.0000`	--	`0.00000000E+00`	`5.75331400E+06`
`pb351595`	`fail`	`132.0000`	--	`0.00000000E+00`	`6.74234600E+06`
`st_e31`	`infeasible`	`2.0000`	--	`0.00000000E+00`	`-1.98442883E+00`
`st_e36`	`infeasible`	`1.0000`	--	`0.00000000E+00`	`-2.43856813E+02`
`tltr`	`infeasible`	`1.0000`	--	`0.00000000E+00`	`5.46000000E+01`

Both solvers failed to solve optimally - Obj same for both solvers:

Modelname	Time (SBB-CONOPT)	Time (AlphaECP-CPLEX)	Ratio (SBB-CONOPT / AlphaECP-CPLEX)	Obj (SBB-CONOPT)	Obj (AlphaECP-CPLEX)
`deb7`	`infeasible`	`infeasible`	--	`1.43492391E+02`	`1.00000000E+20`
`deb8`	`infeasible`	`infeasible`	--	`2.49467682E+03`	`1.00000000E+20`
`feedtray2`	`infeasible`	`infeasible`	--	`0.00000000E+00`	`1.00000000E+20`
`st_e13`	`infeasible`	`fail`	--	`1.00000000E+00`	`1.00000000E+20`
`st_e15`	`infeasible`	`fail`	--	`3.00000000E+00`	`1.00000000E+20`
`st_e40`	`infeasible`	`fail`	--	`4.41421350E+00`	`1.00000000E+20`
`tln12`	`fail`	`fail`	--	`0.00000000E+00`	`1.00000000E+20`
`tln7`	`fail`	`fail`	--	`0.00000000E+00`	`1.00000000E+20`
`tls12`	`fail`	`fail`	--	`0.00000000E+00`	`1.00000000E+20`
`tls6`	`fail`	`fail`	--	`0.00000000E+00`	`1.00000000E+20`
`tls7`	`fail`	`fail`	--	`0.00000000E+00`	`1.00000000E+20`