Solver Square Comparison: Considers all models.

Results created on 02/25/11 16:06:56 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver DICOPT_dicopt-minlpconvex is represented on the left (rows) and solver KNITRO_default on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number Filename
Tracefile 1: MINLPconvex.DICOPT.dicopt-minlpconvex.pav
Tracefile 2: MINLPconvex.KNITRO.default.pav
Solvers used : DICOPT_dicopt-minlpconvex
KNITRO_default
Modeltype(s)   MINLP

KNITRO_default:
optimal
KNITRO_default:
locally optimal
KNITRO_default:
feasible
KNITRO_default:
infeasible
KNITRO_default:
unbounded
KNITRO_default:
fail
KNITRO_default:
no data
total DICOPT_dicopt-minlpconvex
DICOPT_dicopt-minlpconvex:
optimal
9 - 2 - - 20 - 31
DICOPT_dicopt-minlpconvex:
locally optimal
- - - - - - - -
DICOPT_dicopt-minlpconvex:
feasible
1 - 3 - - 3 - 7
DICOPT_dicopt-minlpconvex:
infeasible
- - - - - - - -
DICOPT_dicopt-minlpconvex:
unbounded
- - - - - - - -
DICOPT_dicopt-minlpconvex:
fail
3 - 2 - - 4 - 9
DICOPT_dicopt-minlpconvex:
no data
- - - - - - - -
total KNITRO_default 13 - 7 - - 27 - 47

Solver return definitions:

Outcome Model Status Solver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other

Solver Resource Times


DICOPT_dicopt-minlpconvex: optimal -- KNITRO_default: optimal    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Obj (DICOPT_dicopt-minlpconvex) Obj (KNITRO_default)
clay0303h 74.3480 124.5670 0.597 26669.10000000 26669.10000000
clay0305m 696.0040 397.2470 1.752 8092.50000000 8092.50000000
FLay04H 450.4510 115.5660 3.898 54.40590000 54.40590000
m6 0.4920 1393.7500 0.000 82.25690000 82.25690000
RSyn0805H 0.1920 208.4930 0.001 1296.12000000 1296.12000000
SLay06H 5.9210 591.4240 0.010 32757.00000000 32757.00000000
SLay07H 22.9680 2121.5800 0.011 64748.80000000 64748.80000000
SLay09M 1743.2000 88.3840 19.723 107806.00000000 107806.00000000
sssd-10-4-3 2.9150 31.2650 0.093 152710.00000000 152710.00000000

Back to top


DICOPT_dicopt-minlpconvex: optimal -- KNITRO_default: feasible    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Obj (DICOPT_dicopt-minlpconvex) Obj (KNITRO_default)
Syn15M04M 0.2200 3600.0800 0.000 4937.48000000 4900.44000000
Syn40M03H 1.1550 3600.2300 0.000 395.14900000 395.06600000

Back to top


DICOPT_dicopt-minlpconvex: optimal -- KNITRO_default: fail    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Obj (DICOPT_dicopt-minlpconvex) Status (KNITRO_default)
BatchS101006M 11.7850 3600.2700 --- 769440.00000000 mstat(14)sstat( 3)
BatchS121208M 6.5710 3600.1000 --- 1241130.00000000 mstat(14)sstat( 3)
BatchS151208M 11.1520 3600.0900 --- 1543470.00000000 mstat(14)sstat( 3)
BatchS201210M 8.2760 3600.1000 --- 2295350.00000000 mstat(14)sstat( 3)
clay0305h 454.4820 3600.1300 --- 8092.50000000 mstat(14)sstat( 3)
m7 0.8910 3600.1700 --- 106.75700000 mstat(14)sstat( 3)
RSyn0805M02M 3.8910 3600.5500 --- 2238.40000000 mstat(14)sstat( 3)
RSyn0805M03M 7.9580 3600.3900 --- 3068.93000000 mstat(14)sstat( 3)
RSyn0805M04M 8.7990 3600.3200 --- 7174.22000000 mstat(14)sstat( 3)
RSyn0810M02M 5.2570 3600.1300 --- 1741.39000000 mstat(14)sstat( 3)
RSyn0810M03M 12.4010 3600.1200 --- 2722.45000000 mstat(14)sstat( 3)
RSyn0820M 0.2560 3600.2700 --- 1150.30000000 mstat(14)sstat( 3)
RSyn0830M04H 5.3350 3600.5200 --- 2529.07000000 mstat(14)sstat( 3)
RSyn0830M 0.5680 3600.1200 --- 510.07200000 mstat(14)sstat( 3)
RSyn0840M 0.4160 3600.1100 --- 325.55500000 mstat( 7)sstat( 1)
SLay08H 430.5600 3600.1100 --- 84960.20000000 mstat(14)sstat( 3)
Syn20M03M 0.1520 3600.0900 --- 2646.95000000 mstat(14)sstat( 3)
Syn20M04M 0.2140 3600.1000 --- 3532.74000000 mstat(14)sstat( 3)
Syn30M02M 0.2620 3600.0900 --- 399.68300000 mstat(14)sstat( 3)
Syn40M 0.1550 3600.1000 --- 67.71330000 mstat(14)sstat( 3)

Back to top


DICOPT_dicopt-minlpconvex: feasible -- KNITRO_default: optimal    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Obj (DICOPT_dicopt-minlpconvex) Obj (KNITRO_default)
SLay10M 3694.7100 997.9550 3.702 134056.00000000 129580.00000000

Back to top


DICOPT_dicopt-minlpconvex: feasible -- KNITRO_default: feasible    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Obj (DICOPT_dicopt-minlpconvex) Obj (KNITRO_default)
FLay05H 3935.9300 3600.1200 1.093 64.49810000 64.49810000
uflquad-30-100 3633.2300 3600.1800 1.009 463.87200000 421.54700000
uflquad-40-80 3634.1200 3600.3700 1.009 457.97000000 428.39300000

Back to top


DICOPT_dicopt-minlpconvex: feasible -- KNITRO_default: fail    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Obj (DICOPT_dicopt-minlpconvex) Status (KNITRO_default)
clay0304h 3719.4300 1149.2700 --- 59328.70000000 mstat( 7)sstat( 1)
FLay06M 3629.3900 3600.3900 --- 66.93280000 mstat(14)sstat( 3)
fo7_2 3643.2600 3600.1600 --- 29.15300000 mstat(14)sstat( 3)

Back to top


DICOPT_dicopt-minlpconvex: fail -- KNITRO_default: optimal    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Status (DICOPT_dicopt-minlpconvex) Obj (KNITRO_default)
clay0304m 2565.5800 117.6830 --- mstat(13)sstat(13) 40262.40000000
FLay05M 4063.5800 591.0380 --- mstat(13)sstat(13) 64.49810000
sssd-12-5-3 10.6230 891.1420 --- mstat( 7)sstat( 1) 261143.00000000

Back to top


DICOPT_dicopt-minlpconvex: fail -- KNITRO_default: feasible    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Status (DICOPT_dicopt-minlpconvex) Obj (KNITRO_default)
sssd-15-6-3 132.5540 3600.1800 --- mstat( 7)sstat( 1) 441410.00000000
uflquad-20-150 345.8900 3600.1600 --- mstat(13)sstat(13) 551.51400000

Back to top


DICOPT_dicopt-minlpconvex: fail -- KNITRO_default: fail    

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/KNITRO_default) Status (DICOPT_dicopt-minlpconvex) Status (KNITRO_default)
fo7 148.4970 3600.1500 --- mstat(13)sstat(13) mstat(14)sstat( 3)
fo8 605.8660 3600.1800 --- mstat(13)sstat(13) mstat(14)sstat( 3)
o7_2 3613.2200 3600.1700 --- mstat(13)sstat(13) mstat(14)sstat( 3)
SLay09H 3640.7200 3600.1000 --- mstat(13)sstat(13) mstat(14)sstat( 3)

Back to top


DICOPT_dicopt-minlpconvex: optimal:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Obj (DICOPT_dicopt-minlpconvex)
BatchS101006M 11.7850 769440.00000000
BatchS121208M 6.5710 1241130.00000000
BatchS151208M 11.1520 1543470.00000000
BatchS201210M 8.2760 2295350.00000000
clay0303h 74.3480 26669.10000000
clay0305h 454.4820 8092.50000000
clay0305m 696.0040 8092.50000000
FLay04H 450.4510 54.40590000
m6 0.4920 82.25690000
m7 0.8910 106.75700000
RSyn0805H 0.1920 1296.12000000
RSyn0805M02M 3.8910 2238.40000000
RSyn0805M03M 7.9580 3068.93000000
RSyn0805M04M 8.7990 7174.22000000
RSyn0810M02M 5.2570 1741.39000000
RSyn0810M03M 12.4010 2722.45000000
RSyn0820M 0.2560 1150.30000000
RSyn0830M04H 5.3350 2529.07000000
RSyn0830M 0.5680 510.07200000
RSyn0840M 0.4160 325.55500000
SLay06H 5.9210 32757.00000000
SLay07H 22.9680 64748.80000000
SLay08H 430.5600 84960.20000000
SLay09M 1743.2000 107806.00000000
Syn15M04M 0.2200 4937.48000000
Syn20M03M 0.1520 2646.95000000
Syn20M04M 0.2140 3532.74000000
Syn30M02M 0.2620 399.68300000
Syn40M03H 1.1550 395.14900000
Syn40M 0.1550 67.71330000
sssd-10-4-3 2.9150 152710.00000000

Back to top


DICOPT_dicopt-minlpconvex: feasible:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Obj (DICOPT_dicopt-minlpconvex)
clay0304h 3719.4300 59328.70000000
FLay05H 3935.9300 64.49810000
FLay06M 3629.3900 66.93280000
fo7_2 3643.2600 29.15300000
SLay10M 3694.7100 134056.00000000
uflquad-30-100 3633.2300 463.87200000
uflquad-40-80 3634.1200 457.97000000

Back to top


DICOPT_dicopt-minlpconvex: fail:

Back to top

Modelname Time (DICOPT_dicopt-minlpconvex) Status (DICOPT_dicopt-minlpconvex)
clay0304m -- mstat(13) sstat(13)
FLay05M -- mstat(13) sstat(13)
fo7 -- mstat(13) sstat(13)
fo8 -- mstat(13) sstat(13)
o7_2 -- mstat(13) sstat(13)
SLay09H -- mstat(13) sstat(13)
sssd-12-5-3 -- mstat( 7) sstat( 1)
sssd-15-6-3 -- mstat( 7) sstat( 1)
uflquad-20-150 -- mstat(13) sstat(13)

Back to top


KNITRO_default: optimal:

Back to top

Modelname Time (KNITRO_default) Obj (KNITRO_default)
clay0303h 124.5670 26669.10000000
clay0304m 117.6830 40262.40000000
clay0305m 397.2470 8092.50000000
FLay04H 115.5660 54.40590000
FLay05M 591.0380 64.49810000
m6 1393.7500 82.25690000
RSyn0805H 208.4930 1296.12000000
SLay06H 591.4240 32757.00000000
SLay07H 2121.5800 64748.80000000
SLay09M 88.3840 107806.00000000
SLay10M 997.9550 129580.00000000
sssd-10-4-3 31.2650 152710.00000000
sssd-12-5-3 891.1420 261143.00000000

Back to top

KNITRO_default: feasible:

Back to top

Modelname Time (KNITRO_default) Obj (KNITRO_default)
FLay05H 3600.1200 64.49810000
Syn15M04M 3600.0800 4900.44000000
Syn40M03H 3600.2300 395.06600000
sssd-15-6-3 3600.1800 441410.00000000
uflquad-20-150 3600.1600 551.51400000
uflquad-30-100 3600.1800 421.54700000
uflquad-40-80 3600.3700 428.39300000

Back to top

KNITRO_default: fail:

Back to top

Modelname Time (KNITRO_default) Status (KNITRO_default)
BatchS101006M -- mstat(14)sstat( 3)
BatchS121208M -- mstat(14)sstat( 3)
BatchS151208M -- mstat(14)sstat( 3)
BatchS201210M -- mstat(14)sstat( 3)
clay0304h -- mstat( 7)sstat( 1)
clay0305h -- mstat(14)sstat( 3)
FLay06M -- mstat(14)sstat( 3)
fo7_2 -- mstat(14)sstat( 3)
fo7 -- mstat(14)sstat( 3)
fo8 -- mstat(14)sstat( 3)
m7 -- mstat(14)sstat( 3)
o7_2 -- mstat(14)sstat( 3)
RSyn0805M02M -- mstat(14)sstat( 3)
RSyn0805M03M -- mstat(14)sstat( 3)
RSyn0805M04M -- mstat(14)sstat( 3)
RSyn0810M02M -- mstat(14)sstat( 3)
RSyn0810M03M -- mstat(14)sstat( 3)
RSyn0820M -- mstat(14)sstat( 3)
RSyn0830M04H -- mstat(14)sstat( 3)
RSyn0830M -- mstat(14)sstat( 3)
RSyn0840M -- mstat( 7)sstat( 1)
SLay08H -- mstat(14)sstat( 3)
SLay09H -- mstat(14)sstat( 3)
Syn20M03M -- mstat(14)sstat( 3)
Syn20M04M -- mstat(14)sstat( 3)
Syn30M02M -- mstat(14)sstat( 3)
Syn40M -- mstat(14)sstat( 3)

Back to top

DICOPT_dicopt-minlpconvex: all -- KNITRO_default: all

Back to top

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (4063.58 seconds). The shift is 10s.

Modelname Time (DICOPT_dicopt-minlpconvex) Time (KNITRO_default) Ratio (DICOPT_dicopt-minlpconvex/ KNITRO_default) Obj (DICOPT_dicopt-minlpconvex) Obj (KNITRO_default) ObjEst (DICOPT_dicopt-minlpconvex) ObjEst (KNITRO_default) Gap (DICOPT_dicopt-minlpconvex) Gap (KNITRO_default)
BatchS101006M 11.7850 3600.2700 --- 769440.00000000 mstat(14) sstat(3) 769440.00000000 --- 0.0000 ---
BatchS121208M 6.5710 3600.1000 --- 1241130.00000000 mstat(14) sstat(3) 1241130.00000000 --- 0.0000 ---
BatchS151208M 11.1520 3600.0900 --- 1543470.00000000 mstat(14) sstat(3) 1543470.00000000 --- 0.0000 ---
BatchS201210M 8.2760 3600.1000 --- 2295350.00000000 mstat(14) sstat(3) 2295350.00000000 --- 0.0000 ---
clay0303h 74.3480 124.5670 0.597 26669.10000000 26669.10000000 26669.10000000 26669.10000000 0.0000 0.0000
clay0304h 3719.4300 1149.2700 --- 59328.70000000 mstat( 7) sstat(1) -1.0000000000000E+20 --- 1.0000 ---
clay0304m 2565.5800 117.6830 --- mstat(13) sstat(13) 40262.40000000 --- 40262.40000000 --- 0.0000
clay0305h 454.4820 3600.1300 --- 8092.50000000 mstat(14) sstat(3) 8092.50000000 --- 0.0000 ---
clay0305m 696.0040 397.2470 1.752 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
FLay04H 450.4510 115.5660 3.898 54.40590000 54.40590000 54.40590000 54.40590000 0.0000 0.0000
FLay05H 3935.9300 3600.1200 1.093 64.49810000 64.49810000 -1.0000000000000E+20 60.00000000 1.0000 0.0750
FLay05M 4063.5800 591.0380 --- mstat(13) sstat(13) 64.49810000 --- 64.49810000 --- 0.0000
FLay06M 3629.3900 3600.3900 --- 66.93280000 mstat(14) sstat(3) -1.0000000000000E+20 --- 1.0000 ---
fo7_2 3643.2600 3600.1600 --- 29.15300000 mstat(14) sstat(3) -1.0000000000000E+20 --- 1.0000 ---
fo7 148.4970 3600.1500 --- mstat(13) sstat(13) mstat(14) sstat(3) --- --- --- ---
fo8 605.8660 3600.1800 --- mstat(13) sstat(13) mstat(14) sstat(3) --- --- --- ---
m6 0.4920 1393.7500 0.000 82.25690000 82.25690000 82.25690000 82.25690000 0.0000 0.0000
m7 0.8910 3600.1700 --- 106.75700000 mstat(14) sstat(3) 106.75700000 --- 0.0000 ---
o7_2 3613.2200 3600.1700 --- mstat(13) sstat(13) mstat(14) sstat(3) --- --- --- ---
RSyn0805H (max) 0.1920 208.4930 0.001 1296.12000000 1296.12000000 1296.12000000 1296.12000000 0.0000 0.0000
RSyn0805M02M (max) 3.8910 3600.5500 --- 2238.40000000 mstat(14) sstat(3) 2238.40000000 --- 0.0000 ---
RSyn0805M03M (max) 7.9580 3600.3900 --- 3068.93000000 mstat(14) sstat(3) 3068.93000000 --- 0.0000 ---
RSyn0805M04M (max) 8.7990 3600.3200 --- 7174.22000000 mstat(14) sstat(3) 7174.22000000 --- 0.0000 ---
RSyn0810M02M (max) 5.2570 3600.1300 --- 1741.39000000 mstat(14) sstat(3) 1741.39000000 --- 0.0000 ---
RSyn0810M03M (max) 12.4010 3600.1200 --- 2722.45000000 mstat(14) sstat(3) 2722.45000000 --- 0.0000 ---
RSyn0820M (max) 0.2560 3600.2700 --- 1150.30000000 mstat(14) sstat(3) 1150.30000000 --- 0.0000 ---
RSyn0830M04H (max) 5.3350 3600.5200 --- 2529.07000000 mstat(14) sstat(3) 2529.07000000 --- 0.0000 ---
RSyn0830M (max) 0.5680 3600.1200 --- 510.07200000 mstat(14) sstat(3) 510.07200000 --- 0.0000 ---
RSyn0840M (max) 0.4160 3600.1100 --- 325.55500000 mstat( 7) sstat(1) 325.55500000 --- 0.0000 ---
SLay06H 5.9210 591.4240 0.010 32757.00000000 32757.00000000 32757.00000000 32757.00000000 0.0000 0.0000
SLay07H 22.9680 2121.5800 0.011 64748.80000000 64748.80000000 64748.80000000 64748.80000000 0.0000 0.0000
SLay08H 430.5600 3600.1100 --- 84960.20000000 mstat(14) sstat(3) 84960.20000000 --- 0.0000 ---
SLay09H 3640.7200 3600.1000 --- mstat(13) sstat(13) mstat(14) sstat(3) --- --- --- ---
SLay09M 1743.2000 88.3840 19.723 107806.00000000 107806.00000000 107806.00000000 107806.00000000 0.0000 0.0000
SLay10M 3694.7100 997.9550 3.702 134056.00000000 129580.00000000 -1.0000000000000E+20 129580.00000000 1.0000 0.0000
Syn15M04M (max) 0.2200 3600.0800 0.000 4937.48000000 4900.44000000 4937.48000000 5176.33000000 0.0000 0.0533
Syn20M03M (max) 0.1520 3600.0900 --- 2646.95000000 mstat(14) sstat(3) 2646.95000000 --- 0.0000 ---
Syn20M04M (max) 0.2140 3600.1000 --- 3532.74000000 mstat(14) sstat(3) 3532.74000000 --- 0.0000 ---
Syn30M02M (max) 0.2620 3600.0900 --- 399.68300000 mstat(14) sstat(3) 399.68300000 --- 0.0000 ---
Syn40M03H (max) 1.1550 3600.2300 0.000 395.14900000 395.06600000 395.14900000 397.79000000 0.0000 0.0068
Syn40M (max) 0.1550 3600.1000 --- 67.71330000 mstat(14) sstat(3) 67.71330000 --- 0.0000 ---
sssd-10-4-3 2.9150 31.2650 0.093 152710.00000000 152710.00000000 152710.00000000 152710.00000000 0.0000 0.0000
sssd-12-5-3 10.6230 891.1420 --- mstat( 7) sstat(1) 261143.00000000 --- 261143.00000000 --- 0.0000
sssd-15-6-3 132.5540 3600.1800 --- mstat( 7) sstat(1) 441410.00000000 --- 440679.00000000 --- 0.0017
uflquad-20-150 345.8900 3600.1600 --- mstat(13) sstat(13) 551.51400000 --- 514.73000000 --- 0.0715
uflquad-30-100 3633.2300 3600.1800 1.009 463.87200000 421.54700000 -1.0000000000000E+20 272.57000000 1.0000 0.5466
uflquad-40-80 3634.1200 3600.3700 1.009 457.97000000 428.39300000 -1.0000000000000E+20 211.08500000 1.0000 1.0295
Shifted Geometric Mean
(Solved)
140.38 2037.07              
% Unsolved 34.04% 72.34%         

Back to top