Solver Square Comparison: Considers all models.

Results created on 02/25/11 16:06:55 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver BONMIN_bonmin-bb is represented on the left (rows) and solver KNITRO_default on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number Filename
Tracefile 1: MINLPconvex.BONMIN.bonmin-bb.pav
Tracefile 2: MINLPconvex.KNITRO.default.pav
Solvers used : BONMIN_bonmin-bb
KNITRO_default
Modeltype(s)   MINLP

KNITRO_default:
optimal
KNITRO_default:
locally optimal
KNITRO_default:
feasible
KNITRO_default:
infeasible
KNITRO_default:
unbounded
KNITRO_default:
fail
KNITRO_default:
no data
total BONMIN_bonmin-bb
BONMIN_bonmin-bb:
optimal
13 - 6 - - 9 - 28
BONMIN_bonmin-bb:
locally optimal
- - - - - - - -
BONMIN_bonmin-bb:
feasible
- - 1 - - 17 - 18
BONMIN_bonmin-bb:
infeasible
- - - - - - - -
BONMIN_bonmin-bb:
unbounded
- - - - - - - -
BONMIN_bonmin-bb:
fail
- - - - - 1 - 1
BONMIN_bonmin-bb:
no data
- - - - - - - -
total KNITRO_default 13 - 7 - - 27 - 47

Solver return definitions:

Outcome Model Status Solver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other

Solver Resource Times


BONMIN_bonmin-bb: optimal -- KNITRO_default: optimal    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (KNITRO_default) Ratio (BONMIN_bonmin-bb/KNITRO_default) Obj (BONMIN_bonmin-bb) Obj (KNITRO_default)
clay0303h 28.7740 124.5670 0.231 26669.10000000 26669.10000000
clay0304m 87.6430 117.6830 0.745 40262.40000000 40262.40000000
clay0305m 900.8890 397.2470 2.268 8092.50000000 8092.50000000
FLay04H 48.0610 115.5660 0.416 54.40590000 54.40590000
FLay05M 549.2450 591.0380 0.929 64.49810000 64.49810000
m6 494.4440 1393.7500 0.355 82.25690000 82.25690000
RSyn0805H 3.1030 208.4930 0.015 1296.12000000 1296.12000000
SLay06H 4.1570 591.4240 0.007 32757.00000000 32757.00000000
SLay07H 68.4250 2121.5800 0.032 64748.80000000 64748.80000000
SLay09M 8.6660 88.3840 0.098 107806.00000000 107806.00000000
SLay10M 100.3260 997.9550 0.101 129580.00000000 129580.00000000
sssd-10-4-3 14.2500 31.2650 0.456 152710.00000000 152710.00000000
sssd-12-5-3 61.0080 891.1420 0.068 261143.00000000 261143.00000000

Back to top


BONMIN_bonmin-bb: optimal -- KNITRO_default: feasible    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (KNITRO_default) Ratio (BONMIN_bonmin-bb/KNITRO_default) Obj (BONMIN_bonmin-bb) Obj (KNITRO_default)
FLay05H 2894.0300 3600.1200 0.804 64.49810000 64.49810000
Syn15M04M 260.6110 3600.0800 0.072 4937.48000000 4900.44000000
Syn40M03H 22.1460 3600.2300 0.006 395.14900000 395.06600000
sssd-15-6-3 273.2360 3600.1800 0.076 440711.00000000 441410.00000000
uflquad-20-150 371.6570 3600.1600 0.103 550.11200000 551.51400000
uflquad-30-100 540.4610 3600.1800 0.150 361.91700000 421.54700000

Back to top


BONMIN_bonmin-bb: optimal -- KNITRO_default: fail    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (KNITRO_default) Ratio (BONMIN_bonmin-bb/KNITRO_default) Obj (BONMIN_bonmin-bb) Status (KNITRO_default)
BatchS101006M 22.7760 3600.2700 --- 769440.00000000 mstat(14)sstat( 3)
BatchS121208M 44.9290 3600.1000 --- 1241130.00000000 mstat(14)sstat( 3)
BatchS151208M 138.4870 3600.0900 --- 1543470.00000000 mstat(14)sstat( 3)
BatchS201210M 181.7730 3600.1000 --- 2295350.00000000 mstat(14)sstat( 3)
clay0304h 197.5510 1149.2700 --- 40262.40000000 mstat( 7)sstat( 1)
RSyn0830M04H 337.7570 3600.5200 --- 2529.07000000 mstat(14)sstat( 3)
SLay08H 71.0830 3600.1100 --- 84960.20000000 mstat(14)sstat( 3)
SLay09H 85.6580 3600.1000 --- 107806.00000000 mstat(14)sstat( 3)
Syn40M 1153.7900 3600.1000 --- 67.71330000 mstat(14)sstat( 3)

Back to top


BONMIN_bonmin-bb: feasible -- KNITRO_default: feasible    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (KNITRO_default) Ratio (BONMIN_bonmin-bb/KNITRO_default) Obj (BONMIN_bonmin-bb) Obj (KNITRO_default)
uflquad-40-80 3620.7600 3600.3700 1.006 348.14600000 428.39300000

Back to top


BONMIN_bonmin-bb: feasible -- KNITRO_default: fail    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (KNITRO_default) Ratio (BONMIN_bonmin-bb/KNITRO_default) Obj (BONMIN_bonmin-bb) Status (KNITRO_default)
clay0305h 3616.8200 3600.1300 --- 8102.00000000 mstat(14)sstat( 3)
FLay06M 3650.6700 3600.3900 --- 66.93280000 mstat(14)sstat( 3)
fo7_2 3658.2500 3600.1600 --- 18.52120000 mstat(14)sstat( 3)
fo7 3662.9400 3600.1500 --- 24.99370000 mstat(14)sstat( 3)
fo8 3659.7200 3600.1800 --- 32.36270000 mstat(14)sstat( 3)
m7 3643.9700 3600.1700 --- 130.75700000 mstat(14)sstat( 3)
o7_2 3660.6100 3600.1700 --- 134.01600000 mstat(14)sstat( 3)
RSyn0805M02M 3654.7200 3600.5500 --- 2238.06000000 mstat(14)sstat( 3)
RSyn0805M03M 3641.6500 3600.3900 --- 3068.83000000 mstat(14)sstat( 3)
RSyn0805M04M 3622.5600 3600.3200 --- 7171.22000000 mstat(14)sstat( 3)
RSyn0810M02M 3659.7600 3600.1300 --- 1723.03000000 mstat(14)sstat( 3)
RSyn0810M03M 3660.7800 3600.1200 --- 2695.73000000 mstat(14)sstat( 3)
RSyn0820M 3661.9600 3600.2700 --- 1150.30000000 mstat(14)sstat( 3)
RSyn0830M 3624.1000 3600.1200 --- 509.93700000 mstat(14)sstat( 3)
RSyn0840M 3659.7300 3600.1100 --- 318.55500000 mstat( 7)sstat( 1)
Syn20M04M 3654.3400 3600.1000 --- 3517.74000000 mstat(14)sstat( 3)
Syn30M02M 3664.5900 3600.0900 --- 381.68300000 mstat(14)sstat( 3)

Back to top


BONMIN_bonmin-bb: fail -- KNITRO_default: fail    

Back to top

Modelname Time (BONMIN_bonmin-bb) Time (KNITRO_default) Ratio (BONMIN_bonmin-bb/KNITRO_default) Status (BONMIN_bonmin-bb) Status (KNITRO_default)
Syn20M03M 3646.6500 3600.0900 --- mstat( 7)sstat( 1) mstat(14)sstat( 3)

Back to top


BONMIN_bonmin-bb: optimal:

Back to top

Modelname Time (BONMIN_bonmin-bb) Obj (BONMIN_bonmin-bb)
BatchS101006M 22.7760 769440.00000000
BatchS121208M 44.9290 1241130.00000000
BatchS151208M 138.4870 1543470.00000000
BatchS201210M 181.7730 2295350.00000000
clay0303h 28.7740 26669.10000000
clay0304h 197.5510 40262.40000000
clay0304m 87.6430 40262.40000000
clay0305m 900.8890 8092.50000000
FLay04H 48.0610 54.40590000
FLay05H 2894.0300 64.49810000
FLay05M 549.2450 64.49810000
m6 494.4440 82.25690000
RSyn0805H 3.1030 1296.12000000
RSyn0830M04H 337.7570 2529.07000000
SLay06H 4.1570 32757.00000000
SLay07H 68.4250 64748.80000000
SLay08H 71.0830 84960.20000000
SLay09H 85.6580 107806.00000000
SLay09M 8.6660 107806.00000000
SLay10M 100.3260 129580.00000000
Syn15M04M 260.6110 4937.48000000
Syn40M03H 22.1460 395.14900000
Syn40M 1153.7900 67.71330000
sssd-10-4-3 14.2500 152710.00000000
sssd-12-5-3 61.0080 261143.00000000
sssd-15-6-3 273.2360 440711.00000000
uflquad-20-150 371.6570 550.11200000
uflquad-30-100 540.4610 361.91700000

Back to top


BONMIN_bonmin-bb: feasible:

Back to top

Modelname Time (BONMIN_bonmin-bb) Obj (BONMIN_bonmin-bb)
clay0305h 3616.8200 8102.00000000
FLay06M 3650.6700 66.93280000
fo7_2 3658.2500 18.52120000
fo7 3662.9400 24.99370000
fo8 3659.7200 32.36270000
m7 3643.9700 130.75700000
o7_2 3660.6100 134.01600000
RSyn0805M02M 3654.7200 2238.06000000
RSyn0805M03M 3641.6500 3068.83000000
RSyn0805M04M 3622.5600 7171.22000000
RSyn0810M02M 3659.7600 1723.03000000
RSyn0810M03M 3660.7800 2695.73000000
RSyn0820M 3661.9600 1150.30000000
RSyn0830M 3624.1000 509.93700000
RSyn0840M 3659.7300 318.55500000
Syn20M04M 3654.3400 3517.74000000
Syn30M02M 3664.5900 381.68300000
uflquad-40-80 3620.7600 348.14600000

Back to top


BONMIN_bonmin-bb: fail:

Back to top

Modelname Time (BONMIN_bonmin-bb) Status (BONMIN_bonmin-bb)
Syn20M03M -- mstat( 7) sstat( 1)

Back to top


KNITRO_default: optimal:

Back to top

Modelname Time (KNITRO_default) Obj (KNITRO_default)
clay0303h 124.5670 26669.10000000
clay0304m 117.6830 40262.40000000
clay0305m 397.2470 8092.50000000
FLay04H 115.5660 54.40590000
FLay05M 591.0380 64.49810000
m6 1393.7500 82.25690000
RSyn0805H 208.4930 1296.12000000
SLay06H 591.4240 32757.00000000
SLay07H 2121.5800 64748.80000000
SLay09M 88.3840 107806.00000000
SLay10M 997.9550 129580.00000000
sssd-10-4-3 31.2650 152710.00000000
sssd-12-5-3 891.1420 261143.00000000

Back to top

KNITRO_default: feasible:

Back to top

Modelname Time (KNITRO_default) Obj (KNITRO_default)
FLay05H 3600.1200 64.49810000
Syn15M04M 3600.0800 4900.44000000
Syn40M03H 3600.2300 395.06600000
sssd-15-6-3 3600.1800 441410.00000000
uflquad-20-150 3600.1600 551.51400000
uflquad-30-100 3600.1800 421.54700000
uflquad-40-80 3600.3700 428.39300000

Back to top

KNITRO_default: fail:

Back to top

Modelname Time (KNITRO_default) Status (KNITRO_default)
BatchS101006M -- mstat(14)sstat( 3)
BatchS121208M -- mstat(14)sstat( 3)
BatchS151208M -- mstat(14)sstat( 3)
BatchS201210M -- mstat(14)sstat( 3)
clay0304h -- mstat( 7)sstat( 1)
clay0305h -- mstat(14)sstat( 3)
FLay06M -- mstat(14)sstat( 3)
fo7_2 -- mstat(14)sstat( 3)
fo7 -- mstat(14)sstat( 3)
fo8 -- mstat(14)sstat( 3)
m7 -- mstat(14)sstat( 3)
o7_2 -- mstat(14)sstat( 3)
RSyn0805M02M -- mstat(14)sstat( 3)
RSyn0805M03M -- mstat(14)sstat( 3)
RSyn0805M04M -- mstat(14)sstat( 3)
RSyn0810M02M -- mstat(14)sstat( 3)
RSyn0810M03M -- mstat(14)sstat( 3)
RSyn0820M -- mstat(14)sstat( 3)
RSyn0830M04H -- mstat(14)sstat( 3)
RSyn0830M -- mstat(14)sstat( 3)
RSyn0840M -- mstat( 7)sstat( 1)
SLay08H -- mstat(14)sstat( 3)
SLay09H -- mstat(14)sstat( 3)
Syn20M03M -- mstat(14)sstat( 3)
Syn20M04M -- mstat(14)sstat( 3)
Syn30M02M -- mstat(14)sstat( 3)
Syn40M -- mstat(14)sstat( 3)

Back to top

BONMIN_bonmin-bb: all -- KNITRO_default: all

Back to top

A "(max)" behind a model names indicates that this model is a maximization model.

Rows with red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.

A model is counted as solved if the gap reported by the solver is at most 0.00015. The gap is in this case displayed with a green background.

A shifted geometric mean of the solver time is computed, where unsolved instances and instances above the timelimit are counted with the timelimit (3664.59 seconds). The shift is 10s.

Modelname Time (BONMIN_bonmin-bb) Time (KNITRO_default) Ratio (BONMIN_bonmin-bb/ KNITRO_default) Obj (BONMIN_bonmin-bb) Obj (KNITRO_default) ObjEst (BONMIN_bonmin-bb) ObjEst (KNITRO_default) Gap (BONMIN_bonmin-bb) Gap (KNITRO_default)
BatchS101006M 22.7760 3600.2700 --- 769440.00000000 mstat(14) sstat(3) 769440.00000000 --- 0.0000 ---
BatchS121208M 44.9290 3600.1000 --- 1241130.00000000 mstat(14) sstat(3) 1241130.00000000 --- 0.0000 ---
BatchS151208M 138.4870 3600.0900 --- 1543470.00000000 mstat(14) sstat(3) 1543470.00000000 --- 0.0000 ---
BatchS201210M 181.7730 3600.1000 --- 2295350.00000000 mstat(14) sstat(3) 2295350.00000000 --- 0.0000 ---
clay0303h 28.7740 124.5670 0.231 26669.10000000 26669.10000000 26669.10000000 26669.10000000 0.0000 0.0000
clay0304h 197.5510 1149.2700 --- 40262.40000000 mstat( 7) sstat(1) 40262.40000000 --- 0.0000 ---
clay0304m 87.6430 117.6830 0.745 40262.40000000 40262.40000000 40262.40000000 40262.40000000 0.0000 0.0000
clay0305h 3616.8200 3600.1300 --- 8102.00000000 mstat(14) sstat(3) 7950.00000000 --- 0.0191 ---
clay0305m 900.8890 397.2470 2.268 8092.50000000 8092.50000000 8092.50000000 8092.50000000 0.0000 0.0000
FLay04H 48.0610 115.5660 0.416 54.40590000 54.40590000 54.40590000 54.40590000 0.0000 0.0000
FLay05H 2894.0300 3600.1200 0.804 64.49810000 64.49810000 64.49810000 60.00000000 0.0000 0.0750
FLay05M 549.2450 591.0380 0.929 64.49810000 64.49810000 64.49810000 64.49810000 0.0000 0.0000
FLay06M 3650.6700 3600.3900 --- 66.93280000 mstat(14) sstat(3) 64.49810000 --- 0.0377 ---
fo7_2 3658.2500 3600.1600 --- 18.52120000 mstat(14) sstat(3) 8.95940000 --- 1.0672 ---
fo7 3662.9400 3600.1500 --- 24.99370000 mstat(14) sstat(3) 8.47036000 --- 1.9507 ---
fo8 3659.7200 3600.1800 --- 32.36270000 mstat(14) sstat(3) 9.13875000 --- 2.5413 ---
m6 494.4440 1393.7500 0.355 82.25690000 82.25690000 82.25690000 82.25690000 0.0000 0.0000
m7 3643.9700 3600.1700 --- 130.75700000 mstat(14) sstat(3) 44.90410000 --- 1.9119 ---
o7_2 3660.6100 3600.1700 --- 134.01600000 mstat(14) sstat(3) 29.82670000 --- 3.4932 ---
RSyn0805H (max) 3.1030 208.4930 0.015 1296.12000000 1296.12000000 1296.12000000 1296.12000000 0.0000 0.0000
RSyn0805M02M (max) 3654.7200 3600.5500 --- 2238.06000000 mstat(14) sstat(3) 2310.14000000 --- 0.0312 ---
RSyn0805M03M (max) 3641.6500 3600.3900 --- 3068.83000000 mstat(14) sstat(3) 3293.88000000 --- 0.0683 ---
RSyn0805M04M (max) 3622.5600 3600.3200 --- 7171.22000000 mstat(14) sstat(3) 7651.92000000 --- 0.0628 ---
RSyn0810M02M (max) 3659.7600 3600.1300 --- 1723.03000000 mstat(14) sstat(3) 3051.60000000 --- 0.4354 ---
RSyn0810M03M (max) 3660.7800 3600.1200 --- 2695.73000000 mstat(14) sstat(3) 4040.11000000 --- 0.3328 ---
RSyn0820M (max) 3661.9600 3600.2700 --- 1150.30000000 mstat(14) sstat(3) 1264.78000000 --- 0.0905 ---
RSyn0830M04H (max) 337.7570 3600.5200 --- 2529.07000000 mstat(14) sstat(3) 2529.07000000 --- 0.0000 ---
RSyn0830M (max) 3624.1000 3600.1200 --- 509.93700000 mstat(14) sstat(3) 641.69000000 --- 0.2053 ---
RSyn0840M (max) 3659.7300 3600.1100 --- 318.55500000 mstat( 7) sstat(1) 777.04800000 --- 0.5900 ---
SLay06H 4.1570 591.4240 0.007 32757.00000000 32757.00000000 32757.00000000 32757.00000000 0.0000 0.0000
SLay07H 68.4250 2121.5800 0.032 64748.80000000 64748.80000000 64748.80000000 64748.80000000 0.0000 0.0000
SLay08H 71.0830 3600.1100 --- 84960.20000000 mstat(14) sstat(3) 84960.20000000 --- 0.0000 ---
SLay09H 85.6580 3600.1000 --- 107806.00000000 mstat(14) sstat(3) 107806.00000000 --- 0.0000 ---
SLay09M 8.6660 88.3840 0.098 107806.00000000 107806.00000000 107806.00000000 107806.00000000 0.0000 0.0000
SLay10M 100.3260 997.9550 0.101 129580.00000000 129580.00000000 129580.00000000 129580.00000000 0.0000 0.0000
Syn15M04M (max) 260.6110 3600.0800 0.072 4937.48000000 4900.44000000 4937.48000000 5176.33000000 0.0000 0.0533
Syn20M03M (max) 3646.6500 3600.0900 --- mstat( 7) sstat(1) mstat(14) sstat(3) --- --- --- ---
Syn20M04M (max) 3654.3400 3600.1000 --- 3517.74000000 mstat(14) sstat(3) 4524.25000000 --- 0.2225 ---
Syn30M02M (max) 3664.5900 3600.0900 --- 381.68300000 mstat(14) sstat(3) 642.30300000 --- 0.4058 ---
Syn40M03H (max) 22.1460 3600.2300 0.006 395.14900000 395.06600000 395.14900000 397.79000000 0.0000 0.0068
Syn40M (max) 1153.7900 3600.1000 --- 67.71330000 mstat(14) sstat(3) 67.71330000 --- 0.0000 ---
sssd-10-4-3 14.2500 31.2650 0.456 152710.00000000 152710.00000000 152710.00000000 152710.00000000 0.0000 0.0000
sssd-12-5-3 61.0080 891.1420 0.068 261143.00000000 261143.00000000 261143.00000000 261143.00000000 0.0000 0.0000
sssd-15-6-3 273.2360 3600.1800 0.076 440711.00000000 441410.00000000 440711.00000000 440679.00000000 0.0000 0.0017
uflquad-20-150 371.6570 3600.1600 0.103 550.11200000 551.51400000 550.11200000 514.73000000 0.0000 0.0715
uflquad-30-100 540.4610 3600.1800 0.150 361.91700000 421.54700000 361.91700000 272.57000000 0.0000 0.5466
uflquad-40-80 3620.7600 3600.3700 1.006 348.14600000 428.39300000 311.97000000 211.08500000 0.1160 1.0295
Shifted Geometric Mean
(Solved)
491.29 1889.98              
% Unsolved 40.43% 72.34%         

Back to top