Solver Square Comparison: Considers all models.
Date / Time: |
10/19/08 15:15:21 |
Solver comparison utility.
Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded,
fail) of one solver with all return outcomes of another solver. Interrupt
denotes resource or iteration limit has been reached.
Solver IPOPTMA27 is represented on the left (rows) and
solver KNITRO on top (columns).
See the solver return definitions for return codes.
Models having trace data only in one trace file are listed in
the "no data" column of the other.
|
KNITRO:
optimal |
KNITRO:
locally optimal |
KNITRO:
feasible |
KNITRO:
infeasible |
KNITRO:
unbounded |
KNITRO:
fail |
KNITRO:
no data |
total IPOPTMA27 |
IPOPTMA27: optimal | - |
- |
- |
- |
- |
- |
- |
- |
IPOPTMA27: locally optimal | - |
63 |
1 |
- |
- |
10 |
- |
74 |
IPOPTMA27: feasible | - |
1 |
- |
- |
- |
- |
- |
1 |
IPOPTMA27: infeasible | - |
2 |
- |
- |
- |
- |
- |
2 |
IPOPTMA27: unbounded | - |
- |
- |
- |
- |
2 |
- |
2 |
IPOPTMA27: fail | - |
- |
- |
- |
- |
2 |
- |
2 |
IPOPTMA27: no data | - |
- |
- |
- |
- |
- |
- |
- |
total KNITRO |
- |
66 |
1 |
- |
- |
14 |
- |
81 |
Outcome | Model Status | Solver Status |
optimal | 1 or 15 | 1 |
locally optimal | 2 | any |
feasible | 7 or 16 or 17 | 1 or 2 or 3 or 4 or 5 |
infeasible | 4 or 5 or 19 | 1 |
unbounded | 3 or 18 | 1 |
fail | all other | all other |
Solver Resource Times
- Models for each solver pair outcome. Listed are the
solver resource times TIME(.) in seconds,
as well as the ratio RATIO(./.) of
resource times for the two solvers if both solved optimally.
- Also listed are the objective values OBJ(.) using both solvers.
The better solution found is listed in boldface. A solution
is considered better, if the relative objective function
difference is greater than
5.00E-03.
If both solutions are less than 1e-1, we use the absolute
difference.
- Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.
IPOPTMA27: locally optimal -- KNITRO: locally optimal    Back to top
Modelname |
Time (IPOPTMA27) |
Time (KNITRO) |
Ratio (IPOPTMA27/KNITRO) |
Obj (IPOPTMA27) |
Obj (KNITRO) |
arki0002 |
0.1100 |
0.2300 |
0.478 |
1.87252774 |
1.87252774 |
arki0015 |
3.9100 |
4.7700 |
0.820 |
-266.94068809 |
-263.42945620 |
arki0016 |
1.4000 |
8.4100 |
0.166 |
867.97316601 |
867.97316604 |
arki0020 |
0.2700 |
0.4200 |
0.643 |
-41.07495436 |
-41.07495436 |
arki0021 |
1.7300 |
2.5400 |
0.681 |
-72.58210091 |
-72.58210091 |
arki0022 |
3.1800 |
4.5000 |
0.707 |
-87.09909127 |
-87.09909125 |
arki0023 |
12.2400 |
17.7500 |
0.690 |
-153.66007775 |
-153.66007765 |
camshape400 |
0.2400 |
0.2900 |
0.828 |
-4.27568847 |
-4.27568803 |
camshape800 |
0.6900 |
0.6900 |
1.000 |
-4.27427413 |
-4.27427209 |
catmix100 |
0.0600 |
0.0400 |
1.500 |
-0.04806941 |
-0.04806926 |
catmix200 |
0.0800 |
0.0800 |
1.000 |
-0.04805914 |
-0.04805887 |
catmix400 |
0.1300 |
0.1700 |
0.765 |
-0.04805654 |
-0.04805603 |
catmix800 |
0.3700 |
0.4000 |
0.925 |
-0.04805590 |
-0.04805487 |
chain400 |
0.0400 |
0.0700 |
0.571 |
5.06862169 |
5.06862169 |
ex8_2_2a |
3.7700 |
7.1400 |
0.528 |
-552.66625860 |
-552.66624685 |
ex8_2_2b |
4.5300 |
8.5100 |
0.532 |
-552.66625954 |
-552.66624684 |
ex8_2_3a |
9.9700 |
23.3400 |
0.427 |
-3731.07929639 |
-3731.07927498 |
ex8_2_3b |
13.3400 |
30.4400 |
0.438 |
-3731.07929656 |
-3731.07927499 |
ex8_2_5a |
3.7500 |
5.8900 |
0.637 |
-830.33806724 |
-830.33806266 |
ex8_2_5b |
11.3100 |
15.5200 |
0.729 |
-830.33806724 |
-830.33806266 |
flowchan100 |
0.0800 |
0.0800 |
1.000 |
0.00000000 |
0.00000000 |
flowchan200 |
0.1300 |
0.1900 |
0.684 |
0.00000000 |
0.00000000 |
flowchan400 |
0.2600 |
0.3800 |
0.684 |
0.00000000 |
0.00000000 |
gasoil100 |
0.2300 |
0.3000 |
0.767 |
0.00523659 |
0.00523659 |
gasoil200 |
0.5200 |
0.7900 |
0.658 |
0.00523660 |
0.00523660 |
gasoil400 |
2.2300 |
2.5400 |
0.878 |
0.00523660 |
0.00523660 |
gasoil50 |
0.1000 |
0.1300 |
0.769 |
0.00523664 |
0.00523664 |
glider400 |
3424.5700 |
27.0900 |
126.415 |
-250.00000000 |
-249.99944886 |
infeas1 |
0.6000 |
1.6200 |
0.370 |
13685.59646092 |
13685.59646090 |
jbearing100 |
10.4600 |
8.9500 |
1.169 |
-0.15504194 |
-0.15504059 |
jbearing25 |
0.7100 |
0.8200 |
0.866 |
-0.15401551 |
-0.15401519 |
jbearing50 |
2.1000 |
2.6600 |
0.789 |
-0.15482381 |
-0.15482352 |
jbearing75 |
5.4500 |
5.2200 |
1.044 |
-0.15498446 |
-0.15498349 |
lnts100 |
0.0400 |
0.0500 |
0.800 |
0.55459540 |
0.55459540 |
lnts200 |
0.0700 |
0.1400 |
0.500 |
0.55457702 |
0.55457702 |
lnts400 |
0.1300 |
0.3000 |
0.433 |
0.55457241 |
0.55457241 |
methanol100 |
0.4300 |
1.4500 |
0.297 |
0.00902229 |
0.00902229 |
methanol200 |
4.5000 |
9.3400 |
0.482 |
0.00902229 |
0.00902229 |
methanol400 |
6.4800 |
114.6200 |
0.057 |
0.00902229 |
0.00902229 |
methanol50 |
0.1300 |
0.4400 |
0.295 |
0.00902229 |
0.00902229 |
minsurf100 |
11.0800 |
532.7000 |
0.021 |
2.50694962 |
2.50695092 |
minsurf25 |
0.7900 |
20.7300 |
0.038 |
2.51948798 |
2.51948819 |
minsurf50 |
3.3500 |
54.3900 |
0.062 |
2.51489003 |
2.51489007 |
minsurf75 |
17.5900 |
174.6700 |
0.101 |
2.50568696 |
2.50568773 |
pinene100 |
0.2500 |
0.7400 |
0.338 |
19.87217015 |
19.87217015 |
pinene200 |
0.7100 |
2.0300 |
0.350 |
19.87216684 |
19.87216684 |
pinene25 |
0.1200 |
0.3300 |
0.364 |
19.87216552 |
19.87216552 |
pinene50 |
0.1800 |
0.3200 |
0.563 |
19.87216552 |
19.87216552 |
polygon100 |
5.4100 |
9.7400 |
0.555 |
-0.78505614 |
-0.72686840 |
polygon25 |
0.0600 |
0.1100 |
0.545 |
-0.77974054 |
-0.74913723 |
polygon50 |
1.4800 |
0.7200 |
2.056 |
-0.78213256 |
-0.73359787 |
polygon75 |
4.8900 |
3.1200 |
1.567 |
-0.78446376 |
-0.72686816 |
popdynm100 |
0.5100 |
11.9800 |
0.043 |
19746.52860217 |
19746.52860218 |
popdynm200 |
1.2800 |
50.4100 |
0.025 |
19746.52964660 |
19746.52964661 |
popdynm25 |
0.1900 |
0.2900 |
0.655 |
19752.21541511 |
19752.21541511 |
popdynm50 |
0.2100 |
5.6500 |
0.037 |
19746.54515628 |
19746.54515628 |
rocket100 |
3.7400 |
0.7000 |
5.343 |
-1.01283200 |
-1.01283174 |
rocket200 |
22.4400 |
1.8700 |
12.000 |
-1.01283568 |
-1.01283558 |
rocket400 |
161.4900 |
4.3100 |
37.469 |
-1.01283661 |
-1.01283547 |
torsion100 |
16.9800 |
20.1700 |
0.842 |
-0.41823920 |
-0.41823436 |
torsion25 |
1.1000 |
1.2200 |
0.902 |
-0.41751073 |
-0.41750918 |
torsion50 |
5.5500 |
11.8600 |
0.468 |
-0.41808762 |
-0.41808461 |
torsion75 |
13.4900 |
11.4700 |
1.176 |
-0.41819939 |
-0.41819577 |
Back to top
IPOPTMA27: locally optimal -- KNITRO: feasible    Back to top
Modelname |
Time (IPOPTMA27) |
Time (KNITRO) |
Ratio (IPOPTMA27/KNITRO) |
Obj (IPOPTMA27) |
Obj (KNITRO) |
arki0017 |
1.0300 |
3600.0000 |
0.000 |
-121.83308010 |
-119.74852541 |
Back to top
IPOPTMA27: locally optimal -- KNITRO: fail    Back to top
Modelname |
Time (IPOPTMA27) |
Time (KNITRO) |
Ratio (IPOPTMA27/KNITRO) |
Obj (IPOPTMA27) |
Status (KNITRO) |
arki0003 |
20.1200 |
3600.2700 |
--- |
3795.20606780 |
mstat( 6) sstat( 3) |
arki0004 |
5.4600 |
3600.0300 |
--- |
323.46703883 |
mstat( 6) sstat( 3) |
arki0011 |
80.1400 |
NA |
--- |
-224086.46003178 |
mstat(13) sstat(13) |
arki0012 |
144.1600 |
NA |
--- |
-224252.42720549 |
mstat(13) sstat(13) |
arki0013 |
98.6000 |
NA |
--- |
-224253.08634914 |
mstat(13) sstat(13) |
arki0014 |
89.0400 |
NA |
--- |
-223977.08507254 |
mstat(13) sstat(13) |
arki0018 |
0.6000 |
3600.0200 |
--- |
0.01045662 |
mstat( 6) sstat( 3) |
elec200 |
1520.0900 |
3604.1600 |
--- |
18439.26774952 |
mstat( 6) sstat( 3) |
robot200 |
0.5000 |
3600.0100 |
--- |
9.14139687 |
mstat( 6) sstat( 3) |
robot400 |
1.2400 |
3600.0200 |
--- |
9.14102607 |
mstat( 6) sstat( 3) |
Back to top
IPOPTMA27: feasible -- KNITRO: locally optimal    Back to top
Modelname |
Time (IPOPTMA27) |
Time (KNITRO) |
Ratio (IPOPTMA27/KNITRO) |
Obj (IPOPTMA27) |
Obj (KNITRO) |
glider200 |
193.3500 |
47.1500 |
4.101 |
-250.00000000 |
-249.99920263 |
Back to top
IPOPTMA27: infeasible -- KNITRO: locally optimal    Back to top
Modelname |
Time (IPOPTMA27) |
Time (KNITRO) |
Ratio (IPOPTMA27/KNITRO) |
Status (IPOPTMA27) |
Obj (KNITRO) |
glider100 |
68.0400 |
56.2100 |
--- |
mstat( 5) sstat( 1) |
-249.99810068 |
glider50 |
0.6600 |
22.0400 |
--- |
mstat( 5) sstat( 1) |
-249.99925690 |
Back to top
IPOPTMA27: unbounded -- KNITRO: fail    Back to top
Modelname |
Time (IPOPTMA27) |
Time (KNITRO) |
Ratio (IPOPTMA27/KNITRO) |
Status (IPOPTMA27) |
Status (KNITRO) |
robot100 |
4.1600 |
3600.0000 |
--- |
mstat( 3) sstat( 1) |
mstat( 6) sstat( 3) |
robot50 |
1498.0200 |
3600.0000 |
--- |
mstat( 3) sstat( 1) |
mstat( 6) sstat( 3) |
Back to top
IPOPTMA27: fail -- KNITRO: fail    Back to top
Modelname |
Time (IPOPTMA27) |
Time (KNITRO) |
Ratio (IPOPTMA27/KNITRO) |
Status (IPOPTMA27) |
Status (KNITRO) |
arki0008 |
NA |
3600.0200 |
--- |
mstat(13) sstat(13) |
mstat( 6) sstat( 3) |
ex8_2_2 |
3695.5800 |
3693.5500 |
--- |
mstat( 6) sstat( 3) |
mstat( 6) sstat( 3) |
Back to top
IPOPTMA27: locally optimal:     Back to top
Modelname |
Time (IPOPTMA27) |
Obj (IPOPTMA27) |
arki0002 |
0.1100 |
1.87252774 |
arki0003 |
20.1200 |
3795.20606780 |
arki0004 |
5.4600 |
323.46703883 |
arki0011 |
80.1400 |
-224086.46003178 |
arki0012 |
144.1600 |
-224252.42720549 |
arki0013 |
98.6000 |
-224253.08634914 |
arki0014 |
89.0400 |
-223977.08507254 |
arki0015 |
3.9100 |
-266.94068809 |
arki0016 |
1.4000 |
867.97316601 |
arki0017 |
1.0300 |
-121.83308010 |
arki0018 |
0.6000 |
0.01045662 |
arki0020 |
0.2700 |
-41.07495436 |
arki0021 |
1.7300 |
-72.58210091 |
arki0022 |
3.1800 |
-87.09909127 |
arki0023 |
12.2400 |
-153.66007775 |
camshape400 |
0.2400 |
-4.27568847 |
camshape800 |
0.6900 |
-4.27427413 |
catmix100 |
0.0600 |
-0.04806941 |
catmix200 |
0.0800 |
-0.04805914 |
catmix400 |
0.1300 |
-0.04805654 |
catmix800 |
0.3700 |
-0.04805590 |
chain400 |
0.0400 |
5.06862169 |
elec200 |
1520.0900 |
18439.26774952 |
ex8_2_2a |
3.7700 |
-552.66625860 |
ex8_2_2b |
4.5300 |
-552.66625954 |
ex8_2_3a |
9.9700 |
-3731.07929639 |
ex8_2_3b |
13.3400 |
-3731.07929656 |
ex8_2_5a |
3.7500 |
-830.33806724 |
ex8_2_5b |
11.3100 |
-830.33806724 |
flowchan100 |
0.0800 |
0.00000000 |
flowchan200 |
0.1300 |
0.00000000 |
flowchan400 |
0.2600 |
0.00000000 |
gasoil100 |
0.2300 |
0.00523659 |
gasoil200 |
0.5200 |
0.00523660 |
gasoil400 |
2.2300 |
0.00523660 |
gasoil50 |
0.1000 |
0.00523664 |
glider400 |
3424.5700 |
-250.00000000 |
infeas1 |
0.6000 |
13685.59646092 |
jbearing100 |
10.4600 |
-0.15504194 |
jbearing25 |
0.7100 |
-0.15401551 |
jbearing50 |
2.1000 |
-0.15482381 |
jbearing75 |
5.4500 |
-0.15498446 |
lnts100 |
0.0400 |
0.55459540 |
lnts200 |
0.0700 |
0.55457702 |
lnts400 |
0.1300 |
0.55457241 |
methanol100 |
0.4300 |
0.00902229 |
methanol200 |
4.5000 |
0.00902229 |
methanol400 |
6.4800 |
0.00902229 |
methanol50 |
0.1300 |
0.00902229 |
minsurf100 |
11.0800 |
2.50694962 |
minsurf25 |
0.7900 |
2.51948798 |
minsurf50 |
3.3500 |
2.51489003 |
minsurf75 |
17.5900 |
2.50568696 |
pinene100 |
0.2500 |
19.87217015 |
pinene200 |
0.7100 |
19.87216684 |
pinene25 |
0.1200 |
19.87216552 |
pinene50 |
0.1800 |
19.87216552 |
polygon100 |
5.4100 |
-0.78505614 |
polygon25 |
0.0600 |
-0.77974054 |
polygon50 |
1.4800 |
-0.78213256 |
polygon75 |
4.8900 |
-0.78446376 |
popdynm100 |
0.5100 |
19746.52860217 |
popdynm200 |
1.2800 |
19746.52964660 |
popdynm25 |
0.1900 |
19752.21541511 |
popdynm50 |
0.2100 |
19746.54515628 |
robot200 |
0.5000 |
9.14139687 |
robot400 |
1.2400 |
9.14102607 |
rocket100 |
3.7400 |
-1.01283200 |
rocket200 |
22.4400 |
-1.01283568 |
rocket400 |
161.4900 |
-1.01283661 |
torsion100 |
16.9800 |
-0.41823920 |
torsion25 |
1.1000 |
-0.41751073 |
torsion50 |
5.5500 |
-0.41808762 |
torsion75 |
13.4900 |
-0.41819939 |
Back to top
IPOPTMA27: feasible:     Back to top
Modelname |
Time (IPOPTMA27) |
Obj (IPOPTMA27) |
glider200 |
193.3500 |
-250.00000000 |
Back to top
IPOPTMA27: infeasible:     Back to top
Modelname |
Time (IPOPTMA27) |
Status (IPOPTMA27) |
glider100 |
-- |
mstat( 5) sstat( 1) |
glider50 |
-- |
mstat( 5) sstat( 1) |
Back to top
IPOPTMA27: unbounded:     Back to top
Modelname |
Time (IPOPTMA27) |
Status (IPOPTMA27) |
robot100 |
4.1600 |
mstat( 3) sstat( 1) |
robot50 |
1498.0200 |
mstat( 3) sstat( 1) |
Back to top
IPOPTMA27: fail:     Back to top
Modelname |
Time (IPOPTMA27) |
Status (IPOPTMA27) |
arki0008 |
-- |
mstat(13) sstat(13) |
ex8_2_2 |
-- |
mstat( 6) sstat( 3) |
Back to top
KNITRO: locally optimal:     Back to top
Modelname |
Time (KNITRO) |
Obj (KNITRO) |
arki0002 |
0.2300 |
1.87252774 |
arki0015 |
4.7700 |
-263.42945620 |
arki0016 |
8.4100 |
867.97316604 |
arki0020 |
0.4200 |
-41.07495436 |
arki0021 |
2.5400 |
-72.58210091 |
arki0022 |
4.5000 |
-87.09909125 |
arki0023 |
17.7500 |
-153.66007765 |
camshape400 |
0.2900 |
-4.27568803 |
camshape800 |
0.6900 |
-4.27427209 |
catmix100 |
0.0400 |
-0.04806926 |
catmix200 |
0.0800 |
-0.04805887 |
catmix400 |
0.1700 |
-0.04805603 |
catmix800 |
0.4000 |
-0.04805487 |
chain400 |
0.0700 |
5.06862169 |
ex8_2_2a |
7.1400 |
-552.66624685 |
ex8_2_2b |
8.5100 |
-552.66624684 |
ex8_2_3a |
23.3400 |
-3731.07927498 |
ex8_2_3b |
30.4400 |
-3731.07927499 |
ex8_2_5a |
5.8900 |
-830.33806266 |
ex8_2_5b |
15.5200 |
-830.33806266 |
flowchan100 |
0.0800 |
0.00000000 |
flowchan200 |
0.1900 |
0.00000000 |
flowchan400 |
0.3800 |
0.00000000 |
gasoil100 |
0.3000 |
0.00523659 |
gasoil200 |
0.7900 |
0.00523660 |
gasoil400 |
2.5400 |
0.00523660 |
gasoil50 |
0.1300 |
0.00523664 |
glider100 |
56.2100 |
-249.99810068 |
glider200 |
47.1500 |
-249.99920263 |
glider400 |
27.0900 |
-249.99944886 |
glider50 |
22.0400 |
-249.99925690 |
infeas1 |
1.6200 |
13685.59646090 |
jbearing100 |
8.9500 |
-0.15504059 |
jbearing25 |
0.8200 |
-0.15401519 |
jbearing50 |
2.6600 |
-0.15482352 |
jbearing75 |
5.2200 |
-0.15498349 |
lnts100 |
0.0500 |
0.55459540 |
lnts200 |
0.1400 |
0.55457702 |
lnts400 |
0.3000 |
0.55457241 |
methanol100 |
1.4500 |
0.00902229 |
methanol200 |
9.3400 |
0.00902229 |
methanol400 |
114.6200 |
0.00902229 |
methanol50 |
0.4400 |
0.00902229 |
minsurf100 |
532.7000 |
2.50695092 |
minsurf25 |
20.7300 |
2.51948819 |
minsurf50 |
54.3900 |
2.51489007 |
minsurf75 |
174.6700 |
2.50568773 |
pinene100 |
0.7400 |
19.87217015 |
pinene200 |
2.0300 |
19.87216684 |
pinene25 |
0.3300 |
19.87216552 |
pinene50 |
0.3200 |
19.87216552 |
polygon100 |
9.7400 |
-0.72686840 |
polygon25 |
0.1100 |
-0.74913723 |
polygon50 |
0.7200 |
-0.73359787 |
polygon75 |
3.1200 |
-0.72686816 |
popdynm100 |
11.9800 |
19746.52860218 |
popdynm200 |
50.4100 |
19746.52964661 |
popdynm25 |
0.2900 |
19752.21541511 |
popdynm50 |
5.6500 |
19746.54515628 |
rocket100 |
0.7000 |
-1.01283174 |
rocket200 |
1.8700 |
-1.01283558 |
rocket400 |
4.3100 |
-1.01283547 |
torsion100 |
20.1700 |
-0.41823436 |
torsion25 |
1.2200 |
-0.41750918 |
torsion50 |
11.8600 |
-0.41808461 |
torsion75 |
11.4700 |
-0.41819577 |
Back to top
KNITRO: feasible:     Back to top
Modelname |
Time (KNITRO) |
Obj (KNITRO) |
arki0017 |
3600.0000 |
-119.74852541 |
Back to top
KNITRO: fail:     Back to top
Modelname |
Time (KNITRO) |
Status (KNITRO) |
arki0003 |
-- |
mstat( 6) sstat( 3) |
arki0004 |
-- |
mstat( 6) sstat( 3) |
arki0008 |
-- |
mstat( 6) sstat( 3) |
arki0011 |
-- |
mstat(13) sstat(13) |
arki0012 |
-- |
mstat(13) sstat(13) |
arki0013 |
-- |
mstat(13) sstat(13) |
arki0014 |
-- |
mstat(13) sstat(13) |
arki0018 |
-- |
mstat( 6) sstat( 3) |
elec200 |
-- |
mstat( 6) sstat( 3) |
ex8_2_2 |
-- |
mstat( 6) sstat( 3) |
robot100 |
-- |
mstat( 6) sstat( 3) |
robot200 |
-- |
mstat( 6) sstat( 3) |
robot400 |
-- |
mstat( 6) sstat( 3) |
robot50 |
-- |
mstat( 6) sstat( 3) |
Back to top
IPOPTMA27: all -- KNITRO: all
: Back to top
Back to top