Resource Times:
Results created on 02/04/10 15:30:17
using the PAVER Server/Performance tools available at
http://www.gamsworld.eu/performance/paver
See the solver return definitions
for optimal/feasible model and solve statuses.
Solutions are not checked for how close they are to eachother.
Resource times are considered the same, if they are within 10%
of eachother. A solver is considered faster than another, if it is less
than 50% faster than the other. A solver is considered much
faster than another, if it is more than 50% faster than the
other.
If a model was not solved optimal/feasible by both solvers, the resource time is
considered the same. If a model was solved optimal/feasible by solver A but not by
solver B, then solver A is considered infinitely faster than solver B. Similarly, if one solver has trace data and
the other has no data, then the first solver is consideredinfinitely faster.
A solver is considered to have a better objective function value, if the
relative objective value difference is greater than 1.00E-04 For objective values below 1e-1 we use
absolute differences.
| Input File Number |
Filename |
| Tracefile 1: |
CBC.trc |
| Tracefile 2: |
SCIP.trc |
| Solvers used : | Cbc |
|
SCIP |
| Modeltype(s) |
MIP
|
| Threshold: Solver Faster |
10% |
| Threshold: Solver Much Faster |
50% |
| Threshold: Solver Infinitely Faster |
Other solver failed |
|
Total |
Obj Cbc better |
Obj same |
Obj SCIP better |
| Solver Cbc infinitely faster : | 1
| 1 |
- |
- |
| Solver Cbc much faster : | 26
| - |
26 |
- |
|---|
| Solver Cbc faster : | 20
| - |
20 |
- |
| Solvers perform the same : | 35
| 8 |
21 |
6 |
| Solver SCIP faster : | 23
| - |
23 |
- |
| Solver SCIP much faster : | 23
| 3 |
19 |
1 |
| Solver SCIP infinitely faster : | 1
| - |
- |
1 |
| Both solvers failed to solve optimally : | -
| - |
- |
- |
| Total models: : |
129 | 12 | 109 | 8 |
Solver return definition:
| Outcome |
Model Status |
Solver Status |
| globally optimal |
1 or 15 |
1 |
| locally optimal/feasible |
2 or 8 or 16 |
1 or 2 or 3 or 4 or 5 or 8 |
Resource Times:
- Models for each resource time category. Listed are the solver resource times TIME(.) in
seconds, as well as the ratio of resource times RATIO(.)for the two solvers if both solved optimally.
Models not solved optimally by a solver have status listed instead of resource time.
- Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed
in boldface. A solution is considered better, if the relative objective function difference is
greater than 1.00E-04.
- Solver resource time ratios for a particular model are listed only if both solvers are
optimal and if one solver has resource time greater than 5.00E-02.
Solver Cbc infinitely faster - Obj of Cbc better:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| bc | 3603.2200 | infeasible | -- |
7.00000000E+00 | NA |
Back to top
Solver Cbc much faster - Obj same for both solvers:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| 10teams | 7.9400 | 25.0600 | 0.317 |
9.24000000E+02 | 9.24000000E+02 |
| acc-tight-0 | 1.5200 | 44.5300 | 0.034 |
0.00000000E+00 | 0.00000000E+00 |
| acc-tight-1 | 4.5900 | 77.3900 | 0.059 |
0.00000000E+00 | 0.00000000E+00 |
| acc-tight-4 | 3.5100 | 68.7200 | 0.051 |
0.00000000E+00 | 0.00000000E+00 |
| acc-tight-6 | 172.6700 | 619.1700 | 0.279 |
0.00000000E+00 | 0.00000000E+00 |
| air03 | 2.1800 | 34.5700 | 0.063 |
3.40160000E+05 | 3.40160000E+05 |
| bal8x12 | 0.1200 | 0.3100 | 0.387 |
4.71550000E+02 | 4.71550000E+02 |
| bell3a | 1.4600 | 19.2900 | 0.076 |
8.78430316E+05 | 8.78430316E+05 |
| dano3_3 | 108.3300 | 270.8900 | 0.400 |
5.76344633E+02 | 5.76344633E+02 |
| dano3_5 | 451.1400 | 1617.8100 | 0.279 |
5.76924916E+02 | 5.76924916E+02 |
| dsbmip | 0.8200 | 4.6500 | 0.176 |
-3.06769012E+02 | -3.06769012E+02 |
| fixnet6 | 1.3600 | 3.4200 | 0.398 |
3.98300000E+03 | 3.98300000E+03 |
| l152lav | 1.9100 | 4.4100 | 0.433 |
4.72200000E+03 | 4.72200000E+03 |
| mas284 | 8.7200 | 29.9200 | 0.291 |
9.14057237E+04 | 9.14057237E+04 |
| mas74 | 318.9400 | 1351.2900 | 0.236 |
1.18011857E+04 | 1.18011857E+04 |
| mas76 | 21.1600 | 107.1800 | 0.197 |
4.00050541E+04 | 4.00050541E+04 |
| mitre | 2.1100 | 10.1900 | 0.207 |
1.15155000E+05 | 1.15155000E+05 |
| neos1 | 7.5600 | 17.5800 | 0.430 |
1.90000000E+01 | 1.90000000E+01 |
| neos2 | 10.3200 | 60.9800 | 0.169 |
4.54864697E+02 | 4.54864697E+02 |
| neos3 | 14.4300 | 1242.0800 | 0.012 |
3.68842751E+02 | 3.68842751E+02 |
| nug08 | 17.0800 | 161.2800 | 0.106 |
2.14000000E+02 | 2.14000000E+02 |
| nw04 | 11.7500 | 49.4400 | 0.238 |
1.68620000E+04 | 1.68620000E+04 |
| pk1 | 37.2200 | 122.2200 | 0.305 |
1.10000000E+01 | 1.10000000E+01 |
| qnet1_o | 2.1600 | 6.8600 | 0.315 |
1.60296927E+04 | 1.60296927E+04 |
| ran17x17 | 8.8000 | 18.6400 | 0.472 |
1.37300000E+03 | 1.37300000E+03 |
| rlp2 | 0.4500 | 1.2700 | 0.354 |
1.90000000E+01 | 1.90000000E+01 |
Back to top
Solver Cbc faster - Obj same for both solvers:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| air05 | 40.3600 | 57.6400 | 0.700 |
2.63740000E+04 | 2.63750000E+04 |
| bienst1 | 206.5200 | 356.1000 | 0.580 |
4.67500000E+01 | 4.67500000E+01 |
| binkar10_1 | 317.3000 | 400.6300 | 0.792 |
6.74220002E+03 | 6.74220002E+03 |
| dano3_4 | 243.4300 | 478.3900 | 0.509 |
5.76435225E+02 | 5.76435225E+02 |
| dcmulti | 1.8400 | 2.8400 | 0.648 |
1.88182000E+05 | 1.88182000E+05 |
| gesa3 | 1.1500 | 1.3900 | 0.827 |
2.79910426E+07 | 2.79910426E+07 |
| khb05250 | 0.4100 | 0.5200 | 0.788 |
1.06940226E+08 | 1.06940226E+08 |
| mod010 | 0.7500 | 1.1000 | 0.682 |
6.54800000E+03 | 6.54800000E+03 |
| mod011 | 112.0600 | 196.4800 | 0.570 |
-5.45585350E+07 | -5.45585350E+07 |
| p0548 | 0.1600 | 0.2500 | 0.640 |
8.69100000E+03 | 8.69100000E+03 |
| prod1 | 21.7500 | 28.3600 | 0.767 |
-5.60000000E+01 | -5.60000000E+01 |
| qap10 | 200.0100 | 248.3200 | 0.805 |
3.40000000E+02 | 3.40000000E+02 |
| qnet1 | 2.9200 | 5.2000 | 0.562 |
1.60296927E+04 | 1.60296927E+04 |
| ran10x10a | 0.7300 | 0.8700 | 0.839 |
1.49900000E+03 | 1.49900000E+03 |
| ran10x10c | 2.6000 | 3.4700 | 0.749 |
1.30070000E+04 | 1.30070000E+04 |
| ran12x12 | 22.5300 | 28.9700 | 0.778 |
2.29100000E+03 | 2.29100000E+03 |
| ran8x32 | 22.3100 | 30.0400 | 0.743 |
5.24700000E+03 | 5.24700000E+03 |
| rentacar | 4.4300 | 5.7400 | 0.772 |
2.88824709E+07 | 2.88824709E+07 |
| stein45 | 23.5400 | 30.8400 | 0.763 |
3.00000000E+01 | 3.00000000E+01 |
| swath1 | 48.4600 | 54.9600 | 0.882 |
3.79071300E+02 | 3.79071296E+02 |
Back to top
Solvers perform the same - Obj of Cbc better:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| mkc | 3600.4900 | 3600.0200 | 1.000 |
-5.61246000E+02 | -5.60066000E+02 |
| n3700 | 3602.6100 | 3600.0300 | 1.001 |
1.32628000E+06 | 1.34256000E+06 |
| n3705 | 3601.9800 | 3600.0400 | 1.001 |
1.32677400E+06 | 1.34254000E+06 |
| n3708 | 3602.1300 | 3600.0400 | 1.001 |
1.32334400E+06 | 1.32947900E+06 |
| n370a | 3602.0200 | 3600.0400 | 1.001 |
1.33639700E+06 | 1.35304200E+06 |
| n370b | 3602.2400 | 3600.0400 | 1.001 |
1.34133300E+06 | 1.37379100E+06 |
| n370c | 3602.4700 | 3600.0300 | 1.001 |
1.31700900E+06 | 1.34374900E+06 |
| n370d | 3602.1000 | 3600.0300 | 1.001 |
1.31700900E+06 | 1.34374900E+06 |
Back to top
Solvers perform the same - Obj same for both solvers:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| bienst2 | 807.4600 | 836.2500 | 0.966 |
5.46000000E+01 | 5.46000000E+01 |
| bk4x3 | 0.0300 | 0.0100 | --- |
3.50000000E+02 | 3.50000000E+02 |
| cap6000 | 2.3200 | 2.4200 | 0.959 |
-2.45137700E+06 | -2.45137700E+06 |
| danoint | 3602.6100 | 3600.0000 | 1.001 |
6.56666667E+01 | 6.56666667E+01 |
| egout | 0.0400 | 0.0200 | --- |
5.68100700E+02 | 5.68100700E+02 |
| fast0507 | 1206.6700 | 1226.4100 | 0.984 |
1.74000000E+02 | 1.74000000E+02 |
| gr4x6 | 0.0400 | 0.0100 | --- |
2.02350000E+02 | 2.02350000E+02 |
| gt2 | 0.0200 | 0.0900 | --- |
2.11660000E+04 | 2.11660000E+04 |
| irp | 20.1300 | 20.7300 | 0.971 |
1.21594928E+04 | 1.21594928E+04 |
| misc07 | 25.9600 | 28.7200 | 0.904 |
2.81000000E+03 | 2.81000000E+03 |
| n3701 | 3602.1800 | 3600.0400 | 1.001 |
1.31097000E+06 | 1.31097000E+06 |
| n3702 | 3601.9300 | 3600.0400 | 1.001 |
1.32038700E+06 | 1.32038700E+06 |
| n3703 | 3602.7100 | 3600.0400 | 1.001 |
1.31644200E+06 | 1.31644200E+06 |
| n3704 | 3602.1700 | 3600.0400 | 1.001 |
1.32717900E+06 | 1.32717900E+06 |
| n3706 | 3602.0900 | 3600.0300 | 1.001 |
1.32173500E+06 | 1.32173500E+06 |
| n3707 | 3602.2600 | 3600.0400 | 1.001 |
1.30121800E+06 | 1.30121800E+06 |
| n3709 | 3602.2800 | 3600.0400 | 1.001 |
1.32490400E+06 | 1.32490400E+06 |
| n370e | 3602.3500 | 3600.0300 | 1.001 |
1.31564800E+06 | 1.31564800E+06 |
| p0033 | 0.0100 | 0.0200 | --- |
3.08900000E+03 | 3.08900000E+03 |
| ran10x10b | 0.5300 | 0.5700 | 0.930 |
3.07300000E+03 | 3.07300000E+03 |
| ran12x21 | 97.0500 | 96.6400 | 1.004 |
3.66400000E+03 | 3.66400000E+03 |
Back to top
Solvers perform the same - Obj of SCIP better:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| dano3mip | 3629.5700 | 3600.0900 | 1.008 |
7.28705882E+02 | 7.09322581E+02 |
| harp2 | 3601.3600 | 3600.0000 | 1.000 |
-7.38762990E+07 | -7.38997970E+07 |
| mkc1 | 3600.3600 | 3600.0200 | 1.000 |
-6.07050000E+02 | -6.07207000E+02 |
| ran14x18 | 3603.8300 | 3600.0000 | 1.001 |
3.73600000E+03 | 3.73500000E+03 |
| seymour | 3601.5200 | 3600.0100 | 1.000 |
4.28000000E+02 | 4.26000000E+02 |
| swath | 3600.8600 | 3600.0200 | 1.000 |
5.71749541E+02 | 4.83067580E+02 |
Back to top
Solver SCIP faster - Obj same for both solvers:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| acc-tight-5 | 277.7500 | 176.4300 | 1.574 |
0.00000000E+00 | 0.00000000E+00 |
| air04 | 126.5800 | 99.9300 | 1.267 |
5.61370000E+04 | 5.61380000E+04 |
| arki001 | 3601.4400 | 2693.0100 | 1.337 |
7.58093034E+06 | 7.58081305E+06 |
| fiber | 1.9900 | 1.0900 | 1.826 |
4.05935180E+05 | 4.05935180E+05 |
| gen | 0.1800 | 0.1000 | 1.800 |
1.12313363E+05 | 1.12313363E+05 |
| gesa3_o | 2.3300 | 1.5300 | 1.523 |
2.79910426E+07 | 2.79910426E+07 |
| misc03 | 1.5400 | 1.2400 | 1.242 |
3.36000000E+03 | 3.36000000E+03 |
| misc06 | 0.5300 | 0.4100 | 1.293 |
1.28508607E+04 | 1.28508607E+04 |
| mod008 | 0.3300 | 0.2300 | 1.435 |
3.07000000E+02 | 3.07000000E+02 |
| neos5 | 4.4300 | 2.3800 | 1.861 |
-4.86034408E+10 | -4.86034408E+10 |
| p0201 | 1.6300 | 1.0900 | 1.495 |
7.61500000E+03 | 7.61500000E+03 |
| p0282 | 0.9900 | 0.5500 | 1.800 |
2.58411000E+05 | 2.58411000E+05 |
| p2756 | 1.9300 | 1.6600 | 1.163 |
3.12400000E+03 | 3.12400000E+03 |
| qiu | 184.3100 | 148.2100 | 1.244 |
-1.32873137E+02 | -1.32873137E+02 |
| ran10x12 | 0.8200 | 0.7100 | 1.155 |
2.71400000E+03 | 2.71400000E+03 |
| ran10x26 | 74.3300 | 52.0300 | 1.429 |
4.27000000E+03 | 4.27000000E+03 |
| ran13x13 | 80.9600 | 62.2600 | 1.300 |
3.25200000E+03 | 3.25200000E+03 |
| ran16x16 | 738.1000 | 654.7200 | 1.127 |
3.82300000E+03 | 3.82300000E+03 |
| ran4x64 | 1.0300 | 0.8700 | 1.184 |
9.71100000E+03 | 9.71100000E+03 |
| ran6x43 | 2.3700 | 1.5500 | 1.529 |
6.33000000E+03 | 6.33000000E+03 |
| stein27 | 1.8100 | 1.0900 | 1.661 |
1.80000000E+01 | 1.80000000E+01 |
| swath2 | 157.5000 | 101.1300 | 1.557 |
3.85199693E+02 | 3.85199693E+02 |
| vpm1 | 0.2400 | 0.0300 | --- |
2.00000000E+01 | 2.00000000E+01 |
Back to top
Solver SCIP much faster - Obj of Cbc better:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| bc1 | 1497.3200 | 15.7800 | 94.887 |
3.33836255E+00 | 3.49143049E+00 |
| markshare1 | 3604.2100 | 1306.2900 | 2.759 |
4.00000000E+00 | 1.00000000E+01 |
| markshare2 | 3601.3200 | 1527.1900 | 2.358 |
1.10000000E+01 | 1.90000000E+01 |
Back to top
Solver SCIP much faster - Obj same for both solvers:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| acc-tight-3 | 1301.4600 | 113.3800 | 11.479 |
0.00000000E+00 | 0.00000000E+00 |
| bell5 | 3.1100 | 0.4400 | 7.068 |
8.96640649E+06 | 8.96640649E+06 |
| blend2 | 2.8200 | 0.3300 | 8.545 |
7.59898500E+00 | 7.59898500E+00 |
| eild76 | 1491.7500 | 31.1000 | 47.966 |
8.85411847E+02 | 8.85411847E+02 |
| enigma | 2.2300 | 0.9300 | 2.398 |
0.00000000E+00 | 0.00000000E+00 |
| gesa2 | 2.4600 | 1.0700 | 2.299 |
2.57798564E+07 | 2.57798564E+07 |
| gesa2_o | 7.0600 | 1.0300 | 6.854 |
2.57798564E+07 | 2.57798564E+07 |
| lseu | 0.6100 | 0.2200 | 2.773 |
1.12000000E+03 | 1.12000000E+03 |
| modglob | 5.9000 | 0.6100 | 9.672 |
2.07405081E+07 | 2.07405081E+07 |
| neos4 | 15.9900 | 2.4100 | 6.635 |
-4.86034408E+10 | -4.86034408E+10 |
| neos7 | 1074.2600 | 145.0600 | 7.406 |
7.21934000E+05 | 7.21934000E+05 |
| noswot | 1869.1000 | 120.3200 | 15.534 |
-4.10000000E+01 | -4.10000000E+01 |
| pp08acuts | 13.4200 | 2.2500 | 5.964 |
7.35000000E+03 | 7.35000000E+03 |
| pp08a | 15.2300 | 1.7900 | 8.508 |
7.35000000E+03 | 7.35000000E+03 |
| rgn | 5.8100 | 0.9200 | 6.315 |
8.21999992E+01 | 8.21999968E+01 |
| rout | 818.3400 | 39.8700 | 20.525 |
1.07756000E+03 | 1.07756000E+03 |
| set1ch | 418.4100 | 0.5800 | 721.397 |
5.45377500E+04 | 5.45377500E+04 |
| seymour1 | 1752.7200 | 773.0400 | 2.267 |
4.10763701E+02 | 4.10763701E+02 |
| vpm2 | 2.9500 | 1.1000 | 2.682 |
1.37500000E+01 | 1.37500000E+01 |
Back to top
Solver SCIP much faster - Obj of SCIP better:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| neos6 | 3601.2300 | 1605.1500 | 2.244 |
8.40000000E+01 | 8.30000000E+01 |
Back to top
Solver SCIP infinitely faster - Obj of SCIP better:
| Modelname |
Time (Cbc) |
Time (SCIP) |
Ratio (Cbc / SCIP) |
Obj (Cbc) |
Obj (SCIP) |
| acc-tight-2 | fail | 1088.0300 | -- |
0.00000000E+00 | 0.00000000E+00 |
Back to top