Solver Square Comparison: Considers all models.

Date / Time: 06/01/08 16:28:18


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver SCIP is represented on the left (rows) and solver Cbc on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :2-SCIP-1.trc
Tracefile 2 :3-CBC-1.trc
Solvers used : SCIP
Cbc
Modeltype(s)   MIP



Cbc:
optimal
Cbc:
feasible
Cbc:
infeasible
Cbc:
unbounded
Cbc:
fail
Cbc:
no data
total SCIP
SCIP:
optimal
89 5 - - 1 - 95
SCIP:
feasible
1 26 - - 1 - 28
SCIP:
infeasible
- - - - - - -
SCIP:
unbounded
- - - - - - -
SCIP:
fail
- - - - 2 - 2
SCIP:
no data
- - - - - - -
total Cbc 90 31 - - 4 - 125




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


SCIP: optimal -- Cbc: optimal    Back to top

Modelname Time (SCIP) Time (Cbc) Ratio (SCIP/Cbc) Obj (SCIP) Obj (Cbc)
acc-tight-0 20.4400 2.8200 7.248 0.00000000 0.00000000
air03 15.2000 2.3900 6.360 340160.00000000 340160.00000000
air04 201.9700 248.9600 0.811 56138.00000000 56137.00000000
air05 265.3100 137.0800 1.935 26374.00000000 26374.00000000
bal8x12 0.2800 0.2600 1.077 471.55000000 471.55000000
bc1 1063.5700 1113.0900 0.956 3.33836255 3.33836255
bell3a 25.0800 3.3400 7.509 878430.31600000 878430.31600000
bell5 1.1700 2.6400 0.443 8966406.49152000 8966406.49152000
bienst1 386.6800 114.6000 3.374 46.75000000 46.75000000
bienst2 1818.9900 1181.1600 1.540 54.60000000 54.60000000
bk4x3 0.0100 0.0200 --- 350.00000000 350.00000000
blend2 0.6200 5.3200 0.117 7.59898500 7.59898500
cap6000 10.1200 255.2300 0.040 -2451377.00000000 -2451377.00000000
10teams 85.1200 45.6200 1.866 924.00000000 924.00000000
acc-tight-1 189.8200 4.6800 40.560 0.00000000 0.00000000
acc-tight-4 156.6700 3.7600 41.668 0.00000000 0.00000000
acc-tight-5 952.6700 521.7100 1.826 0.00000000 0.00000000
dano3_3 435.7600 189.7200 2.297 576.34463303 576.34463303
dano3_4 514.8800 269.3700 1.911 576.43522471 576.43522471
dano3_5 1767.1700 1048.9900 1.685 576.92491596 576.92491596
dcmulti 3.5400 6.3000 0.562 188182.00000000 188182.00000000
dsbmip 2.1000 1.2200 1.721 -306.76901203 -306.76901203
egout 0.0500 0.0400 1.250 568.10070000 568.10070000
enigma 0.4000 3.1000 0.129 0.00000000 0.00000000
fiber 2.3100 4.2300 0.546 405935.18000000 405935.18000000
fixnet6 3.3100 5.7000 0.581 3983.00000000 3983.00000000
gen 0.2700 0.1800 1.500 112313.36271800 112313.36271800
gesa2 8.0300 4.3600 1.842 25779856.36715450 25779856.37169790
gesa2_o 10.6500 46.9100 0.227 25779856.29279900 25779856.37169790
gesa3 10.6000 2.0100 5.274 27991042.64398030 27991042.64838270
gesa3_o 11.2500 12.0800 0.931 27991042.64785830 27991042.64838270
gr4x6 0.0100 0.0200 --- 202.35000000 202.35000000
gt2 0.1400 0.1700 0.824 21166.00000000 21166.00000000
irp 49.9100 43.2600 1.154 12159.49283600 12159.49283600
khb05250 0.9900 0.7400 1.338 106940226.00000000 106940226.00000000
l152lav 13.1200 4.8500 2.705 4722.00000000 4722.00000000
lseu 0.3400 2.0000 0.170 1120.00000000 1120.00000000
mas284 59.1000 31.4400 1.880 91405.72368220 91405.72368220
mas76 231.2800 197.4800 1.171 40005.05414200 40005.05414200
misc03 3.1600 3.8400 0.823 3360.00000000 3360.00000000
misc06 0.9200 1.4800 0.622 12850.86073738 12850.86073738
misc07 72.3100 104.0300 0.695 2810.00000000 2810.00000000
mitre 113.0900 11.6500 9.707 115155.00000000 115155.00000000
mod008 1.0100 4.3400 0.233 307.00000000 307.00000000
mod010 1.2800 0.8300 1.542 6548.00000000 6548.00000000
mod011 427.9800 192.0600 2.228 -54558535.01422730 -54558535.01422730
modglob 2.6100 32.6400 0.080 20740508.08446230 20740508.08630820
neos1 16.8400 15.5100 1.086 19.00000000 19.00000000
neos2 211.0200 1300.0700 0.162 454.86469704 454.86970173
neos4 4.4100 13.3400 0.331 -4.8603440750589E+10 -4.8603440750589E+10
neos5 4.1200 9.3500 0.441 -4.8603440750589E+10 -4.8603440750589E+10
neos6 2235.4400 325.0500 6.877 83.00000000 83.00000000
nw04 100.2100 16.1700 6.197 16862.00000000 16862.00000000
p0033 0.0800 0.0400 2.000 3089.00000000 3089.00000000
p0201 3.6600 8.3600 0.438 7615.00000000 7615.00000000
p0282 1.0600 4.8300 0.219 258411.00000000 258411.00000000
p0548 0.7700 0.4100 1.878 8691.00000000 8691.00000000
p2756 4.7500 8.2400 0.576 3124.00000000 3124.00000000
pk1 236.3400 95.9900 2.462 11.00000000 11.00000000
pp08acuts 3.8900 94.5500 0.041 7350.00000000 7350.00000000
pp08a 3.6200 24.0400 0.151 7350.00000000 7350.00000000
prod1 62.9400 151.0600 0.417 -56.00000000 -56.00000000
qiu 301.3300 230.6900 1.306 -132.87313695 -132.87313695
qnet1 9.1600 4.7600 1.924 16029.69268100 16029.69268100
qnet1_o 6.1400 9.9000 0.620 16029.69268100 16029.69268100
ran10x10a 0.9800 1.0900 0.899 1499.00000000 1499.00000000
ran10x10b 0.8200 1.5300 0.536 3073.00000000 3073.00000000
ran10x10c 6.3600 9.4600 0.672 13007.00000000 13007.00000000
ran10x12 1.0800 0.9800 1.102 2714.00000000 2714.00000000
ran10x26 105.9600 74.6500 1.419 4270.00000000 4270.00000000
ran12x12 46.3300 86.9500 0.533 2291.00000000 2291.00000000
ran12x21 377.3000 220.5100 1.711 3664.00000000 3664.00000000
ran13x13 146.5600 158.4600 0.925 3252.00000000 3252.00000000
ran16x16 1908.7800 1347.0800 1.417 3823.00000000 3823.00000000
ran17x17 30.8500 44.0500 0.700 1373.00000000 1373.00000000
ran4x64 2.3100 2.2200 1.041 9711.00000000 9711.00000000
ran6x43 1.5800 3.1200 0.506 6330.00000000 6330.00000000
ran8x32 37.0900 102.0700 0.363 5247.00000000 5247.00000000
rentacar 5.2100 20.6600 0.252 28882470.08510510 28882470.94755360
rgn 1.9600 5.3800 0.364 82.19999924 82.19999924
rlp2 8.9400 3.4100 2.622 19.00000000 19.00000000
rout 293.9600 1469.3500 0.200 1077.56000000 1077.56000000
seymour1 1560.6600 1575.7400 0.990 410.76370139 410.76370139
stein27 2.3400 2.9700 0.788 18.00000000 18.00000000
stein45 63.9000 75.4900 0.846 30.00000000 30.00000000
swath1 142.7600 394.6700 0.362 379.07129575 379.07129575
swath2 159.2700 901.9800 0.177 385.19969295 385.19969295
vpm1 0.1000 0.1500 0.667 20.00000000 20.00000000
vpm2 3.6700 3.9600 0.927 13.75000000 13.75000000

Back to top





SCIP: optimal -- Cbc: feasible    Back to top

Modelname Time (SCIP) Time (Cbc) Ratio (SCIP/Cbc) Obj (SCIP) Obj (Cbc)
arki001 137.6700 3605.8600 0.038 7590989.63795922 7582707.95503836
binkar10_1 1112.6500 3603.3600 0.309 6742.20002400 6742.20002400
neos3 3041.2300 3602.8900 0.844 368.84275100 369.35192970
noswot 465.5700 1170.9300 0.398 -41.00000000 -41.00000000
set1ch 2.4900 3602.5000 0.001 54537.75000000 54543.00000000

Back to top





SCIP: optimal -- Cbc: fail    Back to top

Modelname Time (SCIP) Time (Cbc) Ratio (SCIP/Cbc) Obj (SCIP) Status (Cbc)
acc-tight-6 898.3200 3601.1800 --- 0.00000000 mstat(14) sstat( 3)

Back to top





SCIP: feasible -- Cbc: optimal    Back to top

Modelname Time (SCIP) Time (Cbc) Ratio (SCIP/Cbc) Obj (SCIP) Obj (Cbc)
harp2 1821.3200 617.2800 2.951 -73899787.00000000 -73899798.00000000

Back to top





SCIP: feasible -- Cbc: feasible    Back to top

Modelname Time (SCIP) Time (Cbc) Ratio (SCIP/Cbc) Obj (SCIP) Obj (Cbc)
bc 3583.3200 3216.3800 1.114 7.00000000 7.00000000
dano3mip 3600.1500 3656.4200 0.985 729.81690141 764.96296296
danoint 3600.0000 3602.2500 0.999 65.66666667 65.66666667
fast0507 3559.2100 3604.8800 0.987 175.00000000 178.00000000
markshare1 349.5600 332.7700 1.050 16.00000000 16.00000000
markshare2 404.9800 380.0500 1.066 11.00000000 39.00000000
mas74 1002.4200 397.5900 2.521 11857.37125820 11801.18572900
n3700 3597.3600 3604.0000 0.998 1342560.00000000 1485299.00000000
n3701 3600.1000 3604.0800 0.999 1310970.00000000 1478706.00000000
n3702 3600.0700 3603.2900 0.999 1320387.00000000 1492733.00000000
n3703 3600.1200 3602.0500 0.999 1316442.00000000 2012229.00000000
n3704 3600.0900 3602.6200 0.999 1327179.00000000 1478967.00000000
n3705 3600.3800 3603.6900 0.999 1342540.00000000 1461824.00000000
n3706 3600.1200 3603.4000 0.999 1321735.00000000 1492521.00000000
n3707 3598.0800 3602.5700 0.999 1301218.00000000 2034880.00000000
n3708 3599.0100 3602.9200 0.999 1313681.00000000 1439272.00000000
n3709 3600.1100 3603.7900 0.999 1324904.00000000 1485358.00000000
n370a 3600.1100 3603.9400 0.999 1353042.00000000 1531728.00000000
n370b 3589.7500 3604.0500 0.996 1371162.00000002 1496205.00000000
n370c 3600.1200 3603.6600 0.999 1339434.00000000 1472412.00000000
n370d 3600.1200 3604.0200 0.999 1339434.00000000 1472412.00000000
n370e 3600.1400 3602.3400 0.999 1294544.00000000 2007778.00000000
seymour 3600.0500 3602.6900 0.999 425.00000000 430.00000000
mkc 3534.7300 3602.8400 0.981 -554.94200000 -540.31200000
ran14x18 3555.1200 2962.8400 1.200 3735.00000000 3754.00000000
swath 3472.6400 3602.3000 0.964 496.73085800 514.60367300

Back to top





SCIP: feasible -- Cbc: fail    Back to top

Modelname Time (SCIP) Time (Cbc) Ratio (SCIP/Cbc) Obj (SCIP) Status (Cbc)
mkc1 3461.9200 NA --- -607.20700000 mstat(13) sstat(13)

Back to top





SCIP: fail -- Cbc: fail    Back to top

Modelname Time (SCIP) Time (Cbc) Ratio (SCIP/Cbc) Status (SCIP) Status (Cbc)
acc-tight-2 3600.0200 3601.6700 --- mstat(14) sstat( 3) mstat(14) sstat( 3)
acc-tight-3 3600.0300 3601.1600 --- mstat(14) sstat( 3) mstat(14) sstat( 3)

Back to top





SCIP: optimal:     Back to top

Modelname Time (SCIP) Obj (SCIP)
acc-tight-0 20.4400 0.00000000
air03 15.2000 340160.00000000
air04 201.9700 56138.00000000
air05 265.3100 26374.00000000
arki001 137.6700 7590989.63795922
bal8x12 0.2800 471.55000000
bc1 1063.5700 3.33836255
bell3a 25.0800 878430.31600000
bell5 1.1700 8966406.49152000
bienst1 386.6800 46.75000000
bienst2 1818.9900 54.60000000
binkar10_1 1112.6500 6742.20002400
bk4x3 0.0100 350.00000000
blend2 0.6200 7.59898500
cap6000 10.1200 -2451377.00000000
10teams 85.1200 924.00000000
acc-tight-1 189.8200 0.00000000
acc-tight-4 156.6700 0.00000000
acc-tight-5 952.6700 0.00000000
acc-tight-6 898.3200 0.00000000
dano3_3 435.7600 576.34463303
dano3_4 514.8800 576.43522471
dano3_5 1767.1700 576.92491596
dcmulti 3.5400 188182.00000000
dsbmip 2.1000 -306.76901203
egout 0.0500 568.10070000
enigma 0.4000 0.00000000
fiber 2.3100 405935.18000000
fixnet6 3.3100 3983.00000000
gen 0.2700 112313.36271800
gesa2 8.0300 25779856.36715450
gesa2_o 10.6500 25779856.29279900
gesa3 10.6000 27991042.64398030
gesa3_o 11.2500 27991042.64785830
gr4x6 0.0100 202.35000000
gt2 0.1400 21166.00000000
irp 49.9100 12159.49283600
khb05250 0.9900 106940226.00000000
l152lav 13.1200 4722.00000000
lseu 0.3400 1120.00000000
mas284 59.1000 91405.72368220
mas76 231.2800 40005.05414200
misc03 3.1600 3360.00000000
misc06 0.9200 12850.86073738
misc07 72.3100 2810.00000000
mitre 113.0900 115155.00000000
mod008 1.0100 307.00000000
mod010 1.2800 6548.00000000
mod011 427.9800 -54558535.01422730
modglob 2.6100 20740508.08446230
neos1 16.8400 19.00000000
neos2 211.0200 454.86469704
neos3 3041.2300 368.84275100
neos4 4.4100 -4.8603440750589E+10
neos5 4.1200 -4.8603440750589E+10
neos6 2235.4400 83.00000000
noswot 465.5700 -41.00000000
nw04 100.2100 16862.00000000
p0033 0.0800 3089.00000000
p0201 3.6600 7615.00000000
p0282 1.0600 258411.00000000
p0548 0.7700 8691.00000000
p2756 4.7500 3124.00000000
pk1 236.3400 11.00000000
pp08acuts 3.8900 7350.00000000
pp08a 3.6200 7350.00000000
prod1 62.9400 -56.00000000
qiu 301.3300 -132.87313695
qnet1 9.1600 16029.69268100
qnet1_o 6.1400 16029.69268100
ran10x10a 0.9800 1499.00000000
ran10x10b 0.8200 3073.00000000
ran10x10c 6.3600 13007.00000000
ran10x12 1.0800 2714.00000000
ran10x26 105.9600 4270.00000000
ran12x12 46.3300 2291.00000000
ran12x21 377.3000 3664.00000000
ran13x13 146.5600 3252.00000000
ran16x16 1908.7800 3823.00000000
ran17x17 30.8500 1373.00000000
ran4x64 2.3100 9711.00000000
ran6x43 1.5800 6330.00000000
ran8x32 37.0900 5247.00000000
rentacar 5.2100 28882470.08510510
rgn 1.9600 82.19999924
rlp2 8.9400 19.00000000
rout 293.9600 1077.56000000
set1ch 2.4900 54537.75000000
seymour1 1560.6600 410.76370139
stein27 2.3400 18.00000000
stein45 63.9000 30.00000000
swath1 142.7600 379.07129575
swath2 159.2700 385.19969295
vpm1 0.1000 20.00000000
vpm2 3.6700 13.75000000

Back to top





SCIP: feasible:     Back to top

Modelname Time (SCIP) Obj (SCIP)
bc 3583.3200 7.00000000
dano3mip 3600.1500 729.81690141
danoint 3600.0000 65.66666667
fast0507 3559.2100 175.00000000
harp2 1821.3200 -73899787.00000000
markshare1 349.5600 16.00000000
markshare2 404.9800 11.00000000
mas74 1002.4200 11857.37125820
n3700 3597.3600 1342560.00000000
n3701 3600.1000 1310970.00000000
n3702 3600.0700 1320387.00000000
n3703 3600.1200 1316442.00000000
n3704 3600.0900 1327179.00000000
n3705 3600.3800 1342540.00000000
n3706 3600.1200 1321735.00000000
n3707 3598.0800 1301218.00000000
n3708 3599.0100 1313681.00000000
n3709 3600.1100 1324904.00000000
n370a 3600.1100 1353042.00000000
n370b 3589.7500 1371162.00000002
n370c 3600.1200 1339434.00000000
n370d 3600.1200 1339434.00000000
n370e 3600.1400 1294544.00000000
seymour 3600.0500 425.00000000
mkc1 3461.9200 -607.20700000
mkc 3534.7300 -554.94200000
ran14x18 3555.1200 3735.00000000
swath 3472.6400 496.73085800

Back to top





SCIP: fail:     Back to top

Modelname Time (SCIP) Status (SCIP)
acc-tight-2 -- mstat(14) sstat( 3)
acc-tight-3 -- mstat(14) sstat( 3)

Back to top





Cbc: optimal:     Back to top

Modelname Time (Cbc) Obj (Cbc)
acc-tight-0 2.8200 0.00000000
air03 2.3900 340160.00000000
air04 248.9600 56137.00000000
air05 137.0800 26374.00000000
bal8x12 0.2600 471.55000000
bc1 1113.0900 3.33836255
bell3a 3.3400 878430.31600000
bell5 2.6400 8966406.49152000
bienst1 114.6000 46.75000000
bienst2 1181.1600 54.60000000
bk4x3 0.0200 350.00000000
blend2 5.3200 7.59898500
cap6000 255.2300 -2451377.00000000
10teams 45.6200 924.00000000
acc-tight-1 4.6800 0.00000000
acc-tight-4 3.7600 0.00000000
acc-tight-5 521.7100 0.00000000
dano3_3 189.7200 576.34463303
dano3_4 269.3700 576.43522471
dano3_5 1048.9900 576.92491596
dcmulti 6.3000 188182.00000000
dsbmip 1.2200 -306.76901203
egout 0.0400 568.10070000
enigma 3.1000 0.00000000
fiber 4.2300 405935.18000000
fixnet6 5.7000 3983.00000000
gen 0.1800 112313.36271800
gesa2 4.3600 25779856.37169790
gesa2_o 46.9100 25779856.37169790
gesa3 2.0100 27991042.64838270
gesa3_o 12.0800 27991042.64838270
gr4x6 0.0200 202.35000000
gt2 0.1700 21166.00000000
harp2 617.2800 -73899798.00000000
irp 43.2600 12159.49283600
khb05250 0.7400 106940226.00000000
l152lav 4.8500 4722.00000000
lseu 2.0000 1120.00000000
mas284 31.4400 91405.72368220
mas76 197.4800 40005.05414200
misc03 3.8400 3360.00000000
misc06 1.4800 12850.86073738
misc07 104.0300 2810.00000000
mitre 11.6500 115155.00000000
mod008 4.3400 307.00000000
mod010 0.8300 6548.00000000
mod011 192.0600 -54558535.01422730
modglob 32.6400 20740508.08630820
neos1 15.5100 19.00000000
neos2 1300.0700 454.86970173
neos4 13.3400 -4.8603440750589E+10
neos5 9.3500 -4.8603440750589E+10
neos6 325.0500 83.00000000
nw04 16.1700 16862.00000000
p0033 0.0400 3089.00000000
p0201 8.3600 7615.00000000
p0282 4.8300 258411.00000000
p0548 0.4100 8691.00000000
p2756 8.2400 3124.00000000
pk1 95.9900 11.00000000
pp08acuts 94.5500 7350.00000000
pp08a 24.0400 7350.00000000
prod1 151.0600 -56.00000000
qiu 230.6900 -132.87313695
qnet1 4.7600 16029.69268100
qnet1_o 9.9000 16029.69268100
ran10x10a 1.0900 1499.00000000
ran10x10b 1.5300 3073.00000000
ran10x10c 9.4600 13007.00000000
ran10x12 0.9800 2714.00000000
ran10x26 74.6500 4270.00000000
ran12x12 86.9500 2291.00000000
ran12x21 220.5100 3664.00000000
ran13x13 158.4600 3252.00000000
ran16x16 1347.0800 3823.00000000
ran17x17 44.0500 1373.00000000
ran4x64 2.2200 9711.00000000
ran6x43 3.1200 6330.00000000
ran8x32 102.0700 5247.00000000
rentacar 20.6600 28882470.94755360
rgn 5.3800 82.19999924
rlp2 3.4100 19.00000000
rout 1469.3500 1077.56000000
seymour1 1575.7400 410.76370139
stein27 2.9700 18.00000000
stein45 75.4900 30.00000000
swath1 394.6700 379.07129575
swath2 901.9800 385.19969295
vpm1 0.1500 20.00000000
vpm2 3.9600 13.75000000

Back to top





Cbc: feasible:     Back to top

Modelname Time (Cbc) Obj (Cbc)
arki001 3605.8600 7582707.95503836
bc 3216.3800 7.00000000
binkar10_1 3603.3600 6742.20002400
dano3mip 3656.4200 764.96296296
danoint 3602.2500 65.66666667
fast0507 3604.8800 178.00000000
markshare1 332.7700 16.00000000
markshare2 380.0500 39.00000000
mas74 397.5900 11801.18572900
n3700 3604.0000 1485299.00000000
n3701 3604.0800 1478706.00000000
n3702 3603.2900 1492733.00000000
n3703 3602.0500 2012229.00000000
n3704 3602.6200 1478967.00000000
n3705 3603.6900 1461824.00000000
n3706 3603.4000 1492521.00000000
n3707 3602.5700 2034880.00000000
n3708 3602.9200 1439272.00000000
n3709 3603.7900 1485358.00000000
n370a 3603.9400 1531728.00000000
n370b 3604.0500 1496205.00000000
n370c 3603.6600 1472412.00000000
n370d 3604.0200 1472412.00000000
n370e 3602.3400 2007778.00000000
neos3 3602.8900 369.35192970
noswot 1170.9300 -41.00000000
set1ch 3602.5000 54543.00000000
seymour 3602.6900 430.00000000
mkc 3602.8400 -540.31200000
ran14x18 2962.8400 3754.00000000
swath 3602.3000 514.60367300

Back to top





Cbc: fail:     Back to top

Modelname Time (Cbc) Status (Cbc)
acc-tight-2 -- mstat(14) sstat( 3)
acc-tight-3 -- mstat(14) sstat( 3)
acc-tight-6 -- mstat(14) sstat( 3)
mkc1 -- mstat(13) sstat(13)

Back to top