Solver Square Comparison: Considers all models.

Date / Time: 09/01/07 15:07:01


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC is represented on the left (rows) and solver GLPK on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :2-CBC-1.trc
Tracefile 2 :3-GLPK-1.trc
Solvers used : CBC
GLPK
Modeltype(s)   MIP



GLPK:
optimal
GLPK:
feasible
GLPK:
infeasible
GLPK:
unbounded
GLPK:
fail
GLPK:
no data
total CBC
CBC:
optimal
- - - - - - -
CBC:
feasible
- 60 - - 61 - 121
CBC:
infeasible
- - - - 1 - 1
CBC:
unbounded
- - - - - - -
CBC:
fail
- - - - 3 - 3
CBC:
no data
- - - - - - -
total GLPK - 60 - - 65 - 125




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


CBC: feasible -- GLPK: feasible    Back to top

Modelname Time (CBC) Time (GLPK) Ratio (CBC/GLPK) Obj (CBC) Obj (GLPK)
10teams 32.9800 203.7200 0.162 924.00000000 924.00000000
acc-tight-0 3.3900 52.9500 0.064 0.00000000 0.00000000
air03 6.4800 0.7800 8.308 340160.00000000 340160.00000000
air05 410.8000 1844.5700 0.223 26374.00000000 26374.00000000
bal8x12 1.6300 0.7100 2.296 471.55000000 471.55000000
bell3a 2.6400 16.2300 0.163 878430.31600000 878430.31600000
bienst1 102.3700 1334.7800 0.077 46.75000000 46.75000000
bk4x3 0.0200 0.0000 --- 350.00000000 350.00000000
blend2 6.5600 13.1800 0.498 7.59898500 7.59898500
dano3_3 185.1500 250.4400 0.739 576.34463303 576.34463303
dano3_4 156.6300 267.1900 0.586 576.43522471 576.43522471
dano3_5 663.8700 1877.3400 0.354 576.92491596 576.92491596
dcmulti 7.1200 5.3400 1.333 188182.00000000 188182.00000000
dsbmip 1.3500 3.7000 0.365 -306.76901203 -306.76901203
egout 0.0300 0.0100 --- 568.10070000 568.10070000
enigma 7.1300 82.6200 0.086 0.00000000 0.00000000
fiber 2.9100 139.0100 0.021 405935.18000000 405935.18000000
fixnet6 2.9600 45.6000 0.065 3983.00000000 3983.00000000
gen 0.2200 1.3300 0.165 112313.36271800 112313.36271800
gesa3 10.1400 15.4300 0.657 27991042.64838270 27991042.64838270
gesa3_o 20.3700 27.9100 0.730 27991042.64838270 27991042.64838270
gr4x6 0.0300 0.1000 0.300 202.35000000 202.35000000
gt2 0.9300 386.3300 0.002 21166.00000000 21166.00000000
harp2 439.1800 567.7800 0.774 -73895028.00000000 -73332492.00000000
irp 15.0900 205.2300 0.074 12159.49283600 12159.49286500
khb05250 0.4600 1.0800 0.426 106940226.00000000 106940226.00000000
l152lav 19.9500 92.7400 0.215 4722.00000000 4722.00000000
lseu 1.5700 2.7300 0.575 1120.00000000 1120.00000000
mas284 31.1000 99.1300 0.314 91405.72368220 91405.72368220
misc03 3.2100 10.4200 0.308 3360.00000000 3360.00000000
misc06 1.3300 1.0900 1.220 12850.86073738 12850.86073738
misc07 107.4100 348.2000 0.308 2810.00000000 2810.00000000
mitre 7.5000 144.1400 0.052 115155.00000000 115155.00000000
mod008 2.5100 9.4600 0.265 307.00000000 307.00000000
mod010 1.2600 2.7600 0.457 6548.00000000 6548.00000000
modglob 39.1200 2390.4900 0.016 20740508.08630820 20740508.08630820
nw04 14.8000 32.1600 0.460 16862.00000000 16862.00000000
p0033 0.1400 0.1500 0.933 3089.00000000 3089.00000000
p0201 6.3000 4.6400 1.358 7615.00000000 7615.00000000
p0282 2.1800 3.6600 0.596 258411.00000000 258411.00000000
p0548 0.4000 5.3200 0.075 8691.00000000 8691.00000000
p2756 1.9600 42.5400 0.046 3124.00000000 3124.00000000
pp08a 44.6700 687.9300 0.065 7350.00000000 7350.00000000
qnet1 5.4200 9.0600 0.598 16029.69268100 16029.69268100
qnet1_o 5.0100 18.9300 0.265 16029.69268100 16029.69268100
ran10x10a 3.8800 19.5200 0.199 1499.00000000 1499.00000000
ran10x10b 1.4400 7.5900 0.190 3073.00000000 3073.00000000
ran10x10c 16.0900 2597.2200 0.006 13007.00000000 13007.00000000
ran10x12 2.1800 2.6400 0.826 2714.00000000 2714.00000000
ran4x64 3.2600 1.3900 2.345 9711.00000000 9711.00000000
ran6x43 4.3100 1.8200 2.368 6330.00000000 6330.00000000
ran8x32 67.0100 897.0700 0.075 5247.00000000 5247.00000000
rentacar 8.8000 7.5500 1.166 28882470.94755350 28882470.94755350
rgn 3.8400 9.4100 0.408 82.19999924 82.19999924
rlp2 3.4600 1698.5300 0.002 19.00000000 19.00000000
rout 736.9400 566.0300 1.302 1077.56000000 1115.57000000
stein27 2.9700 14.6900 0.202 18.00000000 18.00000000
stein45 64.7000 410.1000 0.158 30.00000000 30.00000000
vpm1 0.1800 10.6600 0.017 20.00000000 20.00000000
vpm2 5.6600 24.0700 0.235 13.75000000 14.75000000

Back to top





CBC: feasible -- GLPK: fail    Back to top

Modelname Time (CBC) Time (GLPK) Ratio (CBC/GLPK) Obj (CBC) Status (GLPK)
acc-tight-1 5.2700 NA --- 0.00000000 mstat(13) sstat(13)
acc-tight-4 16.3900 NA --- 0.00000000 mstat(13) sstat(13)
acc-tight-5 379.1400 NA --- 0.00000000 mstat(13) sstat(13)
air04 167.8600 3670.7700 --- 56137.00000000 mstat(14) sstat( 3)
arki001 3602.4800 NA --- 7581532.09193870 mstat(13) sstat(13)
bc1 3314.9500 3502.0500 --- 3.33836255 mstat(14) sstat( 3)
bc 3602.4800 3531.0800 --- 7.00000000 mstat(14) sstat( 3)
bell5 54.6900 3592.1200 --- 8966406.49152000 mstat(14) sstat( 3)
bienst2 881.3800 NA --- 54.60000000 mstat(13) sstat(13)
binkar10_1 3605.0900 3435.3100 --- 6742.20002400 mstat(14) sstat( 3)
cap6000 2.2600 3375.8500 --- -2451372.00000000 mstat(14) sstat( 3)
dano3mip 3717.0700 NA --- 731.00000000 mstat(13) sstat(13)
danoint 3602.3100 3543.0800 --- 65.66666667 mstat(14) sstat( 3)
fast0507 3619.3200 3682.7200 --- 179.00000000 mstat(14) sstat( 3)
gesa2 10.3100 3428.8200 --- 25779856.37169790 mstat(14) sstat( 3)
gesa2_o 86.0300 3482.8100 --- 25781467.82340410 mstat(14) sstat( 3)
markshare1 274.8000 3596.4600 --- 15.00000000 mstat(14) sstat( 3)
markshare2 350.8700 3595.5400 --- 37.00000000 mstat(14) sstat( 3)
mas74 490.3300 3595.6500 --- 11801.18572900 mstat(14) sstat( 3)
mas76 252.1700 3596.1400 --- 40005.05414200 mstat(14) sstat( 3)
mkc1 1196.0100 3507.4900 --- -607.16700000 mstat(14) sstat( 3)
mkc 3602.3100 3449.8900 --- -551.60600000 mstat(14) sstat( 3)
mod011 304.0200 3544.5000 --- -54558535.01422730 mstat(14) sstat( 3)
n3700 3604.1400 3504.8400 --- 1341199.00000000 mstat(14) sstat( 3)
n3701 3603.3000 3502.7600 --- 1317126.00000000 mstat(14) sstat( 3)
n3702 3603.5900 3503.1400 --- 1326806.00000000 mstat(14) sstat( 3)
n3703 3603.4500 3510.0300 --- 1325309.00000000 mstat(14) sstat( 3)
n3704 3603.5800 3500.0000 --- 1331120.00000000 mstat(14) sstat( 3)
n3705 3603.0800 3484.4300 --- 1362932.00000000 mstat(14) sstat( 3)
n3706 3603.5200 3503.8300 --- 1319181.00000000 mstat(14) sstat( 3)
n3707 3603.5700 3502.4700 --- 1300918.00000000 mstat(14) sstat( 3)
n3708 3603.0900 3499.9600 --- 1333483.00000000 mstat(14) sstat( 3)
n3709 3603.2100 3505.1900 --- 1327536.00000000 mstat(14) sstat( 3)
n370a 3603.4500 3487.5200 --- 1357665.00000000 mstat(14) sstat( 3)
n370b 3603.0900 3509.8800 --- 1385587.00000000 mstat(14) sstat( 3)
n370c 3603.2900 3519.2800 --- 1348372.00000000 mstat(14) sstat( 3)
n370d 3603.3900 3519.7300 --- 1348372.00000000 mstat(14) sstat( 3)
n370e 3603.3700 3510.7900 --- 1313313.00000000 mstat(14) sstat( 3)
neos1 36.6700 3591.5400 --- 19.00000000 mstat(14) sstat( 3)
neos2 1504.5400 3430.5000 --- 454.86469704 mstat(14) sstat( 3)
neos3 3601.7200 3481.3800 --- 372.28135552 mstat(14) sstat( 3)
neos5 54.3400 3565.7500 --- -4.8603440750590E+10 mstat(14) sstat( 3)
neos6 2760.3600 3536.9600 --- 83.00000000 mstat(14) sstat( 3)
noswot 1200.0600 3594.2400 --- -41.00000000 mstat(14) sstat( 3)
pk1 129.5600 3595.4100 --- 11.00000000 mstat(14) sstat( 3)
pp08acuts 28.4700 NA --- 7350.00000000 mstat(13) sstat(13)
prod1 118.8700 3450.4600 --- -56.00000000 mstat(14) sstat( 3)
qiu 736.4700 3498.1200 --- -132.87313695 mstat(14) sstat( 3)
ran10x26 84.0000 3592.4200 --- 4270.00000000 mstat(14) sstat( 3)
ran12x12 80.2500 3596.0000 --- 2291.00000000 mstat(14) sstat( 3)
ran12x21 318.7100 3432.1800 --- 3664.00000000 mstat(14) sstat( 3)
ran13x13 107.5600 3481.1600 --- 3252.00000000 mstat(14) sstat( 3)
ran14x18 2896.9600 3592.6400 --- 3740.00000000 mstat(14) sstat( 3)
ran16x16 2296.9600 3448.4600 --- 3823.00000000 mstat(14) sstat( 3)
ran17x17 51.1300 3471.2000 --- 1373.00000000 mstat(14) sstat( 3)
set1ch 3712.6800 3594.7200 --- 54537.75000000 mstat(14) sstat( 3)
seymour1 3609.8200 3583.5800 --- 410.76370139 mstat(14) sstat( 3)
seymour 3606.3000 3611.9900 --- 432.00000000 mstat(14) sstat( 3)
swath1 328.7700 3587.8800 --- 379.07129575 mstat(14) sstat( 3)
swath2 2590.2900 3590.3400 --- 385.19969295 mstat(14) sstat( 3)
swath 3604.2800 3588.9000 --- 508.91597500 mstat(14) sstat( 3)

Back to top





CBC: infeasible -- GLPK: fail    Back to top

Modelname Time (CBC) Time (GLPK) Ratio (CBC/GLPK) Status (CBC) Status (GLPK)
neos4 1.4600 3558.1900 --- mstat(19) sstat( 1) mstat(14) sstat( 3)

Back to top





CBC: fail -- GLPK: fail    Back to top

Modelname Time (CBC) Time (GLPK) Ratio (CBC/GLPK) Status (CBC) Status (GLPK)
acc-tight-2 3601.3000 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
acc-tight-3 3601.6100 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)
acc-tight-6 3601.1300 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)

Back to top





CBC: feasible:     Back to top

Modelname Time (CBC) Obj (CBC)
10teams 32.9800 924.00000000
acc-tight-0 3.3900 0.00000000
acc-tight-1 5.2700 0.00000000
acc-tight-4 16.3900 0.00000000
acc-tight-5 379.1400 0.00000000
air03 6.4800 340160.00000000
air04 167.8600 56137.00000000
air05 410.8000 26374.00000000
arki001 3602.4800 7581532.09193870
bal8x12 1.6300 471.55000000
bc1 3314.9500 3.33836255
bc 3602.4800 7.00000000
bell3a 2.6400 878430.31600000
bell5 54.6900 8966406.49152000
bienst1 102.3700 46.75000000
bienst2 881.3800 54.60000000
binkar10_1 3605.0900 6742.20002400
bk4x3 0.0200 350.00000000
blend2 6.5600 7.59898500
cap6000 2.2600 -2451372.00000000
dano3_3 185.1500 576.34463303
dano3_4 156.6300 576.43522471
dano3_5 663.8700 576.92491596
dano3mip 3717.0700 731.00000000
danoint 3602.3100 65.66666667
dcmulti 7.1200 188182.00000000
dsbmip 1.3500 -306.76901203
egout 0.0300 568.10070000
enigma 7.1300 0.00000000
fast0507 3619.3200 179.00000000
fiber 2.9100 405935.18000000
fixnet6 2.9600 3983.00000000
gen 0.2200 112313.36271800
gesa2 10.3100 25779856.37169790
gesa2_o 86.0300 25781467.82340410
gesa3 10.1400 27991042.64838270
gesa3_o 20.3700 27991042.64838270
gr4x6 0.0300 202.35000000
gt2 0.9300 21166.00000000
harp2 439.1800 -73895028.00000000
irp 15.0900 12159.49283600
khb05250 0.4600 106940226.00000000
l152lav 19.9500 4722.00000000
lseu 1.5700 1120.00000000
markshare1 274.8000 15.00000000
markshare2 350.8700 37.00000000
mas284 31.1000 91405.72368220
mas74 490.3300 11801.18572900
mas76 252.1700 40005.05414200
misc03 3.2100 3360.00000000
misc06 1.3300 12850.86073738
misc07 107.4100 2810.00000000
mitre 7.5000 115155.00000000
mkc1 1196.0100 -607.16700000
mkc 3602.3100 -551.60600000
mod008 2.5100 307.00000000
mod010 1.2600 6548.00000000
mod011 304.0200 -54558535.01422730
modglob 39.1200 20740508.08630820
n3700 3604.1400 1341199.00000000
n3701 3603.3000 1317126.00000000
n3702 3603.5900 1326806.00000000
n3703 3603.4500 1325309.00000000
n3704 3603.5800 1331120.00000000
n3705 3603.0800 1362932.00000000
n3706 3603.5200 1319181.00000000
n3707 3603.5700 1300918.00000000
n3708 3603.0900 1333483.00000000
n3709 3603.2100 1327536.00000000
n370a 3603.4500 1357665.00000000
n370b 3603.0900 1385587.00000000
n370c 3603.2900 1348372.00000000
n370d 3603.3900 1348372.00000000
n370e 3603.3700 1313313.00000000
neos1 36.6700 19.00000000
neos2 1504.5400 454.86469704
neos3 3601.7200 372.28135552
neos5 54.3400 -4.8603440750590E+10
neos6 2760.3600 83.00000000
noswot 1200.0600 -41.00000000
nw04 14.8000 16862.00000000
p0033 0.1400 3089.00000000
p0201 6.3000 7615.00000000
p0282 2.1800 258411.00000000
p0548 0.4000 8691.00000000
p2756 1.9600 3124.00000000
pk1 129.5600 11.00000000
pp08acuts 28.4700 7350.00000000
pp08a 44.6700 7350.00000000
prod1 118.8700 -56.00000000
qiu 736.4700 -132.87313695
qnet1 5.4200 16029.69268100
qnet1_o 5.0100 16029.69268100
ran10x10a 3.8800 1499.00000000
ran10x10b 1.4400 3073.00000000
ran10x10c 16.0900 13007.00000000
ran10x12 2.1800 2714.00000000
ran10x26 84.0000 4270.00000000
ran12x12 80.2500 2291.00000000
ran12x21 318.7100 3664.00000000
ran13x13 107.5600 3252.00000000
ran14x18 2896.9600 3740.00000000
ran16x16 2296.9600 3823.00000000
ran17x17 51.1300 1373.00000000
ran4x64 3.2600 9711.00000000
ran6x43 4.3100 6330.00000000
ran8x32 67.0100 5247.00000000
rentacar 8.8000 28882470.94755350
rgn 3.8400 82.19999924
rlp2 3.4600 19.00000000
rout 736.9400 1077.56000000
set1ch 3712.6800 54537.75000000
seymour1 3609.8200 410.76370139
seymour 3606.3000 432.00000000
stein27 2.9700 18.00000000
stein45 64.7000 30.00000000
swath1 328.7700 379.07129575
swath2 2590.2900 385.19969295
swath 3604.2800 508.91597500
vpm1 0.1800 20.00000000
vpm2 5.6600 13.75000000

Back to top





CBC: infeasible:     Back to top

Modelname Time (CBC) Status (CBC)
neos4 -- mstat(19) sstat( 1)

Back to top





CBC: fail:     Back to top

Modelname Time (CBC) Status (CBC)
acc-tight-2 -- mstat(14) sstat( 3)
acc-tight-3 -- mstat(14) sstat( 3)
acc-tight-6 -- mstat(14) sstat( 3)

Back to top





GLPK: feasible:     Back to top

Modelname Time (GLPK) Obj (GLPK)
10teams 203.7200 924.00000000
acc-tight-0 52.9500 0.00000000
air03 0.7800 340160.00000000
air05 1844.5700 26374.00000000
bal8x12 0.7100 471.55000000
bell3a 16.2300 878430.31600000
bienst1 1334.7800 46.75000000
bk4x3 0.0000 350.00000000
blend2 13.1800 7.59898500
dano3_3 250.4400 576.34463303
dano3_4 267.1900 576.43522471
dano3_5 1877.3400 576.92491596
dcmulti 5.3400 188182.00000000
dsbmip 3.7000 -306.76901203
egout 0.0100 568.10070000
enigma 82.6200 0.00000000
fiber 139.0100 405935.18000000
fixnet6 45.6000 3983.00000000
gen 1.3300 112313.36271800
gesa3 15.4300 27991042.64838270
gesa3_o 27.9100 27991042.64838270
gr4x6 0.1000 202.35000000
gt2 386.3300 21166.00000000
harp2 567.7800 -73332492.00000000
irp 205.2300 12159.49286500
khb05250 1.0800 106940226.00000000
l152lav 92.7400 4722.00000000
lseu 2.7300 1120.00000000
mas284 99.1300 91405.72368220
misc03 10.4200 3360.00000000
misc06 1.0900 12850.86073738
misc07 348.2000 2810.00000000
mitre 144.1400 115155.00000000
mod008 9.4600 307.00000000
mod010 2.7600 6548.00000000
modglob 2390.4900 20740508.08630820
nw04 32.1600 16862.00000000
p0033 0.1500 3089.00000000
p0201 4.6400 7615.00000000
p0282 3.6600 258411.00000000
p0548 5.3200 8691.00000000
p2756 42.5400 3124.00000000
pp08a 687.9300 7350.00000000
qnet1 9.0600 16029.69268100
qnet1_o 18.9300 16029.69268100
ran10x10a 19.5200 1499.00000000
ran10x10b 7.5900 3073.00000000
ran10x10c 2597.2200 13007.00000000
ran10x12 2.6400 2714.00000000
ran4x64 1.3900 9711.00000000
ran6x43 1.8200 6330.00000000
ran8x32 897.0700 5247.00000000
rentacar 7.5500 28882470.94755350
rgn 9.4100 82.19999924
rlp2 1698.5300 19.00000000
rout 566.0300 1115.57000000
stein27 14.6900 18.00000000
stein45 410.1000 30.00000000
vpm1 10.6600 20.00000000
vpm2 24.0700 14.75000000

Back to top





GLPK: fail:     Back to top

Modelname Time (GLPK) Status (GLPK)
acc-tight-1 -- mstat(13) sstat(13)
acc-tight-2 -- mstat(13) sstat(13)
acc-tight-3 -- mstat(13) sstat(13)
acc-tight-4 -- mstat(13) sstat(13)
acc-tight-5 -- mstat(13) sstat(13)
acc-tight-6 -- mstat(13) sstat(13)
air04 -- mstat(14) sstat( 3)
arki001 -- mstat(13) sstat(13)
bc1 -- mstat(14) sstat( 3)
bc -- mstat(14) sstat( 3)
bell5 -- mstat(14) sstat( 3)
bienst2 -- mstat(13) sstat(13)
binkar10_1 -- mstat(14) sstat( 3)
cap6000 -- mstat(14) sstat( 3)
dano3mip -- mstat(13) sstat(13)
danoint -- mstat(14) sstat( 3)
fast0507 -- mstat(14) sstat( 3)
gesa2 -- mstat(14) sstat( 3)
gesa2_o -- mstat(14) sstat( 3)
markshare1 -- mstat(14) sstat( 3)
markshare2 -- mstat(14) sstat( 3)
mas74 -- mstat(14) sstat( 3)
mas76 -- mstat(14) sstat( 3)
mkc1 -- mstat(14) sstat( 3)
mkc -- mstat(14) sstat( 3)
mod011 -- mstat(14) sstat( 3)
n3700 -- mstat(14) sstat( 3)
n3701 -- mstat(14) sstat( 3)
n3702 -- mstat(14) sstat( 3)
n3703 -- mstat(14) sstat( 3)
n3704 -- mstat(14) sstat( 3)
n3705 -- mstat(14) sstat( 3)
n3706 -- mstat(14) sstat( 3)
n3707 -- mstat(14) sstat( 3)
n3708 -- mstat(14) sstat( 3)
n3709 -- mstat(14) sstat( 3)
n370a -- mstat(14) sstat( 3)
n370b -- mstat(14) sstat( 3)
n370c -- mstat(14) sstat( 3)
n370d -- mstat(14) sstat( 3)
n370e -- mstat(14) sstat( 3)
neos1 -- mstat(14) sstat( 3)
neos2 -- mstat(14) sstat( 3)
neos3 -- mstat(14) sstat( 3)
neos4 -- mstat(14) sstat( 3)
neos5 -- mstat(14) sstat( 3)
neos6 -- mstat(14) sstat( 3)
noswot -- mstat(14) sstat( 3)
pk1 -- mstat(14) sstat( 3)
pp08acuts -- mstat(13) sstat(13)
prod1 -- mstat(14) sstat( 3)
qiu -- mstat(14) sstat( 3)
ran10x26 -- mstat(14) sstat( 3)
ran12x12 -- mstat(14) sstat( 3)
ran12x21 -- mstat(14) sstat( 3)
ran13x13 -- mstat(14) sstat( 3)
ran14x18 -- mstat(14) sstat( 3)
ran16x16 -- mstat(14) sstat( 3)
ran17x17 -- mstat(14) sstat( 3)
set1ch -- mstat(14) sstat( 3)
seymour1 -- mstat(14) sstat( 3)
seymour -- mstat(14) sstat( 3)
swath1 -- mstat(14) sstat( 3)
swath2 -- mstat(14) sstat( 3)
swath -- mstat(14) sstat( 3)

Back to top