Solver Square Comparison: Considers all models.

Date / Time: 06/01/08 16:28:18


Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver Cbc is represented on the left (rows) and solver Glpk on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.


Tracefile 1 :3-CBC-1.trc
Tracefile 2 :4-GLPK-1.trc
Solvers used : Cbc
Glpk
Modeltype(s)   MIP



Glpk:
optimal
Glpk:
feasible
Glpk:
infeasible
Glpk:
unbounded
Glpk:
fail
Glpk:
no data
total Cbc
Cbc:
optimal
62 26 2 - - - 90
Cbc:
feasible
- 30 - - 1 - 31
Cbc:
infeasible
- - - - - - -
Cbc:
unbounded
- - - - - - -
Cbc:
fail
2 1 - - 1 - 4
Cbc:
no data
- - - - - - -
total Glpk 64 57 2 - 2 - 125




Solver return definitions:

OutcomeModel StatusSolver Status
optimal 1 or 15 1
locally optimal 2 any
feasible 8 or 16 1 or 2 or 3 or 4 or 5
infeasible 4 or 5 or 10 or 19 1
unbounded 3 or 18 1
fail all other all other




Solver Resource Times


Cbc: optimal -- Glpk: optimal    Back to top

Modelname Time (Cbc) Time (Glpk) Ratio (Cbc/Glpk) Obj (Cbc) Obj (Glpk)
10teams 45.6200 84.3700 0.541 924.00000000 924.00000000
acc-tight-0 2.8200 34.2300 0.082 0.00000000 0.00000000
acc-tight-1 4.6800 46.8100 0.100 0.00000000 0.00000000
acc-tight-4 3.7600 42.2600 0.089 0.00000000 0.00000000
air03 2.3900 0.6200 3.855 340160.00000000 340160.00000000
bal8x12 0.2600 0.0700 3.714 471.55000000 471.55000000
bc1 1113.0900 3376.0200 0.330 3.33836255 3.33836255
bell3a 3.3400 24.2400 0.138 878430.31600000 878430.31600000
bell5 2.6400 230.8100 0.011 8966406.49152000 8966406.49152000
bienst1 114.6000 360.7100 0.318 46.75000000 46.75000000
bk4x3 0.0200 0.0000 --- 350.00000000 350.00000000
blend2 5.3200 10.3400 0.515 7.59898500 7.59898500
acc-tight-5 521.7100 51.3900 10.152 0.00000000 0.00000000
dano3_3 189.7200 93.1400 2.037 576.34463303 576.34463303
dano3_4 269.3700 109.5400 2.459 576.43522471 576.43522472
dano3_5 1048.9900 1274.6200 0.823 576.92491596 576.92491596
dcmulti 6.3000 2.4400 2.582 188182.00000000 188182.00000000
dsbmip 1.2200 0.2800 4.357 -306.76901203 -306.76901203
egout 0.0400 0.0000 --- 568.10070000 568.10070000
enigma 3.1000 19.5000 0.159 0.00000000 0.00000000
fiber 4.2300 179.3300 0.024 405935.18000000 405935.18000000
fixnet6 5.7000 6.1000 0.934 3983.00000000 3983.00000000
gen 0.1800 0.3300 0.545 112313.36271800 112313.36271800
gesa2 4.3600 380.5300 0.011 25779856.37169790 25779856.37169790
gesa3 2.0100 3.8700 0.519 27991042.64838270 27991042.64838270
gesa3_o 12.0800 13.3400 0.906 27991042.64838270 27991042.64838270
gr4x6 0.0200 0.0100 --- 202.35000000 202.35000000
gt2 0.1700 0.1000 1.700 21166.00000000 21166.00000000
irp 43.2600 16.9600 2.551 12159.49283600 12159.49283600
khb05250 0.7400 5.4000 0.137 106940226.00000000 106940226.00000000
l152lav 4.8500 93.8200 0.052 4722.00000000 4722.00000000
lseu 2.0000 0.7500 2.667 1120.00000000 1120.00000000
mas284 31.4400 195.7100 0.161 91405.72368220 91405.72368220
misc03 3.8400 6.1300 0.626 3360.00000000 3360.00000000
misc06 1.4800 0.5700 2.596 12850.86073738 12850.86073738
misc07 104.0300 1077.4300 0.097 2810.00000000 2810.00000000
mitre 11.6500 641.0700 0.018 115155.00000000 115155.00000000
mod008 4.3400 3.4800 1.247 307.00000000 307.00000000
mod010 0.8300 2.4700 0.336 6548.00000000 6548.00000000
nw04 16.1700 12.3800 1.306 16862.00000000 16862.00000000
p0033 0.0400 0.0100 --- 3089.00000000 3089.00000000
p0201 8.3600 2.6200 3.191 7615.00000000 7615.00000000
p0282 4.8300 0.3800 12.711 258411.00000000 258411.00000000
p0548 0.4100 0.7600 0.539 8691.00000000 8691.00000000
p2756 8.2400 28.3400 0.291 3124.00000000 3124.00000000
pp08acuts 94.5500 800.8900 0.118 7350.00000000 7350.00000000
qnet1 4.7600 8.0000 0.595 16029.69268100 16029.69268100
qnet1_o 9.9000 9.4600 1.047 16029.69268100 16029.69268100
ran10x10a 1.0900 8.2600 0.132 1499.00000000 1499.00000000
ran10x10b 1.5300 7.5600 0.202 3073.00000000 3073.00000000
ran10x10c 9.4600 1120.5800 0.008 13007.00000000 13007.00000000
ran10x12 0.9800 1.7200 0.570 2714.00000000 2714.00000000
ran4x64 2.2200 2.1000 1.057 9711.00000000 9711.00000000
ran6x43 3.1200 2.0100 1.552 6330.00000000 6330.00000000
ran8x32 102.0700 607.9400 0.168 5247.00000000 5247.00000000
rentacar 20.6600 4.0400 5.114 28882470.94755360 28882470.94755350
rgn 5.3800 1.6500 3.261 82.19999924 82.19999924
rlp2 3.4100 1060.6900 0.003 19.00000000 19.00000000
stein27 2.9700 2.8000 1.061 18.00000000 18.00000000
stein45 75.4900 134.1700 0.563 30.00000000 30.00000000
vpm1 0.1500 250.1700 0.001 20.00000000 20.00000000
vpm2 3.9600 259.8000 0.015 13.75000000 13.75000000

Back to top





Cbc: optimal -- Glpk: feasible    Back to top

Modelname Time (Cbc) Time (Glpk) Ratio (Cbc/Glpk) Obj (Cbc) Obj (Glpk)
air04 248.9600 3589.7600 0.069 56137.00000000 56147.00000000
air05 137.0800 3590.2200 0.038 26374.00000000 26698.00000000
bienst2 1181.1600 3560.5600 0.332 54.60000000 54.60000000
cap6000 255.2300 3507.8800 0.073 -2451377.00000000 -2443745.00000000
gesa2_o 46.9100 3563.7900 0.013 25779856.37169790 25788326.41875760
harp2 617.2800 3482.3700 0.177 -73899798.00000000 -73625862.00000000
mas76 197.4800 3584.4100 0.055 40005.05414200 40121.91226290
mod011 192.0600 3507.5400 0.055 -54558535.01422730 -54558535.01422730
modglob 32.6400 3591.4600 0.009 20740508.08630820 20798910.76650850
neos1 15.5100 3567.2200 0.004 19.00000000 20.00000000
neos2 1300.0700 3527.4700 0.369 454.86970173 925.69266459
neos6 325.0500 3566.2700 0.091 83.00000000 92.00000000
pk1 95.9900 3581.6600 0.027 11.00000000 11.00000000
pp08a 24.0400 3584.3500 0.007 7350.00000000 7380.00000000
prod1 151.0600 3527.7400 0.043 -56.00000000 -56.00000000
qiu 230.6900 3581.4000 0.064 -132.87313695 -132.87313695
ran10x26 74.6500 3587.8700 0.021 4270.00000000 4270.00000000
ran12x12 86.9500 3586.8400 0.024 2291.00000000 2291.00000000
ran12x21 220.5100 3589.6800 0.061 3664.00000000 3675.00000000
ran13x13 158.4600 3587.1000 0.044 3252.00000000 3276.00000000
ran16x16 1347.0800 3587.5000 0.375 3823.00000000 3943.00000000
ran17x17 44.0500 3589.3100 0.012 1373.00000000 1405.00000000
rout 1469.3500 3582.3500 0.410 1077.56000000 1077.56000000
seymour1 1575.7400 3565.9700 0.442 410.76370139 410.83591734
swath1 394.6700 3534.1800 0.112 379.07129575 379.07130045
swath2 901.9800 3531.3000 0.255 385.19969295 385.19969295

Back to top





Cbc: optimal -- Glpk: infeasible    Back to top

Modelname Time (Cbc) Time (Glpk) Ratio (Cbc/Glpk) Obj (Cbc) Status (Glpk)
neos4 13.3400 830.6300 --- -4.8603440750589E+10 mstat(19) sstat( 1)
neos5 9.3500 833.0700 --- -4.8603440750589E+10 mstat(19) sstat( 1)

Back to top





Cbc: feasible -- Glpk: feasible    Back to top

Modelname Time (Cbc) Time (Glpk) Ratio (Cbc/Glpk) Obj (Cbc) Obj (Glpk)
binkar10_1 3603.3600 3539.0700 1.018 6742.20002400 6746.76002300
bc 3216.3800 3465.4900 0.928 7.00000000 8.00000000
dano3mip 3656.4200 3618.9700 1.010 764.96296296 742.00000000
danoint 3602.2500 3578.8100 1.007 65.66666667 65.66666667
fast0507 3604.8800 3620.6200 0.996 178.00000000 195.00000000
markshare1 332.7700 3587.9300 0.093 16.00000000 15.00000000
markshare2 380.0500 3586.8200 0.106 39.00000000 40.00000000
mas74 397.5900 3584.5100 0.111 11801.18572900 11877.69436060
mkc 3602.8400 3496.6500 1.030 -540.31200000 -414.63800000
n3700 3604.0000 3552.1700 1.015 1485299.00000000 1935398.00000000
n3701 3604.0800 3552.7600 1.014 1478706.00000000 2005252.00000000
n3702 3603.2900 3544.3000 1.017 1492733.00000000 2063445.00000000
n3703 3602.0500 3557.3700 1.013 2012229.00000000 2078201.00000000
n3704 3602.6200 3549.6600 1.015 1478967.00000000 1966224.00000000
n3705 3603.6900 3545.7000 1.016 1461824.00000000 1838112.00000000
n3706 3603.4000 3549.6800 1.015 1492521.00000000 1979233.00000000
n3707 3602.5700 3550.9300 1.015 2034880.00000000 1911285.00000000
n3708 3602.9200 3556.4700 1.013 1439272.00000000 2007765.00000000
n3709 3603.7900 3548.6800 1.016 1485358.00000000 2125204.00000000
n370a 3603.9400 3546.6800 1.016 1531728.00000000 1931187.00000000
n370b 3604.0500 3551.9200 1.015 1496205.00000000 2116581.00000000
n370c 3603.6600 3545.7200 1.016 1472412.00000000 2118210.00000000
n370d 3604.0200 3543.6200 1.017 1472412.00000000 2118210.00000000
n370e 3602.3400 3553.0200 1.014 2007778.00000000 2138654.00000000
neos3 3602.8900 3539.2600 1.018 369.35192970 680.17629487
noswot 1170.9300 3582.2600 0.327 -41.00000000 -41.00000000
ran14x18 2962.8400 3588.8300 0.826 3754.00000000 3886.00000000
set1ch 3602.5000 3590.2400 1.003 54543.00000000 57480.75000000
seymour 3602.6900 3584.7600 1.005 430.00000000 431.00000000
swath 3602.3000 3542.1900 1.017 514.60367300 508.98487700

Back to top





Cbc: feasible -- Glpk: fail    Back to top

Modelname Time (Cbc) Time (Glpk) Ratio (Cbc/Glpk) Obj (Cbc) Status (Glpk)
arki001 3605.8600 NA --- 7582707.95503836 mstat(13) sstat(13)

Back to top





Cbc: fail -- Glpk: optimal    Back to top

Modelname Time (Cbc) Time (Glpk) Ratio (Cbc/Glpk) Status (Cbc) Obj (Glpk)
acc-tight-2 3601.6700 2751.4400 --- mstat(14) sstat( 3) 0.00000000
acc-tight-6 3601.1800 417.4500 --- mstat(14) sstat( 3) 0.00000000

Back to top





Cbc: fail -- Glpk: feasible    Back to top

Modelname Time (Cbc) Time (Glpk) Ratio (Cbc/Glpk) Status (Cbc) Obj (Glpk)
mkc1 NA 3517.1700 --- mstat(13) sstat(13) -604.72000000

Back to top





Cbc: fail -- Glpk: fail    Back to top

Modelname Time (Cbc) Time (Glpk) Ratio (Cbc/Glpk) Status (Cbc) Status (Glpk)
acc-tight-3 3601.1600 NA --- mstat(14) sstat( 3) mstat(13) sstat(13)

Back to top





Cbc: optimal:     Back to top

Modelname Time (Cbc) Obj (Cbc)
10teams 45.6200 924.00000000
acc-tight-0 2.8200 0.00000000
acc-tight-1 4.6800 0.00000000
acc-tight-4 3.7600 0.00000000
air03 2.3900 340160.00000000
air04 248.9600 56137.00000000
air05 137.0800 26374.00000000
bal8x12 0.2600 471.55000000
bc1 1113.0900 3.33836255
bell3a 3.3400 878430.31600000
bell5 2.6400 8966406.49152000
bienst1 114.6000 46.75000000
bienst2 1181.1600 54.60000000
bk4x3 0.0200 350.00000000
blend2 5.3200 7.59898500
cap6000 255.2300 -2451377.00000000
acc-tight-5 521.7100 0.00000000
dano3_3 189.7200 576.34463303
dano3_4 269.3700 576.43522471
dano3_5 1048.9900 576.92491596
dcmulti 6.3000 188182.00000000
dsbmip 1.2200 -306.76901203
egout 0.0400 568.10070000
enigma 3.1000 0.00000000
fiber 4.2300 405935.18000000
fixnet6 5.7000 3983.00000000
gen 0.1800 112313.36271800
gesa2 4.3600 25779856.37169790
gesa2_o 46.9100 25779856.37169790
gesa3 2.0100 27991042.64838270
gesa3_o 12.0800 27991042.64838270
gr4x6 0.0200 202.35000000
gt2 0.1700 21166.00000000
harp2 617.2800 -73899798.00000000
irp 43.2600 12159.49283600
khb05250 0.7400 106940226.00000000
l152lav 4.8500 4722.00000000
lseu 2.0000 1120.00000000
mas284 31.4400 91405.72368220
mas76 197.4800 40005.05414200
misc03 3.8400 3360.00000000
misc06 1.4800 12850.86073738
misc07 104.0300 2810.00000000
mitre 11.6500 115155.00000000
mod008 4.3400 307.00000000
mod010 0.8300 6548.00000000
mod011 192.0600 -54558535.01422730
modglob 32.6400 20740508.08630820
neos1 15.5100 19.00000000
neos2 1300.0700 454.86970173
neos4 13.3400 -4.8603440750589E+10
neos5 9.3500 -4.8603440750589E+10
neos6 325.0500 83.00000000
nw04 16.1700 16862.00000000
p0033 0.0400 3089.00000000
p0201 8.3600 7615.00000000
p0282 4.8300 258411.00000000
p0548 0.4100 8691.00000000
p2756 8.2400 3124.00000000
pk1 95.9900 11.00000000
pp08acuts 94.5500 7350.00000000
pp08a 24.0400 7350.00000000
prod1 151.0600 -56.00000000
qiu 230.6900 -132.87313695
qnet1 4.7600 16029.69268100
qnet1_o 9.9000 16029.69268100
ran10x10a 1.0900 1499.00000000
ran10x10b 1.5300 3073.00000000
ran10x10c 9.4600 13007.00000000
ran10x12 0.9800 2714.00000000
ran10x26 74.6500 4270.00000000
ran12x12 86.9500 2291.00000000
ran12x21 220.5100 3664.00000000
ran13x13 158.4600 3252.00000000
ran16x16 1347.0800 3823.00000000
ran17x17 44.0500 1373.00000000
ran4x64 2.2200 9711.00000000
ran6x43 3.1200 6330.00000000
ran8x32 102.0700 5247.00000000
rentacar 20.6600 28882470.94755360
rgn 5.3800 82.19999924
rlp2 3.4100 19.00000000
rout 1469.3500 1077.56000000
seymour1 1575.7400 410.76370139
stein27 2.9700 18.00000000
stein45 75.4900 30.00000000
swath1 394.6700 379.07129575
swath2 901.9800 385.19969295
vpm1 0.1500 20.00000000
vpm2 3.9600 13.75000000

Back to top





Cbc: feasible:     Back to top

Modelname Time (Cbc) Obj (Cbc)
arki001 3605.8600 7582707.95503836
binkar10_1 3603.3600 6742.20002400
bc 3216.3800 7.00000000
dano3mip 3656.4200 764.96296296
danoint 3602.2500 65.66666667
fast0507 3604.8800 178.00000000
markshare1 332.7700 16.00000000
markshare2 380.0500 39.00000000
mas74 397.5900 11801.18572900
mkc 3602.8400 -540.31200000
n3700 3604.0000 1485299.00000000
n3701 3604.0800 1478706.00000000
n3702 3603.2900 1492733.00000000
n3703 3602.0500 2012229.00000000
n3704 3602.6200 1478967.00000000
n3705 3603.6900 1461824.00000000
n3706 3603.4000 1492521.00000000
n3707 3602.5700 2034880.00000000
n3708 3602.9200 1439272.00000000
n3709 3603.7900 1485358.00000000
n370a 3603.9400 1531728.00000000
n370b 3604.0500 1496205.00000000
n370c 3603.6600 1472412.00000000
n370d 3604.0200 1472412.00000000
n370e 3602.3400 2007778.00000000
neos3 3602.8900 369.35192970
noswot 1170.9300 -41.00000000
ran14x18 2962.8400 3754.00000000
set1ch 3602.5000 54543.00000000
seymour 3602.6900 430.00000000
swath 3602.3000 514.60367300

Back to top





Cbc: fail:     Back to top

Modelname Time (Cbc) Status (Cbc)
acc-tight-2 -- mstat(14) sstat( 3)
acc-tight-3 -- mstat(14) sstat( 3)
acc-tight-6 -- mstat(14) sstat( 3)
mkc1 -- mstat(13) sstat(13)

Back to top





Glpk: optimal:     Back to top

Modelname Time (Glpk) Obj (Glpk)
10teams 84.3700 924.00000000
acc-tight-0 34.2300 0.00000000
acc-tight-1 46.8100 0.00000000
acc-tight-2 2751.4400 0.00000000
acc-tight-4 42.2600 0.00000000
acc-tight-6 417.4500 0.00000000
air03 0.6200 340160.00000000
bal8x12 0.0700 471.55000000
bc1 3376.0200 3.33836255
bell3a 24.2400 878430.31600000
bell5 230.8100 8966406.49152000
bienst1 360.7100 46.75000000
bk4x3 0.0000 350.00000000
blend2 10.3400 7.59898500
acc-tight-5 51.3900 0.00000000
dano3_3 93.1400 576.34463303
dano3_4 109.5400 576.43522472
dano3_5 1274.6200 576.92491596
dcmulti 2.4400 188182.00000000
dsbmip 0.2800 -306.76901203
egout 0.0000 568.10070000
enigma 19.5000 0.00000000
fiber 179.3300 405935.18000000
fixnet6 6.1000 3983.00000000
gen 0.3300 112313.36271800
gesa2 380.5300 25779856.37169790
gesa3 3.8700 27991042.64838270
gesa3_o 13.3400 27991042.64838270
gr4x6 0.0100 202.35000000
gt2 0.1000 21166.00000000
irp 16.9600 12159.49283600
khb05250 5.4000 106940226.00000000
l152lav 93.8200 4722.00000000
lseu 0.7500 1120.00000000
mas284 195.7100 91405.72368220
misc03 6.1300 3360.00000000
misc06 0.5700 12850.86073738
misc07 1077.4300 2810.00000000
mitre 641.0700 115155.00000000
mod008 3.4800 307.00000000
mod010 2.4700 6548.00000000
nw04 12.3800 16862.00000000
p0033 0.0100 3089.00000000
p0201 2.6200 7615.00000000
p0282 0.3800 258411.00000000
p0548 0.7600 8691.00000000
p2756 28.3400 3124.00000000
pp08acuts 800.8900 7350.00000000
qnet1 8.0000 16029.69268100
qnet1_o 9.4600 16029.69268100
ran10x10a 8.2600 1499.00000000
ran10x10b 7.5600 3073.00000000
ran10x10c 1120.5800 13007.00000000
ran10x12 1.7200 2714.00000000
ran4x64 2.1000 9711.00000000
ran6x43 2.0100 6330.00000000
ran8x32 607.9400 5247.00000000
rentacar 4.0400 28882470.94755350
rgn 1.6500 82.19999924
rlp2 1060.6900 19.00000000
stein27 2.8000 18.00000000
stein45 134.1700 30.00000000
vpm1 250.1700 20.00000000
vpm2 259.8000 13.75000000

Back to top





Glpk: feasible:     Back to top

Modelname Time (Glpk) Obj (Glpk)
air04 3589.7600 56147.00000000
air05 3590.2200 26698.00000000
bienst2 3560.5600 54.60000000
binkar10_1 3539.0700 6746.76002300
cap6000 3507.8800 -2443745.00000000
bc 3465.4900 8.00000000
dano3mip 3618.9700 742.00000000
danoint 3578.8100 65.66666667
fast0507 3620.6200 195.00000000
gesa2_o 3563.7900 25788326.41875760
harp2 3482.3700 -73625862.00000000
markshare1 3587.9300 15.00000000
markshare2 3586.8200 40.00000000
mas74 3584.5100 11877.69436060
mas76 3584.4100 40121.91226290
mkc1 3517.1700 -604.72000000
mkc 3496.6500 -414.63800000
mod011 3507.5400 -54558535.01422730
modglob 3591.4600 20798910.76650850
n3700 3552.1700 1935398.00000000
n3701 3552.7600 2005252.00000000
n3702 3544.3000 2063445.00000000
n3703 3557.3700 2078201.00000000
n3704 3549.6600 1966224.00000000
n3705 3545.7000 1838112.00000000
n3706 3549.6800 1979233.00000000
n3707 3550.9300 1911285.00000000
n3708 3556.4700 2007765.00000000
n3709 3548.6800 2125204.00000000
n370a 3546.6800 1931187.00000000
n370b 3551.9200 2116581.00000000
n370c 3545.7200 2118210.00000000
n370d 3543.6200 2118210.00000000
n370e 3553.0200 2138654.00000000
neos1 3567.2200 20.00000000
neos2 3527.4700 925.69266459
neos3 3539.2600 680.17629487
neos6 3566.2700 92.00000000
noswot 3582.2600 -41.00000000
pk1 3581.6600 11.00000000
pp08a 3584.3500 7380.00000000
prod1 3527.7400 -56.00000000
qiu 3581.4000 -132.87313695
ran10x26 3587.8700 4270.00000000
ran12x12 3586.8400 2291.00000000
ran12x21 3589.6800 3675.00000000
ran13x13 3587.1000 3276.00000000
ran14x18 3588.8300 3886.00000000
ran16x16 3587.5000 3943.00000000
ran17x17 3589.3100 1405.00000000
rout 3582.3500 1077.56000000
set1ch 3590.2400 57480.75000000
seymour1 3565.9700 410.83591734
seymour 3584.7600 431.00000000
swath1 3534.1800 379.07130045
swath2 3531.3000 385.19969295
swath 3542.1900 508.98487700

Back to top





Glpk: infeasible:     Back to top

Modelname Time (Glpk) Status (Glpk)
neos4 -- mstat(19) sstat( 1)
neos5 -- mstat(19) sstat( 1)

Back to top





Glpk: fail:     Back to top

Modelname Time (Glpk) Status (Glpk)
acc-tight-3 -- mstat(13) sstat(13)
arki001 -- mstat(13) sstat(13)

Back to top