## Solver Square Comparison: Considers all models.

Results created on 03/08/11 11:29:00 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached.

Solver CPLEX is represented on the left (rows) and solver GUROBI on top (columns).

See the solver return definitions for return codes. Models having trace data only in one trace file are listed in the "no data" column of the other.

Input File Number Filename
Tracefile 1: CPLEX-0.trc
Tracefile 2: GUROBI-0.trc
Solvers used : CPLEX
GUROBI
Modeltype(s)   LP

 GUROBI: optimal GUROBI: locally optimal GUROBI: feasible GUROBI: infeasible GUROBI: unbounded GUROBI: fail GUROBI: no data total CPLEX CPLEX: optimal 109 - - - - 1 - 110 CPLEX: locally optimal - - - - - - - - CPLEX: feasible - - - - - - - - CPLEX: infeasible - - - 2 - 1 - 3 CPLEX: unbounded - - - - - - - - CPLEX: fail - - - - - 3 - 3 CPLEX: no data - - - - - - - - total GUROBI 109 - - 2 - 5 - 116

### Solver return definitions:

 Outcome Model Status Solver Status optimal 1 or 15 1 locally optimal 2 any feasible 7 or 16 or 17 1 or 2 or 3 or 4 or 5 infeasible 4 or 5 or 19 1 unbounded 3 or 18 1 fail all other all other

### Solver Resource Times

• Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
• Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
• Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

### CPLEX: optimal -- GUROBI: optimal

Modelname Time (CPLEX) Time (GUROBI) Ratio (CPLEX/GUROBI) Obj (CPLEX) Obj (GUROBI)
aa01 1.1700 1.0200 1.147 55535.43638822 55535.43638822
aa03 0.5900 0.5100 1.157 49616.36363636 49616.36363636
air02 0.0300 0.0300 --- 7640.00000000 7640.00000000
air06 0.5900 0.5200 1.135 49616.36363636 49616.36363636
baxter 0.6300 0.8300 0.759 56007255.67225310 56007255.67225310
car4 0.2800 0.4200 0.667 35.46037017 35.46037017
cari 0.0400 0.1100 0.364 581.89305779 581.89305779
co5 1.2000 1.1300 1.062 714469.55375105 714469.55378561
co9 5.3000 4.7100 1.125 946920.43028456 946920.43030330
cq5 0.7700 0.7000 1.100 400133.80747262 400133.80747262
cq9 3.2600 3.0500 1.069 505541.70980727 505541.70980727
crew1 0.1500 0.1000 1.500 20.55555556 20.55555556
ex3sta1 13.9700 22.0300 0.634 -63.07540325 -63.07540325
fit2d 0.2200 0.1400 1.571 -68464.29329383 -68464.29329383
fit2p 1.6700 2.3600 0.708 68464.29329383 68464.29329383
fome11 0.0900 0.3100 0.290 0.00000000 0.00000000
fome12 0.2000 35.0000 0.006 0.00000000 0.00000000
gen1 0.0900 0.1400 0.643 0.00000006 0.00000000
gen2 7.2200 14.4600 0.499 3.29279078 3.29279078
gen4 0.5900 0.8800 0.670 0.00000000 0.00000000
jendrec1 0.7600 1.0400 0.731 7028.46051135 7028.46051135
ken-11 0.1900 0.1500 1.267 -6972382262.51997100 -6972382262.51999000
ken-13 0.6000 0.5700 1.053 -1.0257394789482E+10 -1.0257394789483E+10
l30 8.8500 7.4600 1.186 0.95266134 0.95266021
lp22 12.9300 17.2200 0.751 458.94459411 458.94459411
lpl3 0.7000 1.0100 0.693 27318.00000000 27318.00000000
maros-r7 1.0300 1.3300 0.774 1497185.16647964 1497185.16647964
mod2 2.4300 2.2700 1.070 27737371.36444530 27737371.36444490
model10 6.2200 5.7200 1.087 -154599.62130064 -154599.62125060
model11 0.3000 0.2200 1.364 0.00000000 0.00000000
model5 1.2500 0.8600 1.453 -858440.72907343 -858440.72907197
model7 1.7700 0.9700 1.825 49380.08549287 49380.08551681
model9 0.6000 0.4400 1.364 -141123.09361299 -141123.09360669
nemspmm1 1.7900 1.3400 1.336 -327415.83567076 -327415.83567076
nemspmm2 1.8200 1.5700 1.159 -291794.83608908 -291794.83608908
nemswrld 22.2000 21.2800 1.043 260.30896600 260.30896600
nsir1 0.0700 0.0800 0.875 -28909033.00000000 -28909033.00000000
nsir2 0.1800 0.1700 1.059 -27175593.50000000 -27175593.50000000
nug15 1003.0500 673.9000 1.488 1040.99404096 1040.99404096
osa-07 0.1300 0.1100 1.182 535722.51729935 535722.51729935
p010 0.4000 0.3900 1.026 1115047.91511081 1115047.91511082
p05 0.1600 0.1600 1.000 556000.27662588 556000.27662588
pcb3000 0.4100 0.3700 1.108 137416.41961282 137416.41961282
pds-06 0.2000 0.2200 0.909 27761037600.00000000 27761037600.00000000
pds-10 0.4500 0.5300 0.849 26727094976.00000000 26727094976.00000000
pilot87 6.7600 9.5700 0.706 301.71035696 301.71204967
qap15 1086.8500 928.0500 1.171 1040.99404096 1040.99404096
r05 0.1800 0.1800 1.000 557831.85904066 557831.85904066
rat1 0.2000 0.2400 0.833 1999531.66287928 1999531.66287928
rat5 0.6800 0.6600 1.030 3083707.01043842 3083707.01043843
rosen10 0.2300 0.0900 2.556 -174215.45613870 -174215.45613870
scfxm1-2b-64 1.4800 3.4700 0.427 2877.56386371 2877.56386371
scfxm1-2r-64 0.5100 0.7400 0.689 2877.56386371 2877.56386371
scfxm1-2r-96 0.9200 1.9000 0.484 2891.70611371 2891.70611371
scrs8-2r-512 0.0900 0.0400 2.250 1074.09934157 1074.09934157
scsd8-2b-64 0.1700 0.2000 0.850 15.99866803 15.99866803
scsd8-2c-64 0.1800 0.2000 0.900 14.99923200 14.99923200
scsd8-2r-108 0.0600 0.0500 1.200 23.69999434 23.70000024
scsd8-2r-216 0.1500 0.1200 1.250 23.39998395 23.39999200
sctap1-2b-64 0.1900 0.1900 1.000 484.56000000 484.56000000
slptsk 0.5600 0.5300 1.057 29.89536602 29.89536602
south31 13.9900 16.0800 0.870 1818940197.10106000 1818940197.10106000
stocfor3 0.6600 0.5600 1.179 -39976.78394365 -39976.78394365
testbig 0.1500 0.0700 2.143 -60.42296073 -60.42296073
ulevimin 9.2400 8.4200 1.097 -5191101861.43197000 -5191101861.43198000
wood1p 0.0200 0.0300 --- 1.44290241 1.44290241
world 2.1500 2.1600 0.995 40364873.11411920 40364873.11417650
bas1lp 4.4000 0.7200 6.111 363.00000000 363.00000000
cre-b 1.4200 1.4500 0.979 23129639.88683240 23129639.88683240
cre-d 0.6400 0.7600 0.842 24454969.76454920 24454969.76454920
fome13 0.4400 9.9000 0.044 0.00000000 0.00000000
fome20 2.6400 2.9700 0.889 23821658640.00000000 23821658640.00000000
fome21 5.3000 5.9900 0.885 47346318912.00000000 47346318912.00000000
ken-18 4.0900 3.4800 1.175 -5.2217025287397E+10 -5.2217025287397E+10
kl02 0.1900 0.2600 0.731 215.25000000 215.25000000
nemsemm2 0.3000 0.3200 0.938 581079.57090468 581079.57090469
nsct1 0.3200 0.7500 0.427 -38922436.00000000 -38922436.00000000
nsct2 0.6300 1.0000 0.630 -37175082.00000000 -37175082.00000000
osa-14 0.2800 0.3800 0.737 1106462.84473626 1106462.84473625
osa-30 0.6900 0.9800 0.704 2142139.87320976 2142139.87320977
pds-20 2.6100 2.9900 0.873 23821658640.00000000 23821658640.00000000
pds-30 6.3100 4.9100 1.285 21385445736.00000000 21385445736.00000000
pds-40 8.7100 11.0000 0.792 18855198824.00000000 18855198824.00000000
pds-50 15.2300 19.5700 0.778 16603525724.00000000 16603525724.00000000
pds-60 17.2900 24.2000 0.714 14265904407.00000000 14265904407.00000000
rail507 4.1600 4.4000 0.945 172.14556668 172.14556668
rail516 1.4100 1.2300 1.146 182.00000000 182.00000000
rail582 1.9400 3.2500 0.597 209.71223296 209.71223296
rat7a 5.1700 7.7400 0.668 2074371.41572829 2074371.41572827
rlfddd 0.2100 0.4100 0.512 -13.00000000 -13.00000000
rlfdual 3.7400 2.0300 1.842 -1.00000000 -1.00000000
rlfprim 0.5200 0.6400 0.813 1.00000000 1.00000000
route 0.1900 0.3000 0.633 5941.65027667 5941.65027667
scsd8-2r-432 0.3500 0.3500 1.000 25.79996959 25.79999441
t0331-4l 9.6000 10.8200 0.887 29730.03335194 29730.03335194
us04 0.2400 0.3400 0.706 17731.66666667 17731.66666667
watson_1 10.5200 20.5900 0.511 -1609.28079574 -1609.27898533
dbic1 39.1600 51.6900 0.758 -9768973.00000000 -9768973.00000000
dbir1 0.5800 1.7900 0.324 -8106707.00000000 -8106707.00000000
dbir2 0.9500 2.4500 0.388 -6116916.50000000 -6116916.50000000
nemsemm1 0.7300 1.5600 0.468 512959.60078798 512959.60078797
nw14 0.6600 1.0500 0.629 61844.00000000 61844.00000000
osa-60 1.9500 3.3000 0.591 4044072.50315743 4044072.50315744
pds-100 41.8700 41.0000 1.021 10928229968.00000000 10928229968.00000000
pds-70 26.1600 26.9600 0.970 12241162812.00000000 12241162812.00000000
pds-80 38.3000 33.7200 1.136 11469077462.00000000 11469077462.00000000
pds-90 39.0900 41.5200 0.941 11087561635.00000000 11087561635.00000000
rail2586 882.0100 1327.3800 0.664 935.92182057 935.92182057
self 17.7300 4.5200 3.923 0.00000000 0.00000000

### CPLEX: optimal -- GUROBI: fail

Modelname Time (CPLEX) Time (GUROBI) Ratio (CPLEX/GUROBI) Obj (CPLEX) Status (GUROBI)
rail4284 1875.6000 3595.3800 --- 1054.05449127 mstat(14)sstat( 3)

### CPLEX: infeasible -- GUROBI: infeasible

Modelname Time (CPLEX) Time (GUROBI) Ratio (CPLEX/GUROBI) Status (CPLEX) Status (GUROBI)
bgindy 0.0700 0.0100 --- mstat( 4)sstat( 1) mstat(19)sstat( 1)
lpl1 51.0800 0.0700 --- mstat( 4)sstat( 1) mstat(19)sstat( 1)

### CPLEX: infeasible -- GUROBI: fail

Modelname Time (CPLEX) Time (GUROBI) Ratio (CPLEX/GUROBI) Status (CPLEX) Status (GUROBI)
gosh 0.8800 0.0300 --- mstat( 4)sstat( 1) mstat(14)sstat( 1)

### CPLEX: fail -- GUROBI: fail

Modelname Time (CPLEX) Time (GUROBI) Ratio (CPLEX/GUROBI) Status (CPLEX) Status (GUROBI)
nug20 3599.0000 3596.6500 --- mstat( 6)sstat( 3) mstat(14)sstat( 3)
sgpf5y6 3600.5800 0.1400 --- mstat( 6)sstat( 3) mstat(14)sstat( 1)
nug30 3654.5100 3605.1600 --- mstat( 6)sstat( 3) mstat(14)sstat( 3)

### CPLEX: optimal:

Modelname Time (CPLEX) Obj (CPLEX)
aa01 1.1700 55535.43638822
aa03 0.5900 49616.36363636
air02 0.0300 7640.00000000
air06 0.5900 49616.36363636
baxter 0.6300 56007255.67225310
car4 0.2800 35.46037017
cari 0.0400 581.89305779
co5 1.2000 714469.55375105
co9 5.3000 946920.43028456
cq5 0.7700 400133.80747262
cq9 3.2600 505541.70980727
crew1 0.1500 20.55555556
ex3sta1 13.9700 -63.07540325
fit2d 0.2200 -68464.29329383
fit2p 1.6700 68464.29329383
fome11 0.0900 0.00000000
fome12 0.2000 0.00000000
gen1 0.0900 0.00000006
gen2 7.2200 3.29279078
gen4 0.5900 0.00000000
jendrec1 0.7600 7028.46051135
ken-11 0.1900 -6972382262.51997100
ken-13 0.6000 -1.0257394789482E+10
l30 8.8500 0.95266134
lp22 12.9300 458.94459411
lpl3 0.7000 27318.00000000
maros-r7 1.0300 1497185.16647964
mod2 2.4300 27737371.36444530
model10 6.2200 -154599.62130064
model11 0.3000 0.00000000
model5 1.2500 -858440.72907343
model7 1.7700 49380.08549287
model9 0.6000 -141123.09361299
nemspmm1 1.7900 -327415.83567076
nemspmm2 1.8200 -291794.83608908
nemswrld 22.2000 260.30896600
nsir1 0.0700 -28909033.00000000
nsir2 0.1800 -27175593.50000000
nug15 1003.0500 1040.99404096
osa-07 0.1300 535722.51729935
p010 0.4000 1115047.91511081
p05 0.1600 556000.27662588
pcb3000 0.4100 137416.41961282
pds-06 0.2000 27761037600.00000000
pds-10 0.4500 26727094976.00000000
pilot87 6.7600 301.71035696
qap15 1086.8500 1040.99404096
r05 0.1800 557831.85904066
rat1 0.2000 1999531.66287928
rat5 0.6800 3083707.01043842
rosen10 0.2300 -174215.45613870
scfxm1-2b-64 1.4800 2877.56386371
scfxm1-2r-64 0.5100 2877.56386371
scfxm1-2r-96 0.9200 2891.70611371
scrs8-2r-512 0.0900 1074.09934157
scsd8-2b-64 0.1700 15.99866803
scsd8-2c-64 0.1800 14.99923200
scsd8-2r-108 0.0600 23.69999434
scsd8-2r-216 0.1500 23.39998395
sctap1-2b-64 0.1900 484.56000000
slptsk 0.5600 29.89536602
south31 13.9900 1818940197.10106000
stocfor3 0.6600 -39976.78394365
testbig 0.1500 -60.42296073
ulevimin 9.2400 -5191101861.43197000
wood1p 0.0200 1.44290241
world 2.1500 40364873.11411920
bas1lp 4.4000 363.00000000
cre-b 1.4200 23129639.88683240
cre-d 0.6400 24454969.76454920
fome13 0.4400 0.00000000
fome20 2.6400 23821658640.00000000
fome21 5.3000 47346318912.00000000
ken-18 4.0900 -5.2217025287397E+10
kl02 0.1900 215.25000000
nemsemm2 0.3000 581079.57090468
nsct1 0.3200 -38922436.00000000
nsct2 0.6300 -37175082.00000000
osa-14 0.2800 1106462.84473626
osa-30 0.6900 2142139.87320976
pds-20 2.6100 23821658640.00000000
pds-30 6.3100 21385445736.00000000
pds-40 8.7100 18855198824.00000000
pds-50 15.2300 16603525724.00000000
pds-60 17.2900 14265904407.00000000
rail507 4.1600 172.14556668
rail516 1.4100 182.00000000
rail582 1.9400 209.71223296
rat7a 5.1700 2074371.41572829
rlfddd 0.2100 -13.00000000
rlfdual 3.7400 -1.00000000
rlfprim 0.5200 1.00000000
route 0.1900 5941.65027667
scsd8-2r-432 0.3500 25.79996959
t0331-4l 9.6000 29730.03335194
us04 0.2400 17731.66666667
watson_1 10.5200 -1609.28079574
dbic1 39.1600 -9768973.00000000
dbir1 0.5800 -8106707.00000000
dbir2 0.9500 -6116916.50000000
nemsemm1 0.7300 512959.60078798
nw14 0.6600 61844.00000000
osa-60 1.9500 4044072.50315743
pds-100 41.8700 10928229968.00000000
pds-70 26.1600 12241162812.00000000
pds-80 38.3000 11469077462.00000000
pds-90 39.0900 11087561635.00000000
rail2586 882.0100 935.92182057
rail4284 1875.6000 1054.05449127
self 17.7300 0.00000000

### CPLEX: infeasible:

Modelname Time (CPLEX) Status (CPLEX)
bgindy -- mstat( 4) sstat( 1)
gosh -- mstat( 4) sstat( 1)
lpl1 -- mstat( 4) sstat( 1)

### CPLEX: fail:

Modelname Time (CPLEX) Status (CPLEX)
nug20 -- mstat( 6) sstat( 3)
sgpf5y6 -- mstat( 6) sstat( 3)
nug30 -- mstat( 6) sstat( 3)

### GUROBI: optimal:

Modelname Time (GUROBI) Obj (GUROBI)
aa01 1.0200 55535.43638822
aa03 0.5100 49616.36363636
air02 0.0300 7640.00000000
air06 0.5200 49616.36363636
baxter 0.8300 56007255.67225310
car4 0.4200 35.46037017
cari 0.1100 581.89305779
co5 1.1300 714469.55378561
co9 4.7100 946920.43030330
cq5 0.7000 400133.80747262
cq9 3.0500 505541.70980727
crew1 0.1000 20.55555556
ex3sta1 22.0300 -63.07540325
fit2d 0.1400 -68464.29329383
fit2p 2.3600 68464.29329383
fome11 0.3100 0.00000000
fome12 35.0000 0.00000000
gen1 0.1400 0.00000000
gen2 14.4600 3.29279078
gen4 0.8800 0.00000000
jendrec1 1.0400 7028.46051135
ken-11 0.1500 -6972382262.51999000
ken-13 0.5700 -1.0257394789483E+10
l30 7.4600 0.95266021
lp22 17.2200 458.94459411
lpl3 1.0100 27318.00000000
maros-r7 1.3300 1497185.16647964
mod2 2.2700 27737371.36444490
model10 5.7200 -154599.62125060
model11 0.2200 0.00000000
model5 0.8600 -858440.72907197
model7 0.9700 49380.08551681
model9 0.4400 -141123.09360669
nemspmm1 1.3400 -327415.83567076
nemspmm2 1.5700 -291794.83608908
nemswrld 21.2800 260.30896600
nsir1 0.0800 -28909033.00000000
nsir2 0.1700 -27175593.50000000
nug15 673.9000 1040.99404096
osa-07 0.1100 535722.51729935
p010 0.3900 1115047.91511082
p05 0.1600 556000.27662588
pcb3000 0.3700 137416.41961282
pds-06 0.2200 27761037600.00000000
pds-10 0.5300 26727094976.00000000
pilot87 9.5700 301.71204967
qap15 928.0500 1040.99404096
r05 0.1800 557831.85904066
rat1 0.2400 1999531.66287928
rat5 0.6600 3083707.01043843
rosen10 0.0900 -174215.45613870
scfxm1-2b-64 3.4700 2877.56386371
scfxm1-2r-64 0.7400 2877.56386371
scfxm1-2r-96 1.9000 2891.70611371
scrs8-2r-512 0.0400 1074.09934157
scsd8-2b-64 0.2000 15.99866803
scsd8-2c-64 0.2000 14.99923200
scsd8-2r-108 0.0500 23.70000024
scsd8-2r-216 0.1200 23.39999200
sctap1-2b-64 0.1900 484.56000000
slptsk 0.5300 29.89536602
south31 16.0800 1818940197.10106000
stocfor3 0.5600 -39976.78394365
testbig 0.0700 -60.42296073
ulevimin 8.4200 -5191101861.43198000
wood1p 0.0300 1.44290241
world 2.1600 40364873.11417650
bas1lp 0.7200 363.00000000
cre-b 1.4500 23129639.88683240
cre-d 0.7600 24454969.76454920
fome13 9.9000 0.00000000
fome20 2.9700 23821658640.00000000
fome21 5.9900 47346318912.00000000
ken-18 3.4800 -5.2217025287397E+10
kl02 0.2600 215.25000000
nemsemm2 0.3200 581079.57090469
nsct1 0.7500 -38922436.00000000
nsct2 1.0000 -37175082.00000000
osa-14 0.3800 1106462.84473625
osa-30 0.9800 2142139.87320977
pds-20 2.9900 23821658640.00000000
pds-30 4.9100 21385445736.00000000
pds-40 11.0000 18855198824.00000000
pds-50 19.5700 16603525724.00000000
pds-60 24.2000 14265904407.00000000
rail507 4.4000 172.14556668
rail516 1.2300 182.00000000
rail582 3.2500 209.71223296
rat7a 7.7400 2074371.41572827
rlfddd 0.4100 -13.00000000
rlfdual 2.0300 -1.00000000
rlfprim 0.6400 1.00000000
route 0.3000 5941.65027667
scsd8-2r-432 0.3500 25.79999441
t0331-4l 10.8200 29730.03335194
us04 0.3400 17731.66666667
watson_1 20.5900 -1609.27898533
dbic1 51.6900 -9768973.00000000
dbir1 1.7900 -8106707.00000000
dbir2 2.4500 -6116916.50000000
nemsemm1 1.5600 512959.60078797
nw14 1.0500 61844.00000000
osa-60 3.3000 4044072.50315744
pds-100 41.0000 10928229968.00000000
pds-70 26.9600 12241162812.00000000
pds-80 33.7200 11469077462.00000000
pds-90 41.5200 11087561635.00000000
rail2586 1327.3800 935.92182057
self 4.5200 0.00000000

### GUROBI: infeasible:

Modelname Time (GUROBI) Status (GUROBI)
bgindy -- mstat(19)sstat( 1)
lpl1 -- mstat(19)sstat( 1)

### GUROBI: fail:

Modelname Time (GUROBI) Status (GUROBI)
gosh -- mstat(14)sstat( 1)
nug20 -- mstat(14)sstat( 3)
sgpf5y6 -- mstat(14)sstat( 1)
nug30 -- mstat(14)sstat( 3)
rail4284 -- mstat(14)sstat( 3)