Benchmark Resource Time Table

Resource Timings:

Results created on 01/18/09 17:30:50 using the PAVER Server/Performance tools available at http://www.gamsworld.eu/performance/paver

Input File Number	Filename
Tracefile 1 :	CPLEX-1.trc
Tracefile 2:	SCIP-1.trc
Tracefile 3:	CBC-1.trc
Modeltype(s)	`MIP`
Solvers used :	`CPLEX` `SCIP` `Cbc`

Results available as text file:

mipall/timings.txt

Top

Resource Time Results:

Instances solved to optimality are highlighted with a green background.
ETSolver times below resource time or above 11 seconds and exceeding the resource time by at least 10% are highlighted with red background.

The average time is calculated as a shifted geometric mean.

The limit in the solver time columns is 3600.00 seconds and the shift is 10.00 seconds.
The limit in the ETSolver columns is 3600.00 and the shift is 10.00.

In the "Shifted Geometric Mean (feasible)" row, instances without feasible solution and instances above the limit are counted with the limit value (3600.00 and 3600.00, resp.).
In the "Shifted Geometric Mean (optimal)" row, instances not solved to optimality and instances above the limit are counted with the limit value (3600.00 and 3600.00, resp.).

Modelname	CPLEX (sec)	CPLEX (ETSolver)	SCIP (sec)	SCIP (ETSolver)	Cbc (sec)	Cbc (ETSolver)
`10teams`	`5.30`	`5.60`	`33.67`	`34.56`	`11.10`	`11.47`
`acc-tight-0`	`0.63`	`0.71`	`2.81`	`2.98`	`28.08`	`28.49`
`acc-tight-1`	`2.60`	`2.67`	`123.12`	`123.77`	`75.72`	`76.00`
`acc-tight-2`	`57.69`	`57.77`	`625.85`	`629.03`	`3223.11`	`3237.81`
`acc-tight-3`	`1711.97`	`1712.89`	`107.64`	`108.45`	`1116.97`	`1119.12`
`acc-tight-4`	`1.58`	`1.63`	`94.74`	`95.39`	`3.05`	`3.20`
`acc-tight-5`	`38.89`	`38.99`	`350.41`	`352.96`	`220.97`	`221.77`
`acc-tight-6`	`48.12`	`48.26`	`1237.58`	`1245.00`	`3601.62 (fail)`	`3607.13`
`air03`	`0.46`	`0.54`	`35.99`	`36.70`	`3.03`	`3.53`
`air04`	`15.79`	`15.94`	`179.08`	`180.15`	`121.88`	`122.71`
`air05`	`9.65`	`9.78`	`81.04`	`81.87`	`59.68`	`60.14`
`arki001`	`3795.25`	`3805.60`	`3600.02`	`3630.42`	`3602.53`	`3647.77`
`bal8x12`	`0.10`	`0.13`	`0.37`	`0.44`	`0.49`	`0.55`
`bc1`	`130.97`	`136.67`	`360.75`	`377.71`	`1723.72`	`2042.71`
`bc`	`3758.25`	`3822.23`	`3600.20`	`3747.87`	`3179.13`	`3827.59`
`bell3a`	`2.03`	`2.17`	`19.71`	`20.75`	`2.99`	`3.08`
`bell5`	`0.19`	`0.21`	`0.88`	`0.97`	`2.94`	`3.04`
`bienst1`	`36.93`	`37.07`	`49.41`	`50.26`	`187.21`	`190.32`
`bienst2`	`176.36`	`176.87`	`496.05`	`501.32`	`1129.51`	`1155.77`
`binkar10_1`	`19.75`	`19.85`	`1500.09`	`1511.46`	`933.97`	`956.93`
`bk4x3`	`0.01`	`0.03`	`0.01`	`0.07`	`0.02`	`0.07`
`blend2`	`1.29`	`1.37`	`0.54`	`0.60`	`7.00`	`7.07`
`cap6000`	`1.02`	`1.11`	`6.56`	`7.02`	`60.22`	`60.92`
`dano3_3`	`74.34`	`74.52`	`478.70`	`527.57`	`183.59`	`185.07`
`dano3_4`	`96.19`	`96.40`	`708.09`	`755.17`	`238.55`	`240.49`
`dano3_5`	`256.53`	`256.93`	`1906.27`	`1962.74`	`489.29`	`491.16`
`dano3mip`	`3827.76`	`3832.60`	`3600.12`	`3657.94`	`3638.81`	`3664.78`
`danoint`	`3838.89`	`3841.34`	`3600.01`	`3623.20`	`3602.36`	`3658.16`
`dcmulti`	`0.50`	`0.53`	`2.89`	`2.99`	`3.89`	`4.02`
`dsbmip`	`0.74`	`0.79`	`0.34`	`0.87`	`8.28`	`8.50`
`egout`	`0.00`	`0.03`	`0.02`	`0.07`	`0.04`	`0.07`
`enigma`	`0.01`	`0.03`	`0.58`	`0.66`	`1.66`	`1.82`
`fast0507`	`1899.79`	`1919.11`	`3600.66`	`3656.66`	`3604.52`	`3640.05`
`fiber`	`0.36`	`0.39`	`1.22`	`1.35`	`4.76`	`4.89`
`fixnet6`	`1.24`	`1.34`	`5.26`	`5.38`	`6.49`	`6.65`
`gen`	`0.06`	`0.08`	`0.16`	`0.28`	`0.18`	`0.29`
`gesa2`	`0.46`	`0.53`	`1.80`	`1.93`	`8.66`	`8.78`
`gesa2_o`	`0.38`	`0.46`	`1.78`	`1.90`	`37.91`	`38.04`
`gesa3`	`0.59`	`0.64`	`2.45`	`2.58`	`16.34`	`16.51`
`gesa3_o`	`0.41`	`0.44`	`2.52`	`2.63`	`11.49`	`11.66`
`gr4x6`	`0.01`	`0.03`	`0.02`	`0.08`	`0.02`	`0.08`
`gt2`	`0.03`	`0.06`	`0.14`	`0.17`	`0.13`	`0.18`
`harp2`	`205.58`	`208.16`	`3600.01`	`3658.02`	`699.05`	`704.59`
`irp`	`5.82`	`6.20`	`63.96`	`65.03`	`40.94`	`41.74`
`khb05250`	`0.16`	`0.19`	`0.81`	`0.94`	`0.67`	`0.77`
`l152lav`	`0.90`	`0.95`	`7.86`	`8.04`	`5.84`	`5.94`
`lseu`	`0.10`	`0.12`	`0.32`	`0.41`	`0.82`	`0.93`
`markshare1`	`3688.07`	`3858.64`	`3600.00`	`3825.67`	`3530.35`	`3853.81`
`markshare2`	`3693.32`	`3841.67`	`3600.00`	`3805.67`	`3549.00`	`3841.02`
`mas284`	`5.66`	`5.81`	`48.11`	`48.65`	`34.51`	`35.05`
`mas74`	`370.43`	`385.37`	`2354.57`	`2420.47`	`2375.27`	`2513.74`
`mas76`	`59.60`	`61.62`	`163.97`	`168.90`	`214.14`	`230.26`
`misc03`	`1.07`	`1.11`	`2.27`	`2.38`	`3.36`	`3.46`
`misc06`	`0.09`	`0.12`	`0.59`	`0.74`	`1.12`	`1.21`
`misc07`	`42.25`	`42.57`	`53.33`	`54.51`	`80.18`	`80.56`
`mitre`	`0.52`	`0.58`	`19.86`	`20.81`	`4.34`	`4.76`
`mkc1`	`32.85`	`33.60`	`3600.02`	`3636.69`	`3600.60`	`3697.10`
`mkc`	`3800.09`	`3849.32`	`3600.07`	`3627.66`	`3601.14`	`3674.46`
`mod008`	`0.08`	`0.12`	`0.62`	`0.73`	`0.70`	`0.79`
`mod010`	`0.34`	`0.38`	`2.10`	`2.28`	`0.68`	`0.79`
`mod011`	`107.98`	`108.16`	`432.83`	`435.98`	`158.62`	`159.12`
`modglob`	`0.18`	`0.22`	`0.66`	`0.81`	`17.41`	`17.58`
`n3700`	`3832.83`	`3851.96`	`3600.12`	`3613.71`	`3602.24`	`3691.01`
`n3701`	`3821.51`	`3841.22`	`3600.12`	`3630.80`	`3602.80`	`3718.67`
`n3702`	`3820.47`	`3841.22`	`3600.12`	`3616.23`	`3602.50`	`3691.40`
`n3703`	`3822.03`	`3841.28`	`3600.12`	`3612.47`	`3604.79`	`3690.75`
`n3704`	`3821.48`	`3841.23`	`3600.13`	`3615.83`	`3602.48`	`3702.19`
`n3705`	`3821.93`	`3841.33`	`3600.12`	`3615.05`	`3602.22`	`3701.26`
`n3706`	`3823.56`	`3841.26`	`3600.12`	`3611.23`	`3602.59`	`3707.76`
`n3707`	`3824.67`	`3841.25`	`3600.06`	`3612.50`	`3602.71`	`3715.81`
`n3708`	`3823.71`	`3841.24`	`3600.13`	`3613.94`	`3602.40`	`3693.54`
`n3709`	`3823.79`	`3841.24`	`3600.14`	`3613.67`	`3603.62`	`3724.18`
`n370a`	`3824.84`	`3841.34`	`3600.14`	`3614.12`	`3603.87`	`3718.13`
`n370b`	`3822.72`	`3841.27`	`3600.13`	`3612.51`	`3603.16`	`3692.53`
`n370c`	`3820.29`	`3841.23`	`3600.12`	`3613.86`	`3603.60`	`3731.29`
`n370d`	`3819.25`	`3841.24`	`3600.14`	`3613.88`	`3603.23`	`3728.11`
`n370e`	`3822.47`	`3841.18`	`3600.13`	`3618.74`	`3602.55`	`3688.47`
`neos1`	`0.71`	`0.76`	`22.68`	`23.25`	`52.97`	`53.38`
`neos2`	`11.76`	`12.01`	`204.25`	`206.63`	`9.87`	`10.10`
`neos3`	`90.86`	`91.70`	`3600.01`	`3646.68`	`26.45`	`26.82`
`neos4`	`3.10`	`3.31`	`3.19`	`5.50`	`33.68`	`34.94`
`neos5`	`3.10`	`4.45`	`3.16`	`4.81`	`18.93`	`20.27`
`neos6`	`65.77`	`67.01`	`3600.13`	`3618.32`	`1042.00`	`1127.55`
`noswot`	`3752.05`	`3838.34`	`273.40`	`285.97`	`3608.32`	`3692.53`
`nw04`	`32.50`	`33.55`	`66.76`	`71.08`	`31.57`	`36.12`
`p0033`	`0.02`	`0.06`	`0.08`	`0.20`	`0.04`	`0.12`
`p0201`	`0.36`	`0.40`	`1.95`	`2.02`	`5.82`	`5.88`
`p0282`	`0.14`	`0.16`	`0.75`	`0.84`	`6.15`	`6.26`
`p0548`	`0.05`	`0.08`	`0.40`	`0.49`	`2.65`	`2.70`
`p2756`	`0.34`	`0.37`	`2.93`	`3.12`	`9.22`	`9.36`
`pk1`	`129.94`	`132.23`	`215.42`	`219.90`	`205.66`	`216.03`
`pp08acuts`	`1.96`	`1.99`	`3.12`	`3.27`	`16.46`	`16.68`
`pp08a`	`1.05`	`1.09`	`2.80`	`2.93`	`23.94`	`24.07`
`prod1`	`15.74`	`16.02`	`43.87`	`44.42`	`136.00`	`138.48`
`qiu`	`48.55`	`48.64`	`217.74`	`219.84`	`649.22`	`659.71`
`qnet1`	`1.71`	`1.80`	`8.30`	`8.47`	`4.84`	`4.94`
`qnet1_o`	`1.10`	`1.15`	`4.26`	`4.36`	`4.87`	`5.10`
`ran10x10a`	`0.18`	`0.20`	`1.02`	`1.09`	`1.78`	`1.82`
`ran10x10b`	`0.12`	`0.16`	`0.62`	`0.66`	`1.54`	`1.59`
`ran10x10c`	`1.69`	`1.76`	`4.03`	`4.18`	`4.49`	`4.54`
`ran10x12`	`0.34`	`0.36`	`0.80`	`0.87`	`1.65`	`1.70`
`ran10x26`	`12.14`	`12.25`	`123.00`	`124.85`	`43.13`	`43.97`
`ran12x12`	`9.56`	`9.73`	`43.36`	`43.93`	`50.06`	`50.55`
`ran12x21`	`62.88`	`63.21`	`263.49`	`266.40`	`230.61`	`236.48`
`ran13x13`	`24.01`	`24.25`	`101.94`	`103.35`	`85.13`	`86.63`
`ran14x18`	`2565.42`	`2572.23`	`3600.00`	`3639.64`	`3603.68`	`3698.29`
`ran16x16`	`162.77`	`163.41`	`1135.30`	`1146.50`	`1415.54`	`1452.79`
`ran17x17`	`5.03`	`5.12`	`36.61`	`36.95`	`14.01`	`14.15`
`ran4x64`	`0.18`	`0.21`	`1.28`	`1.35`	`1.95`	`2.00`
`ran6x43`	`0.32`	`0.36`	`3.01`	`3.10`	`2.62`	`2.67`
`ran8x32`	`3.55`	`3.62`	`41.18`	`41.55`	`28.15`	`28.48`
`rentacar`	`0.47`	`0.53`	`4.72`	`6.00`	`6.13`	`6.58`
`rgn`	`0.20`	`0.24`	`1.36`	`1.46`	`2.50`	`2.54`
`rlp2`	`0.04`	`0.06`	`4.51`	`4.67`	`1.95`	`2.04`
`rout`	`14.78`	`14.91`	`73.08`	`74.11`	`1173.71`	`1201.96`
`set1ch`	`0.34`	`0.38`	`0.88`	`1.04`	`1102.82`	`1131.02`
`seymour1`	`214.90`	`215.19`	`1493.82`	`1510.71`	`1871.66`	`1876.01`
`seymour`	`3799.88`	`3811.21`	`3600.03`	`3646.30`	`3602.56`	`3642.65`
`stein27`	`0.29`	`0.31`	`1.96`	`2.11`	`2.31`	`2.40`
`stein45`	`13.15`	`13.45`	`49.89`	`51.03`	`61.33`	`62.53`
`swath1`	`12.71`	`13.07`	`109.63`	`111.19`	`187.74`	`190.65`
`swath2`	`11.33`	`11.65`	`97.65`	`99.39`	`218.10`	`219.01`
`swath`	`3710.21`	`3881.65`	`3600.08`	`3637.40`	`3601.31`	`3615.81`
`vpm1`	`0.07`	`0.27`	`0.28`	`1.61`	`0.10`	`0.18`
`vpm2`	`0.75`	`0.80`	`2.17`	`2.31`	`4.76`	`4.81`
`Shifted Geometric Mean (feasible)`	`53.79`	`54.19`	`109.86`	`111.61`	`121.79`	`123.49`
`% no feasible point`	`0.00%`		`0.00%`		`0.80%`
`Shifted Geometric Mean (optimal)`	`53.79`	`54.19`	`118.58`	`120.43`	`121.95`	`123.49`
`% not optimal`	`20.00%`		`25.60%`		`23.20%`

Top

Model Statistics:

Modelname	Equations	Total Variables	Discrete Variables	Total Nonzeros	Nonlinear Nonzeros
`10teams`	`231`	`2026`	`1800`	`14176`	--
`acc-tight-0`	`1738`	`1621`	`1620`	`7292`	--
`acc-tight-1`	`2521`	`1621`	`1620`	`15329`	--
`acc-tight-2`	`3286`	`1621`	`1620`	`17075`	--
`acc-tight-3`	`3048`	`1336`	`1335`	`16110`	--
`acc-tight-4`	`2287`	`1621`	`1620`	`12980`	--
`acc-tight-5`	`3250`	`1621`	`1620`	`16787`	--
`acc-tight-6`	`3053`	`1340`	`1339`	`16136`	--
`air03`	`125`	`10758`	`10757`	`101786`	--
`air04`	`824`	`8905`	`8904`	`81870`	--
`air05`	`427`	`7196`	`7195`	`59317`	--
`arki001`	`1049`	`1389`	`511`	`20441`	--
`bal8x12`	`117`	`193`	`96`	`577`	--
`bc1`	`1914`	`1752`	`252`	`276844`	--
`bc`	`1914`	`1752`	`483`	`276844`	--
`bell3a`	`124`	`134`	`71`	`442`	--
`bell5`	`92`	`105`	`58`	`341`	--
`bienst1`	`577`	`506`	`28`	`2186`	--
`bienst2`	`577`	`506`	`35`	`2186`	--
`binkar10_1`	`1027`	`2299`	`170`	`6239`	--
`bk4x3`	`20`	`25`	`12`	`73`	--
`blend2`	`275`	`354`	`256`	`1498`	--
`cap6000`	`2177`	`6001`	`6000`	`54239`	--
`dano3_3`	`3203`	`13874`	`69`	`79657`	--
`dano3_4`	`3203`	`13874`	`92`	`79657`	--
`dano3_5`	`3203`	`13874`	`115`	`79657`	--
`dano3mip`	`3203`	`13874`	`552`	`79657`	--
`danoint`	`665`	`522`	`56`	`3234`	--
`dcmulti`	`291`	`549`	`75`	`1834`	--
`dsbmip`	`1183`	`1904`	`160`	`8461`	--
`egout`	`99`	`142`	`55`	`393`	--
`enigma`	`22`	`101`	`100`	`299`	--
`fast0507`	`508`	`63010`	`63009`	`472359`	--
`fiber`	`364`	`1299`	`1254`	`4199`	--
`fixnet6`	`479`	`879`	`378`	`2551`	--
`gen`	`781`	`871`	`150`	`3175`	--
`gesa2`	`1393`	`1225`	`408`	`6001`	--
`gesa2_o`	`1249`	`1225`	`720`	`4609`	--
`gesa3`	`1369`	`1153`	`384`	`5737`	--
`gesa3_o`	`1225`	`1153`	`672`	`4417`	--
`gr4x6`	`35`	`49`	`24`	`145`	--
`gt2`	`30`	`189`	`188`	`469`	--
`harp2`	`113`	`2994`	`2993`	`8834`	--
`irp`	`40`	`20316`	`20315`	`118570`	--
`khb05250`	`102`	`1351`	`24`	`3974`	--
`l152lav`	`98`	`1990`	`1989`	`11912`	--
`lseu`	`29`	`90`	`89`	`395`	--
`markshare1`	`7`	`63`	`50`	`325`	--
`markshare2`	`8`	`75`	`60`	`449`	--
`mas284`	`69`	`152`	`150`	`9783`	--
`mas74`	`14`	`152`	`150`	`1858`	--
`mas76`	`13`	`152`	`150`	`1792`	--
`misc03`	`97`	`161`	`159`	`2055`	--
`misc06`	`821`	`1809`	`112`	`5861`	--
`misc07`	`213`	`261`	`259`	`8621`	--
`mitre`	`2055`	`9959`	`9958`	`46330`	--
`mkc1`	`3412`	`5326`	`3087`	`19985`	--
`mkc`	`3412`	`5326`	`5323`	`19985`	--
`mod008`	`7`	`320`	`319`	`1563`	--
`mod010`	`147`	`2656`	`2655`	`13859`	--
`mod011`	`4481`	`10968`	`96`	`29849`	--
`modglob`	`292`	`423`	`98`	`1391`	--
`n3700`	`5151`	`10001`	`5000`	`30001`	--
`n3701`	`5151`	`10001`	`5000`	`30001`	--
`n3702`	`5151`	`10001`	`5000`	`30001`	--
`n3703`	`5151`	`10001`	`5000`	`30000`	--
`n3704`	`5151`	`10001`	`5000`	`30001`	--
`n3705`	`5151`	`10001`	`5000`	`30001`	--
`n3706`	`5151`	`10001`	`5000`	`30001`	--
`n3707`	`5151`	`10001`	`5000`	`30001`	--
`n3708`	`5151`	`10001`	`5000`	`30001`	--
`n3709`	`5151`	`10001`	`5000`	`30001`	--
`n370a`	`5151`	`10001`	`5000`	`30001`	--
`n370b`	`5151`	`10001`	`5000`	`30001`	--
`n370c`	`5151`	`10001`	`5000`	`30001`	--
`n370d`	`5151`	`10001`	`5000`	`30001`	--
`n370e`	`5151`	`10001`	`5000`	`30001`	--
`neos1`	`5021`	`2113`	`2112`	`21601`	--
`neos2`	`1104`	`2102`	`1040`	`7331`	--
`neos3`	`1443`	`2748`	`1360`	`9586`	--
`neos4`	`38578`	`22885`	`17172`	`116041`	--
`neos5`	`36703`	`21125`	`17136`	`109069`	--
`neos6`	`1037`	`8787`	`8340`	`252170`	--
`noswot`	`183`	`129`	`100`	`761`	--
`nw04`	`37`	`87483`	`87482`	`724149`	--
`p0033`	`16`	`34`	`33`	`132`	--
`p0201`	`134`	`202`	`201`	`2125`	--
`p0282`	`242`	`283`	`282`	`2249`	--
`p0548`	`177`	`549`	`548`	`2128`	--
`p2756`	`756`	`2757`	`2756`	`11104`	--
`pk1`	`46`	`87`	`55`	`917`	--
`pp08acuts`	`247`	`241`	`64`	`1016`	--
`pp08a`	`137`	`241`	`64`	`657`	--
`prod1`	`209`	`251`	`149`	`5352`	--
`qiu`	`1193`	`841`	`48`	`3745`	--
`qnet1`	`504`	`1542`	`1417`	`4747`	--
`qnet1_o`	`457`	`1542`	`1417`	`4339`	--
`ran10x10a`	`121`	`201`	`100`	`601`	--
`ran10x10b`	`121`	`201`	`100`	`601`	--
`ran10x10c`	`121`	`201`	`100`	`601`	--
`ran10x12`	`143`	`241`	`120`	`721`	--
`ran10x26`	`297`	`521`	`260`	`1561`	--
`ran12x12`	`169`	`289`	`144`	`865`	--
`ran12x21`	`286`	`505`	`252`	`1513`	--
`ran13x13`	`196`	`339`	`169`	`1015`	--
`ran14x18`	`285`	`505`	`252`	`1513`	--
`ran16x16`	`289`	`513`	`256`	`1537`	--
`ran17x17`	`324`	`579`	`289`	`1735`	--
`ran4x64`	`325`	`513`	`256`	`1537`	--
`ran6x43`	`308`	`517`	`258`	`1549`	--
`ran8x32`	`297`	`513`	`256`	`1537`	--
`rentacar`	`6785`	`9559`	`55`	`42021`	--
`rgn`	`25`	`181`	`100`	`541`	--
`rlp2`	`69`	`452`	`450`	`5397`	--
`rout`	`292`	`557`	`315`	`2433`	--
`set1ch`	`493`	`713`	`240`	`1885`	--
`seymour1`	`4945`	`1373`	`451`	`34922`	--
`seymour`	`4945`	`1373`	`1372`	`34922`	--
`stein27`	`119`	`28`	`27`	`406`	--
`stein45`	`332`	`46`	`45`	`1080`	--
`swath1`	`885`	`6806`	`2306`	`34967`	--
`swath2`	`885`	`6806`	`2406`	`34967`	--
`swath`	`885`	`6806`	`6724`	`34967`	--
`vpm1`	`235`	`379`	`168`	`918`	--
`vpm2`	`235`	`379`	`168`	`1086`	--

Top