Solver Square Comparison

Solver Square Comparison: Considers all models.

Date / Time: 08/25/08 16:26:12

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC20 is represented on the left (rows) and solver CBC21 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

Tracefile 1 :	`22.7.trc`
Tracefile 2 :	`22.8.trc`
Solvers used :	`CBC20`
	`CBC21`
Modeltype(s)	`MIP`

	CBC21: optimal	CBC21: feasible	CBC21: infeasible	CBC21: unbounded	CBC21: fail	CBC21: no data	total CBC20
CBC20: optimal	`79`	`2`	-	-	-	-	`81`
CBC20: feasible	`6`	`15`	-	-	-	-	`21`
CBC20: infeasible	-	-	-	-	-	-	`-`
CBC20: unbounded	-	-	-	-	-	-	`-`
CBC20: fail	`5`	`1`	-	-	`2`	-	`8`
CBC20: no data	-	-	-	-	-	-	`-`
total CBC21	`90`	`18`	`-`	`-`	`2`	`-`	`110`

Solver return definitions:

Outcome	Model Status	Solver Status
optimal	1 or 15	1
locally optimal	2	any
feasible	8 or 16	1 or 2 or 3 or 4 or 5
infeasible	4 or 5 or 10 or 19	1
unbounded	3 or 18	1
fail	all other	all other

Solver Resource Times

Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

CBC20: optimal -- CBC21: optimal Back to top

Modelname	Time (CBC20)	Time (CBC21)	Ratio (CBC20/CBC21)	Obj (CBC20)	Obj (CBC21)
`10teams`	`35.9300`	`50.7800`	`0.708`	`924.00000000`	`924.00000000`
`acc-tight-0`	`3.8400`	`6.4600`	`0.594`	`0.00000000`	`0.00000000`
`acc-tight-1`	`6.0500`	`9.5200`	`0.636`	`0.00000000`	`0.00000000`
`acc-tight-4`	`8.5600`	`3.8300`	`2.235`	`0.00000000`	`0.00000000`
`air03`	`5.1800`	`1.8800`	`2.755`	`340160.00000000`	`340160.00000000`
`air04`	`298.6500`	`226.1600`	`1.321`	`56137.00000000`	`56137.00000000`
`air05`	`422.5000`	`94.3600`	`4.478`	`26374.00000000`	`26374.00000000`
`bal8x12`	`1.7300`	`0.2600`	`6.654`	`471.55000000`	`471.55000000`
`bell3a`	`3.1600`	`2.6500`	`1.192`	`878430.31600000`	`878430.31600000`
`bell5`	`82.9300`	`2.8600`	`28.997`	`8966406.49152000`	`8966406.49152000`
`bienst1`	`103.6800`	`39.5700`	`2.620`	`46.75000000`	`46.75000000`
`bk4x3`	`0.0100`	`0.0100`	`---`	`350.00000000`	`350.00000000`
`blend2`	`12.4600`	`4.4400`	`2.806`	`7.59898500`	`7.59898500`
`cap6000`	`12.4000`	`259.8800`	`0.048`	`-2451377.00000000`	`-2451377.00000000`
`dcmulti`	`6.7100`	`6.3000`	`1.065`	`188182.00000000`	`188182.00000000`
`dsbmip`	`1.0800`	`1.5400`	`0.701`	`-306.76901203`	`-306.76901203`
`egout`	`0.0300`	`0.0400`	`---`	`568.10070000`	`568.10070000`
`enigma`	`6.1600`	`3.1900`	`1.931`	`0.00000000`	`0.00000000`
`fiber`	`2.0000`	`4.4300`	`0.451`	`405935.18000000`	`405935.18000000`
`fixnet6`	`11.5100`	`8.3700`	`1.375`	`3983.00000000`	`3983.00000000`
`gen`	`0.1900`	`0.2400`	`0.792`	`112313.36271800`	`112313.36271800`
`gesa2`	`11.2300`	`8.0200`	`1.400`	`25779856.37169790`	`25779856.37169790`
`gesa2_o`	`42.3500`	`36.7500`	`1.152`	`25779856.37169790`	`25779856.37169790`
`gesa3`	`11.6000`	`1.5900`	`7.296`	`27991042.64838270`	`27991042.64838270`
`gesa3_o`	`13.1500`	`15.5500`	`0.846`	`27991042.64838270`	`27991042.64838270`
`gr4x6`	`0.0300`	`0.0200`	`---`	`202.35000000`	`202.35000000`
`gt2`	`0.0500`	`1.0200`	`0.049`	`21166.00000000`	`21166.00000000`
`irp`	`244.0700`	`42.9500`	`5.683`	`12159.49283600`	`12159.49283600`
`khb05250`	`0.4600`	`0.6900`	`0.667`	`106940226.00000000`	`106940226.00000000`
`l152lav`	`23.8300`	`11.6000`	`2.054`	`4722.00000000`	`4722.00000000`
`lseu`	`1.7700`	`1.8500`	`0.957`	`1120.00000000`	`1120.00000000`
`mas284`	`31.0800`	`29.2400`	`1.063`	`91405.72368220`	`91405.72368220`
`mas76`	`241.3000`	`184.5200`	`1.308`	`40005.05414200`	`40005.05414200`
`misc03`	`3.3400`	`3.2200`	`1.037`	`3360.00000000`	`3360.00000000`
`misc06`	`1.3400`	`2.0300`	`0.660`	`12850.86073738`	`12850.86073738`
`misc07`	`108.7200`	`96.8000`	`1.123`	`2810.00000000`	`2810.00000000`
`mitre`	`10.1600`	`11.3200`	`0.898`	`115155.00000000`	`115155.00000000`
`mod008`	`1.7800`	`4.5100`	`0.395`	`307.00000000`	`307.00000000`
`mod010`	`1.1200`	`0.8600`	`1.302`	`6548.00000000`	`6548.00000000`
`mod011`	`248.0700`	`169.2100`	`1.466`	`-54558535.01422730`	`-54558535.01422730`
`modglob`	`30.0400`	`12.8600`	`2.336`	`20740508.08630820`	`20740508.08630820`
`neos4`	`42.0800`	`14.5000`	`2.902`	`-4.8603440750589E+10`	`-4.8603440750590E+10`
`neos5`	`33.9300`	`10.9200`	`3.107`	`-4.8603440750589E+10`	`-4.8603440750590E+10`
`neos6`	`441.4500`	`1594.1900`	`0.277`	`83.00000000`	`83.00000000`
`nw04`	`25.0300`	`28.7400`	`0.871`	`16862.00000000`	`16862.00000000`
`p0033`	`0.0600`	`0.0300`	`2.000`	`3089.00000000`	`3089.00000000`
`p0201`	`7.6800`	`8.2300`	`0.933`	`7615.00000000`	`7615.00000000`
`p0282`	`3.1900`	`4.2000`	`0.760`	`258411.00000000`	`258411.00000000`
`p0548`	`0.5800`	`0.3700`	`1.568`	`8691.00000000`	`8691.00000000`
`p2756`	`2.4300`	`7.3600`	`0.330`	`3124.00000000`	`3124.00000000`
`pk1`	`129.1600`	`95.2200`	`1.356`	`11.00000000`	`11.00000000`
`pp08acuts`	`40.0900`	`59.5200`	`0.674`	`7350.00000000`	`7350.00000000`
`pp08a`	`75.2400`	`49.0300`	`1.535`	`7350.00000000`	`7350.00000000`
`prod1`	`134.6000`	`186.3900`	`0.722`	`-56.00000000`	`-56.00000000`
`qiu`	`293.6300`	`318.1900`	`0.923`	`-132.87313695`	`-132.87313695`
`qnet1`	`7.1300`	`6.6800`	`1.067`	`16029.69268100`	`16029.69268100`
`qnet1_o`	`6.2200`	`5.9600`	`1.044`	`16029.69268100`	`16029.69268100`
`ran10x10a`	`3.5300`	`5.2200`	`0.676`	`1499.00000000`	`1499.00000000`
`ran10x10b`	`2.3800`	`2.3700`	`1.004`	`3073.00000000`	`3073.00000000`
`ran10x10c`	`11.3300`	`3.5700`	`3.174`	`13007.00000000`	`13007.00000000`
`ran10x12`	`2.5900`	`3.2300`	`0.802`	`2714.00000000`	`2714.00000000`
`ran10x26`	`112.6900`	`40.2900`	`2.797`	`4270.00000000`	`4270.00000000`
`ran12x12`	`47.1800`	`55.6300`	`0.848`	`2291.00000000`	`2291.00000000`
`ran12x21`	`247.7600`	`275.5300`	`0.899`	`3664.00000000`	`3664.00000000`
`ran13x13`	`169.8700`	`154.5000`	`1.099`	`3252.00000000`	`3252.00000000`
`ran16x16`	`992.1700`	`1599.3000`	`0.620`	`3823.00000000`	`3823.00000000`
`ran17x17`	`26.1100`	`23.2400`	`1.123`	`1373.00000000`	`1373.00000000`
`ran4x64`	`1.9500`	`2.2900`	`0.852`	`9711.00000000`	`9711.00000000`
`ran6x43`	`3.7100`	`3.2800`	`1.131`	`6330.00000000`	`6330.00000000`
`ran8x32`	`43.7500`	`27.6200`	`1.584`	`5247.00000000`	`5247.00000000`
`rentacar`	`6.0900`	`8.0900`	`0.753`	`28882470.94755350`	`28882470.94755350`
`rgn`	`3.5000`	`4.0600`	`0.862`	`82.19999924`	`82.19999924`
`rlp2`	`3.9600`	`4.7000`	`0.843`	`19.00000000`	`19.00000000`
`stein27`	`2.9500`	`2.9400`	`1.003`	`18.00000000`	`18.00000000`
`stein45`	`64.5800`	`63.2600`	`1.021`	`30.00000000`	`30.00000000`
`swath1`	`743.8200`	`369.6800`	`2.012`	`379.07129575`	`379.07129575`
`vpm1`	`0.2000`	`0.1200`	`1.667`	`20.00000000`	`20.00000000`
`vpm2`	`8.6600`	`1.9700`	`4.396`	`13.75000000`	`13.75000000`
`harp2`	`1788.4700`	`181.0900`	`9.876`	`-73889532.00000000`	`-73899069.00000000`

CBC20: optimal -- CBC21: feasible Back to top

Modelname	Time (CBC20)	Time (CBC21)	Ratio (CBC20/CBC21)	Obj (CBC20)	Obj (CBC21)
`bienst2`	`762.9600`	`1800.7900`	`0.424`	`54.60000000`	`54.60000000`
`neos1`	`970.2200`	`1801.4600`	`0.539`	`19.00000000`	`19.00000000`

CBC20: feasible -- CBC21: optimal Back to top

Modelname	Time (CBC20)	Time (CBC21)	Ratio (CBC20/CBC21)	Obj (CBC20)	Obj (CBC21)
`binkar10_1`	`1801.6600`	`1571.8700`	`1.146`	`6746.64002300`	`6742.20002400`
`neos2`	`1800.5500`	`477.7900`	`3.768`	`468.53452713`	`454.86970173`
`rout`	`1802.4900`	`178.5100`	`10.097`	`1077.56000000`	`1077.56000000`
`seymour1`	`1825.8300`	`1498.0300`	`1.219`	`411.08574808`	`410.76370139`
`swath2`	`1801.1400`	`871.4900`	`2.067`	`387.63980365`	`385.19969295`
`bc1`	`1803.2900`	`1299.5800`	`1.388`	`3.33836255`	`3.33836255`

CBC20: feasible -- CBC21: feasible Back to top

Modelname	Time (CBC20)	Time (CBC21)	Ratio (CBC20/CBC21)	Obj (CBC20)	Obj (CBC21)
`arki001`	`1801.4900`	`1803.4400`	`0.999`	`7582515.66574672`	`7581399.75958207`
`danoint`	`1800.9200`	`1801.4700`	`1.000`	`66.37500000`	`65.66666667`
`fast0507`	`1806.2800`	`1803.5600`	`1.002`	`179.00000000`	`179.00000000`
`mkc1`	`1800.4400`	`1801.1800`	`1.000`	`-607.20700000`	`-607.20700000`
`mkc`	`1802.2200`	`1801.4000`	`1.000`	`-534.34200000`	`-548.01200000`
`neos3`	`1800.7300`	`1801.6000`	`1.000`	`387.48814776`	`549.52300713`
`noswot`	`1758.7600`	`1806.0200`	`0.974`	`-41.00000000`	`-41.00000000`
`ran14x18`	`1802.8000`	`1803.4000`	`1.000`	`3735.00000000`	`3736.00000000`
`set1ch`	`1802.4400`	`1802.7900`	`1.000`	`54555.00000000`	`54537.75000000`
`seymour`	`1802.5000`	`1802.3400`	`1.000`	`435.00000000`	`431.00000000`
`swath`	`1802.1400`	`1802.0100`	`1.000`	`517.86689600`	`501.95221100`
`markshare1`	`1804.5300`	`1803.0900`	`1.001`	`11.00000000`	`10.00000000`
`markshare2`	`1803.2400`	`1802.5800`	`1.000`	`14.00000000`	`15.00000000`
`mas74`	`1803.5200`	`1802.9400`	`1.000`	`11801.18572900`	`11801.18572900`
`bc`	`1801.8500`	`1803.1200`	`0.999`	`7.00000000`	`7.00000000`

CBC20: fail -- CBC21: optimal Back to top

Modelname	Time (CBC20)	Time (CBC21)	Ratio (CBC20/CBC21)	Status (CBC20)	Obj (CBC21)
`acc-tight-2`	`NA`	`1402.1500`	---	`mstat(13) sstat(13)`	`0.00000000`
`acc-tight-5`	`NA`	`367.3000`	---	`mstat(13) sstat(13)`	`0.00000000`
`dano3_3`	`NA`	`209.1500`	---	`mstat(13) sstat(13)`	`576.34463303`
`dano3_4`	`NA`	`265.1000`	---	`mstat(13) sstat(13)`	`576.43522471`
`dano3_5`	`NA`	`658.1500`	---	`mstat(13) sstat(13)`	`576.92491596`

CBC20: fail -- CBC21: feasible Back to top

Modelname	Time (CBC20)	Time (CBC21)	Ratio (CBC20/CBC21)	Status (CBC20)	Obj (CBC21)
`dano3mip`	`NA`	`1887.0600`	---	`mstat(13) sstat(13)`	`756.62500000`

CBC20: fail -- CBC21: fail Back to top

Modelname	Time (CBC20)	Time (CBC21)	Ratio (CBC20/CBC21)	Status (CBC20)	Status (CBC21)
`acc-tight-3`	`NA`	`1801.5100`	---	`mstat(13) sstat(13)`	`mstat(14) sstat( 3)`
`acc-tight-6`	`NA`	`1801.3600`	---	`mstat(13) sstat(13)`	`mstat(14) sstat( 3)`

CBC20: optimal: Back to top

Modelname	Time (CBC20)	Obj (CBC20)
`10teams`	`35.9300`	`924.00000000`
`acc-tight-0`	`3.8400`	`0.00000000`
`acc-tight-1`	`6.0500`	`0.00000000`
`acc-tight-4`	`8.5600`	`0.00000000`
`air03`	`5.1800`	`340160.00000000`
`air04`	`298.6500`	`56137.00000000`
`air05`	`422.5000`	`26374.00000000`
`bal8x12`	`1.7300`	`471.55000000`
`bell3a`	`3.1600`	`878430.31600000`
`bell5`	`82.9300`	`8966406.49152000`
`bienst1`	`103.6800`	`46.75000000`
`bienst2`	`762.9600`	`54.60000000`
`bk4x3`	`0.0100`	`350.00000000`
`blend2`	`12.4600`	`7.59898500`
`cap6000`	`12.4000`	`-2451377.00000000`
`dcmulti`	`6.7100`	`188182.00000000`
`dsbmip`	`1.0800`	`-306.76901203`
`egout`	`0.0300`	`568.10070000`
`enigma`	`6.1600`	`0.00000000`
`fiber`	`2.0000`	`405935.18000000`
`fixnet6`	`11.5100`	`3983.00000000`
`gen`	`0.1900`	`112313.36271800`
`gesa2`	`11.2300`	`25779856.37169790`
`gesa2_o`	`42.3500`	`25779856.37169790`
`gesa3`	`11.6000`	`27991042.64838270`
`gesa3_o`	`13.1500`	`27991042.64838270`
`gr4x6`	`0.0300`	`202.35000000`
`gt2`	`0.0500`	`21166.00000000`
`irp`	`244.0700`	`12159.49283600`
`khb05250`	`0.4600`	`106940226.00000000`
`l152lav`	`23.8300`	`4722.00000000`
`lseu`	`1.7700`	`1120.00000000`
`mas284`	`31.0800`	`91405.72368220`
`mas76`	`241.3000`	`40005.05414200`
`misc03`	`3.3400`	`3360.00000000`
`misc06`	`1.3400`	`12850.86073738`
`misc07`	`108.7200`	`2810.00000000`
`mitre`	`10.1600`	`115155.00000000`
`mod008`	`1.7800`	`307.00000000`
`mod010`	`1.1200`	`6548.00000000`
`mod011`	`248.0700`	`-54558535.01422730`
`modglob`	`30.0400`	`20740508.08630820`
`neos1`	`970.2200`	`19.00000000`
`neos4`	`42.0800`	`-4.8603440750589E+10`
`neos5`	`33.9300`	`-4.8603440750589E+10`
`neos6`	`441.4500`	`83.00000000`
`nw04`	`25.0300`	`16862.00000000`
`p0033`	`0.0600`	`3089.00000000`
`p0201`	`7.6800`	`7615.00000000`
`p0282`	`3.1900`	`258411.00000000`
`p0548`	`0.5800`	`8691.00000000`
`p2756`	`2.4300`	`3124.00000000`
`pk1`	`129.1600`	`11.00000000`
`pp08acuts`	`40.0900`	`7350.00000000`
`pp08a`	`75.2400`	`7350.00000000`
`prod1`	`134.6000`	`-56.00000000`
`qiu`	`293.6300`	`-132.87313695`
`qnet1`	`7.1300`	`16029.69268100`
`qnet1_o`	`6.2200`	`16029.69268100`
`ran10x10a`	`3.5300`	`1499.00000000`
`ran10x10b`	`2.3800`	`3073.00000000`
`ran10x10c`	`11.3300`	`13007.00000000`
`ran10x12`	`2.5900`	`2714.00000000`
`ran10x26`	`112.6900`	`4270.00000000`
`ran12x12`	`47.1800`	`2291.00000000`
`ran12x21`	`247.7600`	`3664.00000000`
`ran13x13`	`169.8700`	`3252.00000000`
`ran16x16`	`992.1700`	`3823.00000000`
`ran17x17`	`26.1100`	`1373.00000000`
`ran4x64`	`1.9500`	`9711.00000000`
`ran6x43`	`3.7100`	`6330.00000000`
`ran8x32`	`43.7500`	`5247.00000000`
`rentacar`	`6.0900`	`28882470.94755350`
`rgn`	`3.5000`	`82.19999924`
`rlp2`	`3.9600`	`19.00000000`
`stein27`	`2.9500`	`18.00000000`
`stein45`	`64.5800`	`30.00000000`
`swath1`	`743.8200`	`379.07129575`
`vpm1`	`0.2000`	`20.00000000`
`vpm2`	`8.6600`	`13.75000000`
`harp2`	`1788.4700`	`-73889532.00000000`

CBC20: feasible: Back to top

Modelname	Time (CBC20)	Obj (CBC20)
`arki001`	`1801.4900`	`7582515.66574672`
`binkar10_1`	`1801.6600`	`6746.64002300`
`danoint`	`1800.9200`	`66.37500000`
`fast0507`	`1806.2800`	`179.00000000`
`mkc1`	`1800.4400`	`-607.20700000`
`mkc`	`1802.2200`	`-534.34200000`
`neos2`	`1800.5500`	`468.53452713`
`neos3`	`1800.7300`	`387.48814776`
`noswot`	`1758.7600`	`-41.00000000`
`ran14x18`	`1802.8000`	`3735.00000000`
`rout`	`1802.4900`	`1077.56000000`
`set1ch`	`1802.4400`	`54555.00000000`
`seymour1`	`1825.8300`	`411.08574808`
`seymour`	`1802.5000`	`435.00000000`
`swath2`	`1801.1400`	`387.63980365`
`swath`	`1802.1400`	`517.86689600`
`markshare1`	`1804.5300`	`11.00000000`
`markshare2`	`1803.2400`	`14.00000000`
`mas74`	`1803.5200`	`11801.18572900`
`bc`	`1801.8500`	`7.00000000`
`bc1`	`1803.2900`	`3.33836255`

CBC20: fail: Back to top

Modelname	Time (CBC20)	Status (CBC20)
`acc-tight-2`	`--`	`mstat(13) sstat(13)`
`acc-tight-3`	`--`	`mstat(13) sstat(13)`
`acc-tight-5`	`--`	`mstat(13) sstat(13)`
`acc-tight-6`	`--`	`mstat(13) sstat(13)`
`dano3_3`	`--`	`mstat(13) sstat(13)`
`dano3_4`	`--`	`mstat(13) sstat(13)`
`dano3_5`	`--`	`mstat(13) sstat(13)`
`dano3mip`	`--`	`mstat(13) sstat(13)`

CBC21: optimal: Back to top

Modelname	Time (CBC21)	Obj (CBC21)
`10teams`	`50.7800`	`924.00000000`
`acc-tight-0`	`6.4600`	`0.00000000`
`acc-tight-1`	`9.5200`	`0.00000000`
`acc-tight-2`	`1402.1500`	`0.00000000`
`acc-tight-4`	`3.8300`	`0.00000000`
`acc-tight-5`	`367.3000`	`0.00000000`
`air03`	`1.8800`	`340160.00000000`
`air04`	`226.1600`	`56137.00000000`
`air05`	`94.3600`	`26374.00000000`
`bal8x12`	`0.2600`	`471.55000000`
`bell3a`	`2.6500`	`878430.31600000`
`bell5`	`2.8600`	`8966406.49152000`
`bienst1`	`39.5700`	`46.75000000`
`binkar10_1`	`1571.8700`	`6742.20002400`
`bk4x3`	`0.0100`	`350.00000000`
`blend2`	`4.4400`	`7.59898500`
`cap6000`	`259.8800`	`-2451377.00000000`
`dano3_3`	`209.1500`	`576.34463303`
`dano3_4`	`265.1000`	`576.43522471`
`dano3_5`	`658.1500`	`576.92491596`
`dcmulti`	`6.3000`	`188182.00000000`
`dsbmip`	`1.5400`	`-306.76901203`
`egout`	`0.0400`	`568.10070000`
`enigma`	`3.1900`	`0.00000000`
`fiber`	`4.4300`	`405935.18000000`
`fixnet6`	`8.3700`	`3983.00000000`
`gen`	`0.2400`	`112313.36271800`
`gesa2`	`8.0200`	`25779856.37169790`
`gesa2_o`	`36.7500`	`25779856.37169790`
`gesa3`	`1.5900`	`27991042.64838270`
`gesa3_o`	`15.5500`	`27991042.64838270`
`gr4x6`	`0.0200`	`202.35000000`
`gt2`	`1.0200`	`21166.00000000`
`irp`	`42.9500`	`12159.49283600`
`khb05250`	`0.6900`	`106940226.00000000`
`l152lav`	`11.6000`	`4722.00000000`
`lseu`	`1.8500`	`1120.00000000`
`mas284`	`29.2400`	`91405.72368220`
`mas76`	`184.5200`	`40005.05414200`
`misc03`	`3.2200`	`3360.00000000`
`misc06`	`2.0300`	`12850.86073738`
`misc07`	`96.8000`	`2810.00000000`
`mitre`	`11.3200`	`115155.00000000`
`mod008`	`4.5100`	`307.00000000`
`mod010`	`0.8600`	`6548.00000000`
`mod011`	`169.2100`	`-54558535.01422730`
`modglob`	`12.8600`	`20740508.08630820`
`neos2`	`477.7900`	`454.86970173`
`neos4`	`14.5000`	`-4.8603440750590E+10`
`neos5`	`10.9200`	`-4.8603440750590E+10`
`neos6`	`1594.1900`	`83.00000000`
`nw04`	`28.7400`	`16862.00000000`
`p0033`	`0.0300`	`3089.00000000`
`p0201`	`8.2300`	`7615.00000000`
`p0282`	`4.2000`	`258411.00000000`
`p0548`	`0.3700`	`8691.00000000`
`p2756`	`7.3600`	`3124.00000000`
`pk1`	`95.2200`	`11.00000000`
`pp08acuts`	`59.5200`	`7350.00000000`
`pp08a`	`49.0300`	`7350.00000000`
`prod1`	`186.3900`	`-56.00000000`
`qiu`	`318.1900`	`-132.87313695`
`qnet1`	`6.6800`	`16029.69268100`
`qnet1_o`	`5.9600`	`16029.69268100`
`ran10x10a`	`5.2200`	`1499.00000000`
`ran10x10b`	`2.3700`	`3073.00000000`
`ran10x10c`	`3.5700`	`13007.00000000`
`ran10x12`	`3.2300`	`2714.00000000`
`ran10x26`	`40.2900`	`4270.00000000`
`ran12x12`	`55.6300`	`2291.00000000`
`ran12x21`	`275.5300`	`3664.00000000`
`ran13x13`	`154.5000`	`3252.00000000`
`ran16x16`	`1599.3000`	`3823.00000000`
`ran17x17`	`23.2400`	`1373.00000000`
`ran4x64`	`2.2900`	`9711.00000000`
`ran6x43`	`3.2800`	`6330.00000000`
`ran8x32`	`27.6200`	`5247.00000000`
`rentacar`	`8.0900`	`28882470.94755350`
`rgn`	`4.0600`	`82.19999924`
`rlp2`	`4.7000`	`19.00000000`
`rout`	`178.5100`	`1077.56000000`
`seymour1`	`1498.0300`	`410.76370139`
`stein27`	`2.9400`	`18.00000000`
`stein45`	`63.2600`	`30.00000000`
`swath1`	`369.6800`	`379.07129575`
`swath2`	`871.4900`	`385.19969295`
`vpm1`	`0.1200`	`20.00000000`
`vpm2`	`1.9700`	`13.75000000`
`bc1`	`1299.5800`	`3.33836255`
`harp2`	`181.0900`	`-73899069.00000000`

CBC21: feasible: Back to top

Modelname	Time (CBC21)	Obj (CBC21)
`arki001`	`1803.4400`	`7581399.75958207`
`bienst2`	`1800.7900`	`54.60000000`
`dano3mip`	`1887.0600`	`756.62500000`
`danoint`	`1801.4700`	`65.66666667`
`fast0507`	`1803.5600`	`179.00000000`
`mkc1`	`1801.1800`	`-607.20700000`
`mkc`	`1801.4000`	`-548.01200000`
`neos1`	`1801.4600`	`19.00000000`
`neos3`	`1801.6000`	`549.52300713`
`noswot`	`1806.0200`	`-41.00000000`
`ran14x18`	`1803.4000`	`3736.00000000`
`set1ch`	`1802.7900`	`54537.75000000`
`seymour`	`1802.3400`	`431.00000000`
`swath`	`1802.0100`	`501.95221100`
`markshare1`	`1803.0900`	`10.00000000`
`markshare2`	`1802.5800`	`15.00000000`
`mas74`	`1802.9400`	`11801.18572900`
`bc`	`1803.1200`	`7.00000000`

CBC21: fail: Back to top

Modelname	Time (CBC21)	Status (CBC21)
`acc-tight-3`	`--`	`mstat(14) sstat( 3)`
`acc-tight-6`	`--`	`mstat(14) sstat( 3)`

CBC20: all -- CBC21: all : Back to top

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 1e-5. For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the timelimit (1800 seconds). The shift is 10s for time and 0.0001 for timeratios. For gaps, an arithmetic mean is used. Only instances with relative gap are counted. Instances without a gap are counted with 1.

Modelname	Time (CBC20)	Time (CBC21)	Ratio (CBC20/CBC21)	Obj (CBC20)	Obj (CBC21)	ObjEst (CBC20)	ObjEst (CBC21)	Gap (CBC20)	Gap (CBC21)
`10teams`	`35.9300`	`50.7800`	`0.708`	`924.00000000`	`924.00000000`	`924.00000000`	`924.00000000`	`0.0000`	`0.0000`
`acc-tight-0`	`3.8400`	`6.4600`	`0.594`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-1`	`6.0500`	`9.5200`	`0.636`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-2`	`NA`	`1402.1500`	---	`mstat(13) sstat(13)`	`0.00000000`	---	`0.00000000`	`---`	`0.0000`
`acc-tight-3`	`NA`	`1801.5100`	---	`mstat(13) sstat(13)`	`mstat(14) sstat( 3)`	---	---	---	---
`acc-tight-4`	`8.5600`	`3.8300`	`2.235`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-5`	`NA`	`367.3000`	---	`mstat(13) sstat(13)`	`0.00000000`	---	`0.00000000`	`---`	`0.0000`
`acc-tight-6`	`NA`	`1801.3600`	---	`mstat(13) sstat(13)`	`mstat(14) sstat( 3)`	---	---	---	---
`air03`	`5.1800`	`1.8800`	`2.755`	`340160.00000000`	`340160.00000000`	`340160.00000000`	`340160.00000000`	`0.0000`	`0.0000`
`air04`	`298.6500`	`226.1600`	`1.321`	`56137.00000000`	`56137.00000000`	`56137.00000000`	`56137.00000000`	`0.0000`	`0.0000`
`air05`	`422.5000`	`94.3600`	`4.478`	`26374.00000000`	`26374.00000000`	`26374.00000000`	`26374.00000000`	`0.0000`	`0.0000`
`arki001`	`1801.4900`	`1803.4400`	`1.000`	`7582515.66574672`	`7581399.75958207`	`7580317.76637409`	`7580417.05770240`	`0.0003`	`0.0001`
`bal8x12`	`1.7300`	`0.2600`	`6.654`	`471.55000000`	`471.55000000`	`471.55000000`	`471.55000000`	`0.0000`	`0.0000`
`bell3a`	`3.1600`	`2.6500`	`1.192`	`878430.31600000`	`878430.31600000`	`878430.31600000`	`878430.31600000`	`0.0000`	`0.0000`
`bell5`	`82.9300`	`2.8600`	`28.997`	`8966406.49152000`	`8966406.49152000`	`8966406.49152000`	`8966406.49152000`	`0.0000`	`0.0000`
`bienst1`	`103.6800`	`39.5700`	`2.620`	`46.75000000`	`46.75000000`	`46.75000000`	`46.75000000`	`0.0000`	`0.0000`
`bienst2`	`762.9600`	`1800.7900`	`0.212`	`54.60000000`	`54.60000000`	`54.60000000`	`52.77974380`	`0.0000`	`0.0345`
`binkar10_1`	`1801.6600`	`1571.8700`	`2.290`	`6746.64002300`	`6742.20002400`	`6729.06767310`	`6742.20002400`	`0.0026`	`0.0000`
`bk4x3`	`0.0100`	`0.0100`	`---`	`350.00000000`	`350.00000000`	`350.00000000`	`350.00000000`	`0.0000`	`0.0000`
`blend2`	`12.4600`	`4.4400`	`2.806`	`7.59898500`	`7.59898500`	`7.59898500`	`7.59898500`	`0.0000`	`0.0000`
`cap6000`	`12.4000`	`259.8800`	`0.048`	`-2451377.00000000`	`-2451377.00000000`	`-2451377.00000000`	`-2451377.00000000`	`0.0000`	`0.0000`
`dano3_3`	`NA`	`209.1500`	---	`mstat(13) sstat(13)`	`576.34463303`	---	`576.34463303`	`---`	`0.0000`
`dano3_4`	`NA`	`265.1000`	---	`mstat(13) sstat(13)`	`576.43522471`	---	`576.43522471`	`---`	`0.0000`
`dano3_5`	`NA`	`658.1500`	---	`mstat(13) sstat(13)`	`576.92491596`	---	`576.92491596`	`---`	`0.0000`
`dano3mip`	`NA`	`1887.0600`	---	`mstat(13) sstat(13)`	`756.62500000`	---	`576.61143751`	`---`	`0.3122`
`danoint`	`1800.9200`	`1801.4700`	`1.000`	`66.37500000`	`65.66666667`	`63.41017254`	`63.64905485`	`0.0468`	`0.0317`
`dcmulti`	`6.7100`	`6.3000`	`1.065`	`188182.00000000`	`188182.00000000`	`188182.00000000`	`188182.00000000`	`0.0000`	`0.0000`
`dsbmip`	`1.0800`	`1.5400`	`0.701`	`-306.76901203`	`-306.76901203`	`-306.76901203`	`-306.76901203`	`0.0000`	`0.0000`
`egout`	`0.0300`	`0.0400`	`---`	`568.10070000`	`568.10070000`	`568.10070000`	`568.10070000`	`0.0000`	`0.0000`
`enigma`	`6.1600`	`3.1900`	`1.931`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`fast0507`	`1806.2800`	`1803.5600`	`1.000`	`179.00000000`	`179.00000000`	`172.32418453`	`172.35111895`	`0.0387`	`0.0386`
`fiber`	`2.0000`	`4.4300`	`0.451`	`405935.18000000`	`405935.18000000`	`405935.18000000`	`405935.18000000`	`0.0000`	`0.0000`
`fixnet6`	`11.5100`	`8.3700`	`1.375`	`3983.00000000`	`3983.00000000`	`3983.00000000`	`3983.00000000`	`0.0000`	`0.0000`
`gen`	`0.1900`	`0.2400`	`0.792`	`112313.36271800`	`112313.36271800`	`112313.36271800`	`112313.36271800`	`0.0000`	`0.0000`
`gesa2`	`11.2300`	`8.0200`	`1.400`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`0.0000`	`0.0000`
`gesa2_o`	`42.3500`	`36.7500`	`1.152`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`0.0000`	`0.0000`
`gesa3`	`11.6000`	`1.5900`	`7.296`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`0.0000`	`0.0000`
`gesa3_o`	`13.1500`	`15.5500`	`0.846`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`0.0000`	`0.0000`
`gr4x6`	`0.0300`	`0.0200`	`---`	`202.35000000`	`202.35000000`	`202.35000000`	`202.35000000`	`0.0000`	`0.0000`
`gt2`	`0.0500`	`1.0200`	`0.049`	`21166.00000000`	`21166.00000000`	`21166.00000000`	`21166.00000000`	`0.0000`	`0.0000`
`irp`	`244.0700`	`42.9500`	`5.683`	`12159.49283600`	`12159.49283600`	`12159.49283600`	`12159.49283600`	`0.0000`	`0.0000`
`khb05250`	`0.4600`	`0.6900`	`0.667`	`106940226.00000000`	`106940226.00000000`	`106940226.00000000`	`106940226.00000000`	`0.0000`	`0.0000`
`l152lav`	`23.8300`	`11.6000`	`2.054`	`4722.00000000`	`4722.00000000`	`4722.00000000`	`4722.00000000`	`0.0000`	`0.0000`
`lseu`	`1.7700`	`1.8500`	`0.957`	`1120.00000000`	`1120.00000000`	`1120.00000000`	`1120.00000000`	`0.0000`	`0.0000`
`mas284`	`31.0800`	`29.2400`	`1.063`	`91405.72368220`	`91405.72368220`	`91405.72368220`	`91405.72368220`	`0.0000`	`0.0000`
`mas76`	`241.3000`	`184.5200`	`1.308`	`40005.05414200`	`40005.05414200`	`40005.05414200`	`40005.05414200`	`0.0000`	`0.0000`
`misc03`	`3.3400`	`3.2200`	`1.037`	`3360.00000000`	`3360.00000000`	`3360.00000000`	`3360.00000000`	`0.0000`	`0.0000`
`misc06`	`1.3400`	`2.0300`	`0.660`	`12850.86073738`	`12850.86073738`	`12850.86073738`	`12850.86073738`	`0.0000`	`0.0000`
`misc07`	`108.7200`	`96.8000`	`1.123`	`2810.00000000`	`2810.00000000`	`2810.00000000`	`2810.00000000`	`0.0000`	`0.0000`
`mitre`	`10.1600`	`11.3200`	`0.898`	`115155.00000000`	`115155.00000000`	`115155.00000000`	`115155.00000000`	`0.0000`	`0.0000`
`mkc1`	`1800.4400`	`1801.1800`	`1.000`	`-607.20700000`	`-607.20700000`	`-607.21000000`	`-607.21000000`	`0.0000`	`0.0000`
`mkc`	`1802.2200`	`1801.4000`	`1.000`	`-534.34200000`	`-548.01200000`	`-583.78559431`	`-571.95000135`	`0.0847`	`0.0419`
`mod008`	`1.7800`	`4.5100`	`0.395`	`307.00000000`	`307.00000000`	`307.00000000`	`307.00000000`	`0.0000`	`0.0000`
`mod010`	`1.1200`	`0.8600`	`1.302`	`6548.00000000`	`6548.00000000`	`6548.00000000`	`6548.00000000`	`0.0000`	`0.0000`
`mod011`	`248.0700`	`169.2100`	`1.466`	`-54558535.01422730`	`-54558535.01422730`	`-54558535.01422730`	`-54558535.01422730`	`0.0000`	`0.0000`
`modglob`	`30.0400`	`12.8600`	`2.336`	`20740508.08630820`	`20740508.08630820`	`20740508.08630820`	`20740508.08630820`	`0.0000`	`0.0000`
`neos1`	`970.2200`	`1801.4600`	`0.270`	`19.00000000`	`19.00000000`	`19.00000000`	`14.83297749`	`0.0000`	`0.2809`
`neos2`	`1800.5500`	`477.7900`	`1.000`	`468.53452713`	`454.86970173`	`316.70562689`	`+INF`	`0.4794`	`+INF`
`neos3`	`1800.7300`	`1801.6000`	`1.000`	`387.48814776`	`549.52300713`	`-106.82749368`	`-1794.26238767`	`4.6272`	`1.3063`
`neos4`	`42.0800`	`14.5000`	`2.902`	`-4.8603440750589E+10`	`-4.8603440750590E+10`	`-4.8603440750590E+10`	`-4.8603440750590E+10`	`0.0000`	`0.0000`
`neos5`	`33.9300`	`10.9200`	`3.107`	`-4.8603440750589E+10`	`-4.8603440750590E+10`	`-4.8603440750590E+10`	`-4.8603440750590E+10`	`0.0000`	`0.0000`
`neos6`	`441.4500`	`1594.1900`	`0.277`	`83.00000000`	`83.00000000`	`83.00000000`	`83.00000000`	`0.0000`	`0.0000`
`noswot`	`1758.7600`	`1806.0200`	`1.000`	`-41.00000000`	`-41.00000000`	`-43.00000000`	`-43.00000000`	`0.0465`	`0.0465`
`nw04`	`25.0300`	`28.7400`	`0.871`	`16862.00000000`	`16862.00000000`	`16862.00000000`	`16862.00000000`	`0.0000`	`0.0000`
`p0033`	`0.0600`	`0.0300`	`2.000`	`3089.00000000`	`3089.00000000`	`3089.00000000`	`3089.00000000`	`0.0000`	`0.0000`
`p0201`	`7.6800`	`8.2300`	`0.933`	`7615.00000000`	`7615.00000000`	`7615.00000000`	`7615.00000000`	`0.0000`	`0.0000`
`p0282`	`3.1900`	`4.2000`	`0.760`	`258411.00000000`	`258411.00000000`	`258411.00000000`	`258411.00000000`	`0.0000`	`0.0000`
`p0548`	`0.5800`	`0.3700`	`1.568`	`8691.00000000`	`8691.00000000`	`8691.00000000`	`8691.00000000`	`0.0000`	`0.0000`
`p2756`	`2.4300`	`7.3600`	`0.330`	`3124.00000000`	`3124.00000000`	`3124.00000000`	`3124.00000000`	`0.0000`	`0.0000`
`pk1`	`129.1600`	`95.2200`	`1.356`	`11.00000000`	`11.00000000`	`11.00000000`	`11.00000000`	`0.0000`	`0.0000`
`pp08acuts`	`40.0900`	`59.5200`	`0.674`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`0.0000`	`0.0000`
`pp08a`	`75.2400`	`49.0300`	`1.535`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`0.0000`	`0.0000`
`prod1`	`134.6000`	`186.3900`	`0.722`	`-56.00000000`	`-56.00000000`	`-56.00000000`	`-56.00000000`	`0.0000`	`0.0000`
`qiu`	`293.6300`	`318.1900`	`0.923`	`-132.87313695`	`-132.87313695`	`-132.87313695`	`-132.87313695`	`0.0000`	`0.0000`
`qnet1`	`7.1300`	`6.6800`	`1.067`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`0.0000`	`0.0000`
`qnet1_o`	`6.2200`	`5.9600`	`1.044`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`0.0000`	`0.0000`
`ran10x10a`	`3.5300`	`5.2200`	`0.676`	`1499.00000000`	`1499.00000000`	`1499.00000000`	`1499.00000000`	`0.0000`	`0.0000`
`ran10x10b`	`2.3800`	`2.3700`	`1.004`	`3073.00000000`	`3073.00000000`	`3073.00000000`	`3073.00000000`	`0.0000`	`0.0000`
`ran10x10c`	`11.3300`	`3.5700`	`3.174`	`13007.00000000`	`13007.00000000`	`13007.00000000`	`13007.00000000`	`0.0000`	`0.0000`
`ran10x12`	`2.5900`	`3.2300`	`0.802`	`2714.00000000`	`2714.00000000`	`2714.00000000`	`2714.00000000`	`0.0000`	`0.0000`
`ran10x26`	`112.6900`	`40.2900`	`2.797`	`4270.00000000`	`4270.00000000`	`4270.00000000`	`4270.00000000`	`0.0000`	`0.0000`
`ran12x12`	`47.1800`	`55.6300`	`0.848`	`2291.00000000`	`2291.00000000`	`2291.00000000`	`2291.00000000`	`0.0000`	`0.0000`
`ran12x21`	`247.7600`	`275.5300`	`0.899`	`3664.00000000`	`3664.00000000`	`3664.00000000`	`3664.00000000`	`0.0000`	`0.0000`
`ran13x13`	`169.8700`	`154.5000`	`1.099`	`3252.00000000`	`3252.00000000`	`3252.00000000`	`3252.00000000`	`0.0000`	`0.0000`
`ran14x18`	`1802.8000`	`1803.4000`	`1.000`	`3735.00000000`	`3736.00000000`	`3518.02027632`	`3566.84442142`	`0.0617`	`0.0474`
`ran16x16`	`992.1700`	`1599.3000`	`0.620`	`3823.00000000`	`3823.00000000`	`3823.00000000`	`3823.00000000`	`0.0000`	`0.0000`
`ran17x17`	`26.1100`	`23.2400`	`1.123`	`1373.00000000`	`1373.00000000`	`1373.00000000`	`1373.00000000`	`0.0000`	`0.0000`
`ran4x64`	`1.9500`	`2.2900`	`0.852`	`9711.00000000`	`9711.00000000`	`9711.00000000`	`9711.00000000`	`0.0000`	`0.0000`
`ran6x43`	`3.7100`	`3.2800`	`1.131`	`6330.00000000`	`6330.00000000`	`6330.00000000`	`6330.00000000`	`0.0000`	`0.0000`
`ran8x32`	`43.7500`	`27.6200`	`1.584`	`5247.00000000`	`5247.00000000`	`5247.00000000`	`5247.00000000`	`0.0000`	`0.0000`
`rentacar`	`6.0900`	`8.0900`	`0.753`	`28882470.94755350`	`28882470.94755350`	`28882470.94755350`	`28882470.94755350`	`0.0000`	`0.0000`
`rgn`	`3.5000`	`4.0600`	`0.862`	`82.19999924`	`82.19999924`	`82.19999924`	`82.19999924`	`0.0000`	`0.0000`
`rlp2`	`3.9600`	`4.7000`	`0.843`	`19.00000000`	`19.00000000`	`19.00000000`	`19.00000000`	`0.0000`	`0.0000`
`rout`	`1802.4900`	`178.5100`	`20.167`	`1077.56000000`	`1077.56000000`	`1044.66808848`	`1077.56000000`	`0.0315`	`0.0000`
`set1ch`	`1802.4400`	`1802.7900`	`1.000`	`54555.00000000`	`54537.75000000`	`54189.68297590`	`54266.88862148`	`0.0067`	`0.0050`
`seymour1`	`1825.8300`	`1498.0300`	`2.403`	`411.08574808`	`410.76370139`	`409.91158207`	`410.76370139`	`0.0029`	`0.0000`
`seymour`	`1802.5000`	`1802.3400`	`1.000`	`435.00000000`	`431.00000000`	`410.06537513`	`409.76245173`	`0.0608`	`0.0518`
`stein27`	`2.9500`	`2.9400`	`1.003`	`18.00000000`	`18.00000000`	`18.00000000`	`18.00000000`	`0.0000`	`0.0000`
`stein45`	`64.5800`	`63.2600`	`1.021`	`30.00000000`	`30.00000000`	`30.00000000`	`30.00000000`	`0.0000`	`0.0000`
`swath1`	`743.8200`	`369.6800`	`2.012`	`379.07129575`	`379.07129575`	`379.07129575`	`379.07129575`	`0.0000`	`0.0000`
`swath2`	`1801.1400`	`871.4900`	`4.131`	`387.63980365`	`385.19969295`	`371.94441583`	`385.19969295`	`0.0422`	`0.0000`
`swath`	`1802.1400`	`1802.0100`	`1.000`	`517.86689600`	`501.95221100`	`354.06052185`	`348.79997283`	`0.4627`	`0.4391`
`vpm1`	`0.2000`	`0.1200`	`1.667`	`20.00000000`	`20.00000000`	`20.00000000`	`20.00000000`	`0.0000`	`0.0000`
`vpm2`	`8.6600`	`1.9700`	`4.396`	`13.75000000`	`13.75000000`	`13.75000000`	`13.75000000`	`0.0000`	`0.0000`
`markshare1`	`1804.5300`	`1803.0900`	`1.000`	`11.00000000`	`10.00000000`	`0.00000000`	`0.00000000`	`11.0000`	`10.0000`
`markshare2`	`1803.2400`	`1802.5800`	`1.000`	`14.00000000`	`15.00000000`	`0.00000000`	`0.00000000`	`14.0000`	`15.0000`
`mas74`	`1803.5200`	`1802.9400`	`1.000`	`11801.18572900`	`11801.18572900`	`11649.49567611`	`11621.83426653`	`0.0130`	`0.0154`
`bc`	`1801.8500`	`1803.1200`	`1.000`	`7.00000000`	`7.00000000`	`5.03076902`	`5.03262958`	`0.3914`	`0.3909`
`bc1`	`1803.2900`	`1299.5800`	`2.770`	`3.33836255`	`3.33836255`	`3.32613827`	`3.33836255`	`0.0037`	`0.0000`
`harp2`	`1788.4700`	`181.0900`	`19.880`	`-73889532.00000000`	`-73899069.00000000`	`+INF`	`-73899069.00000000`	`+INF`	`0.0000`
mean	114.26	88.58	1.31	---	---	---	---	0.16	0.07
unsolved	26.36%	18.18%