Solver Square Comparison

Solver Square Comparison: Considers all models.

Date / Time: 08/25/08 16:26:12

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver CBC12 is represented on the left (rows) and solver CBC21 on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

Tracefile 1 :	`22.5.trc`
Tracefile 2 :	`22.8.trc`
Solvers used :	`CBC12`
	`CBC21`
Modeltype(s)	`MIP`

	CBC21: optimal	CBC21: feasible	CBC21: infeasible	CBC21: unbounded	CBC21: fail	CBC21: no data	total CBC12
CBC12: optimal	-	-	-	-	-	-	`-`
CBC12: feasible	`69`	`1`	-	-	-	-	`70`
CBC12: infeasible	-	-	-	-	-	-	`-`
CBC12: unbounded	-	-	-	-	-	-	`-`
CBC12: fail	`21`	`17`	-	-	`2`	-	`40`
CBC12: no data	-	-	-	-	-	-	`-`
total CBC21	`90`	`18`	`-`	`-`	`2`	`-`	`110`

Solver return definitions:

Outcome	Model Status	Solver Status
optimal	1 or 15	1
locally optimal	2	any
feasible	8 or 16	1 or 2 or 3 or 4 or 5
infeasible	4 or 5 or 10 or 19	1
unbounded	3 or 18	1
fail	all other	all other

Solver Resource Times

Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

CBC12: feasible -- CBC21: optimal Back to top

Modelname	Time (CBC12)	Time (CBC21)	Ratio (CBC12/CBC21)	Obj (CBC12)	Obj (CBC21)
`acc-tight-0`	`36.1500`	`6.4600`	`5.596`	`0.00000000`	`0.00000000`
`acc-tight-1`	`397.4500`	`9.5200`	`41.749`	`0.00000000`	`0.00000000`
`acc-tight-4`	`105.8300`	`3.8300`	`27.632`	`0.00000000`	`0.00000000`
`air03`	`5.0600`	`1.8800`	`2.691`	`340160.00000000`	`340160.00000000`
`air04`	`124.9700`	`226.1600`	`0.553`	`56137.00000000`	`56137.00000000`
`air05`	`348.7400`	`94.3600`	`3.696`	`26374.00000000`	`26374.00000000`
`bal8x12`	`1.0100`	`0.2600`	`3.885`	`471.55000000`	`471.55000000`
`bell3a`	`15.2900`	`2.6500`	`5.770`	`878430.31600000`	`878430.31600000`
`bk4x3`	`0.0000`	`0.0100`	`---`	`350.00000000`	`350.00000000`
`blend2`	`14.1500`	`4.4400`	`3.187`	`7.59898500`	`7.59898500`
`cap6000`	`57.7900`	`259.8800`	`0.222`	`-2451377.00000000`	`-2451377.00000000`
`dcmulti`	`2.5200`	`6.3000`	`0.400`	`188182.00000000`	`188182.00000000`
`dsbmip`	`46.7700`	`1.5400`	`30.370`	`-306.76901203`	`-306.76901203`
`egout`	`0.0200`	`0.0400`	`---`	`568.10070000`	`568.10070000`
`enigma`	`14.6200`	`3.1900`	`4.583`	`0.00000000`	`0.00000000`
`fiber`	`4.4900`	`4.4300`	`1.014`	`405935.18000000`	`405935.18000000`
`fixnet6`	`8.7200`	`8.3700`	`1.042`	`3983.00000000`	`3983.00000000`
`gen`	`0.4800`	`0.2400`	`2.000`	`112313.36271800`	`112313.36271800`
`gesa2`	`89.8500`	`8.0200`	`11.203`	`25779856.37169790`	`25779856.37169790`
`gesa2_o`	`500.3600`	`36.7500`	`13.615`	`25779856.37169790`	`25779856.37169790`
`gesa3`	`5.2900`	`1.5900`	`3.327`	`27991042.64838270`	`27991042.64838270`
`gesa3_o`	`7.0600`	`15.5500`	`0.454`	`27991042.64838270`	`27991042.64838270`
`gr4x6`	`0.0200`	`0.0200`	`---`	`202.35000000`	`202.35000000`
`gt2`	`0.4700`	`1.0200`	`0.461`	`21166.00000000`	`21166.00000000`
`irp`	`87.6500`	`42.9500`	`2.041`	`12159.49283600`	`12159.49283600`
`khb05250`	`0.2800`	`0.6900`	`0.406`	`106940226.00000000`	`106940226.00000000`
`l152lav`	`35.7100`	`11.6000`	`3.078`	`4722.00000000`	`4722.00000000`
`lseu`	`2.1400`	`1.8500`	`1.157`	`1120.00000000`	`1120.00000000`
`mas284`	`63.5000`	`29.2400`	`2.172`	`91405.72368220`	`91405.72368220`
`mas76`	`424.9300`	`184.5200`	`2.303`	`40005.05414200`	`40005.05414200`
`misc03`	`9.8400`	`3.2200`	`3.056`	`3360.00000000`	`3360.00000000`
`misc06`	`0.8300`	`2.0300`	`0.409`	`12850.86073738`	`12850.86073738`
`misc07`	`95.1000`	`96.8000`	`0.982`	`2810.00000000`	`2810.00000000`
`mitre`	`8.6200`	`11.3200`	`0.761`	`115155.00000000`	`115155.00000000`
`mod008`	`1.2200`	`4.5100`	`0.271`	`307.00000000`	`307.00000000`
`mod010`	`8.3100`	`0.8600`	`9.663`	`6548.00000000`	`6548.00000000`
`mod011`	`264.7600`	`169.2100`	`1.565`	`-54558535.01422730`	`-54558535.01422730`
`modglob`	`38.7200`	`12.8600`	`3.011`	`20740508.08630820`	`20740508.08630820`
`neos2`	`30.9400`	`477.7900`	`0.065`	`454.86469703`	`454.86970173`
`neos4`	`168.6800`	`14.5000`	`11.633`	`-4.8603440750589E+10`	`-4.8603440750590E+10`
`neos5`	`165.2900`	`10.9200`	`15.136`	`-4.8603440750589E+10`	`-4.8603440750590E+10`
`nw04`	`49.5300`	`28.7400`	`1.723`	`16862.00000000`	`16862.00000000`
`p0033`	`0.2400`	`0.0300`	`8.000`	`3089.00000000`	`3089.00000000`
`p0201`	`15.9700`	`8.2300`	`1.940`	`7615.00000000`	`7615.00000000`
`p0282`	`4.8200`	`4.2000`	`1.148`	`258411.00000000`	`258411.00000000`
`p0548`	`12.7100`	`0.3700`	`34.351`	`8691.00000000`	`8691.00000000`
`pk1`	`447.1800`	`95.2200`	`4.696`	`11.00000000`	`11.00000000`
`pp08acuts`	`763.5900`	`59.5200`	`12.829`	`7350.00000000`	`7350.00000000`
`pp08a`	`35.7800`	`49.0300`	`0.730`	`7350.00000000`	`7350.00000000`
`prod1`	`123.2600`	`186.3900`	`0.661`	`-56.00000000`	`-56.00000000`
`qnet1`	`8.1900`	`6.6800`	`1.226`	`16029.69268100`	`16029.69268100`
`qnet1_o`	`5.9500`	`5.9600`	`0.998`	`16029.69268100`	`16029.69268100`
`ran10x10a`	`10.4600`	`5.2200`	`2.004`	`1499.00000000`	`1499.00000000`
`ran10x10b`	`4.5800`	`2.3700`	`1.932`	`3073.00000000`	`3073.00000000`
`ran10x10c`	`12.0600`	`3.5700`	`3.378`	`13007.00000000`	`13007.00000000`
`ran10x12`	`9.6200`	`3.2300`	`2.978`	`2714.00000000`	`2714.00000000`
`ran10x26`	`537.9800`	`40.2900`	`13.353`	`4270.00000000`	`4270.00000000`
`ran12x12`	`248.1500`	`55.6300`	`4.461`	`2291.00000000`	`2291.00000000`
`ran13x13`	`534.5600`	`154.5000`	`3.460`	`3252.00000000`	`3252.00000000`
`ran17x17`	`251.3200`	`23.2400`	`10.814`	`1373.00000000`	`1373.00000000`
`ran4x64`	`9.3100`	`2.2900`	`4.066`	`9711.00000000`	`9711.00000000`
`ran6x43`	`4.2400`	`3.2800`	`1.293`	`6330.00000000`	`6330.00000000`
`rentacar`	`11.6400`	`8.0900`	`1.439`	`28882470.94755350`	`28882470.94755350`
`rlp2`	`97.6400`	`4.7000`	`20.774`	`19.00000000`	`19.00000000`
`stein27`	`2.1700`	`2.9400`	`0.738`	`18.00000000`	`18.00000000`
`stein45`	`57.4100`	`63.2600`	`0.908`	`30.00000000`	`30.00000000`
`swath1`	`579.6000`	`369.6800`	`1.568`	`379.07129575`	`379.07129575`
`vpm1`	`1.3800`	`0.1200`	`11.500`	`20.00000000`	`20.00000000`
`vpm2`	`9.6500`	`1.9700`	`4.898`	`13.75000000`	`13.75000000`

CBC12: feasible -- CBC21: feasible Back to top

Modelname	Time (CBC12)	Time (CBC21)	Ratio (CBC12/CBC21)	Obj (CBC12)	Obj (CBC21)
`neos3`	`224.6600`	`1801.6000`	`0.125`	`368.84275100`	`549.52300713`

CBC12: fail -- CBC21: optimal Back to top

Modelname	Time (CBC12)	Time (CBC21)	Ratio (CBC12/CBC21)	Status (CBC12)	Obj (CBC21)
`10teams`	`1800.3200`	`50.7800`	---	`mstat(14) sstat( 2)`	`924.00000000`
`acc-tight-2`	`NA`	`1402.1500`	---	`mstat(13) sstat(13)`	`0.00000000`
`acc-tight-5`	`NA`	`367.3000`	---	`mstat(13) sstat(13)`	`0.00000000`
`bc1`	`NA`	`1299.5800`	---	`mstat(13) sstat(13)`	`3.33836255`
`bienst1`	`NA`	`39.5700`	---	`mstat(13) sstat(13)`	`46.75000000`
`binkar10_1`	`1801.6600`	`1571.8700`	---	`mstat(14) sstat( 2)`	`6742.20002400`
`dano3_3`	`NA`	`209.1500`	---	`mstat(13) sstat(13)`	`576.34463303`
`dano3_4`	`NA`	`265.1000`	---	`mstat(13) sstat(13)`	`576.43522471`
`dano3_5`	`NA`	`658.1500`	---	`mstat(13) sstat(13)`	`576.92491596`
`harp2`	`1800.8100`	`181.0900`	---	`mstat(14) sstat( 2)`	`-73899069.00000000`
`neos6`	`1801.3700`	`1594.1900`	---	`mstat(14) sstat( 2)`	`83.00000000`
`p2756`	`NA`	`7.3600`	---	`mstat(13) sstat(13)`	`3124.00000000`
`qiu`	`1800.1100`	`318.1900`	---	`mstat(14) sstat( 2)`	`-132.87313695`
`ran12x21`	`1800.0200`	`275.5300`	---	`mstat(14) sstat( 2)`	`3664.00000000`
`ran16x16`	`1800.0400`	`1599.3000`	---	`mstat(14) sstat( 2)`	`3823.00000000`
`ran8x32`	`1800.0100`	`27.6200`	---	`mstat(14) sstat( 2)`	`5247.00000000`
`rgn`	`NA`	`4.0600`	---	`mstat(13) sstat(13)`	`82.19999924`
`rout`	`1801.5800`	`178.5100`	---	`mstat(14) sstat( 2)`	`1077.56000000`
`seymour1`	`1802.2400`	`1498.0300`	---	`mstat(14) sstat( 2)`	`410.76370139`
`swath2`	`1800.6400`	`871.4900`	---	`mstat(14) sstat( 2)`	`385.19969295`
`bell5`	`1802.7200`	`2.8600`	---	`mstat(14) sstat( 2)`	`8966406.49152000`

CBC12: fail -- CBC21: feasible Back to top

Modelname	Time (CBC12)	Time (CBC21)	Ratio (CBC12/CBC21)	Status (CBC12)	Obj (CBC21)
`arki001`	`1800.7300`	`1803.4400`	---	`mstat(14) sstat( 2)`	`7581399.75958207`
`bc`	`1801.5600`	`1803.1200`	---	`mstat(14) sstat( 2)`	`7.00000000`
`bienst2`	`NA`	`1800.7900`	---	`mstat(13) sstat(13)`	`54.60000000`
`dano3mip`	`NA`	`1887.0600`	---	`mstat(13) sstat(13)`	`756.62500000`
`danoint`	`1800.4100`	`1801.4700`	---	`mstat(14) sstat( 2)`	`65.66666667`
`fast0507`	`1811.0100`	`1803.5600`	---	`mstat(14) sstat( 2)`	`179.00000000`
`mkc1`	`1800.6000`	`1801.1800`	---	`mstat(14) sstat( 2)`	`-607.20700000`
`mkc`	`1800.5000`	`1801.4000`	---	`mstat(14) sstat( 2)`	`-548.01200000`
`neos1`	`1800.6300`	`1801.4600`	---	`mstat(14) sstat( 2)`	`19.00000000`
`ran14x18`	`1801.8300`	`1803.4000`	---	`mstat(14) sstat( 2)`	`3736.00000000`
`set1ch`	`1801.4900`	`1802.7900`	---	`mstat(14) sstat( 2)`	`54537.75000000`
`seymour`	`1802.0600`	`1802.3400`	---	`mstat(14) sstat( 2)`	`431.00000000`
`swath`	`1800.6400`	`1802.0100`	---	`mstat(14) sstat( 2)`	`501.95221100`
`markshare1`	`1803.9500`	`1803.0900`	---	`mstat(14) sstat( 2)`	`10.00000000`
`markshare2`	`1803.0400`	`1802.5800`	---	`mstat(14) sstat( 2)`	`15.00000000`
`mas74`	`1800.0400`	`1802.9400`	---	`mstat(14) sstat( 2)`	`11801.18572900`
`noswot`	`1800.5900`	`1806.0200`	---	`mstat(14) sstat( 2)`	`-41.00000000`

CBC12: fail -- CBC21: fail Back to top

Modelname	Time (CBC12)	Time (CBC21)	Ratio (CBC12/CBC21)	Status (CBC12)	Status (CBC21)
`acc-tight-3`	`NA`	`1801.5100`	---	`mstat(13) sstat(13)`	`mstat(14) sstat( 3)`
`acc-tight-6`	`NA`	`1801.3600`	---	`mstat(13) sstat(13)`	`mstat(14) sstat( 3)`

CBC12: feasible: Back to top

Modelname	Time (CBC12)	Obj (CBC12)
`acc-tight-0`	`36.1500`	`0.00000000`
`acc-tight-1`	`397.4500`	`0.00000000`
`acc-tight-4`	`105.8300`	`0.00000000`
`air03`	`5.0600`	`340160.00000000`
`air04`	`124.9700`	`56137.00000000`
`air05`	`348.7400`	`26374.00000000`
`bal8x12`	`1.0100`	`471.55000000`
`bell3a`	`15.2900`	`878430.31600000`
`bk4x3`	`0.0000`	`350.00000000`
`blend2`	`14.1500`	`7.59898500`
`cap6000`	`57.7900`	`-2451377.00000000`
`dcmulti`	`2.5200`	`188182.00000000`
`dsbmip`	`46.7700`	`-306.76901203`
`egout`	`0.0200`	`568.10070000`
`enigma`	`14.6200`	`0.00000000`
`fiber`	`4.4900`	`405935.18000000`
`fixnet6`	`8.7200`	`3983.00000000`
`gen`	`0.4800`	`112313.36271800`
`gesa2`	`89.8500`	`25779856.37169790`
`gesa2_o`	`500.3600`	`25779856.37169790`
`gesa3`	`5.2900`	`27991042.64838270`
`gesa3_o`	`7.0600`	`27991042.64838270`
`gr4x6`	`0.0200`	`202.35000000`
`gt2`	`0.4700`	`21166.00000000`
`irp`	`87.6500`	`12159.49283600`
`khb05250`	`0.2800`	`106940226.00000000`
`l152lav`	`35.7100`	`4722.00000000`
`lseu`	`2.1400`	`1120.00000000`
`mas284`	`63.5000`	`91405.72368220`
`mas76`	`424.9300`	`40005.05414200`
`misc03`	`9.8400`	`3360.00000000`
`misc06`	`0.8300`	`12850.86073738`
`misc07`	`95.1000`	`2810.00000000`
`mitre`	`8.6200`	`115155.00000000`
`mod008`	`1.2200`	`307.00000000`
`mod010`	`8.3100`	`6548.00000000`
`mod011`	`264.7600`	`-54558535.01422730`
`modglob`	`38.7200`	`20740508.08630820`
`neos2`	`30.9400`	`454.86469703`
`neos3`	`224.6600`	`368.84275100`
`neos4`	`168.6800`	`-4.8603440750589E+10`
`neos5`	`165.2900`	`-4.8603440750589E+10`
`nw04`	`49.5300`	`16862.00000000`
`p0033`	`0.2400`	`3089.00000000`
`p0201`	`15.9700`	`7615.00000000`
`p0282`	`4.8200`	`258411.00000000`
`p0548`	`12.7100`	`8691.00000000`
`pk1`	`447.1800`	`11.00000000`
`pp08acuts`	`763.5900`	`7350.00000000`
`pp08a`	`35.7800`	`7350.00000000`
`prod1`	`123.2600`	`-56.00000000`
`qnet1`	`8.1900`	`16029.69268100`
`qnet1_o`	`5.9500`	`16029.69268100`
`ran10x10a`	`10.4600`	`1499.00000000`
`ran10x10b`	`4.5800`	`3073.00000000`
`ran10x10c`	`12.0600`	`13007.00000000`
`ran10x12`	`9.6200`	`2714.00000000`
`ran10x26`	`537.9800`	`4270.00000000`
`ran12x12`	`248.1500`	`2291.00000000`
`ran13x13`	`534.5600`	`3252.00000000`
`ran17x17`	`251.3200`	`1373.00000000`
`ran4x64`	`9.3100`	`9711.00000000`
`ran6x43`	`4.2400`	`6330.00000000`
`rentacar`	`11.6400`	`28882470.94755350`
`rlp2`	`97.6400`	`19.00000000`
`stein27`	`2.1700`	`18.00000000`
`stein45`	`57.4100`	`30.00000000`
`swath1`	`579.6000`	`379.07129575`
`vpm1`	`1.3800`	`20.00000000`
`vpm2`	`9.6500`	`13.75000000`

CBC12: fail: Back to top

Modelname	Time (CBC12)	Status (CBC12)
`10teams`	`--`	`mstat(14) sstat( 2)`
`acc-tight-2`	`--`	`mstat(13) sstat(13)`
`acc-tight-3`	`--`	`mstat(13) sstat(13)`
`acc-tight-5`	`--`	`mstat(13) sstat(13)`
`acc-tight-6`	`--`	`mstat(13) sstat(13)`
`arki001`	`--`	`mstat(14) sstat( 2)`
`bc1`	`--`	`mstat(13) sstat(13)`
`bc`	`--`	`mstat(14) sstat( 2)`
`bienst1`	`--`	`mstat(13) sstat(13)`
`bienst2`	`--`	`mstat(13) sstat(13)`
`binkar10_1`	`--`	`mstat(14) sstat( 2)`
`dano3_3`	`--`	`mstat(13) sstat(13)`
`dano3_4`	`--`	`mstat(13) sstat(13)`
`dano3_5`	`--`	`mstat(13) sstat(13)`
`dano3mip`	`--`	`mstat(13) sstat(13)`
`danoint`	`--`	`mstat(14) sstat( 2)`
`fast0507`	`--`	`mstat(14) sstat( 2)`
`harp2`	`--`	`mstat(14) sstat( 2)`
`mkc1`	`--`	`mstat(14) sstat( 2)`
`mkc`	`--`	`mstat(14) sstat( 2)`
`neos1`	`--`	`mstat(14) sstat( 2)`
`neos6`	`--`	`mstat(14) sstat( 2)`
`p2756`	`--`	`mstat(13) sstat(13)`
`qiu`	`--`	`mstat(14) sstat( 2)`
`ran12x21`	`--`	`mstat(14) sstat( 2)`
`ran14x18`	`--`	`mstat(14) sstat( 2)`
`ran16x16`	`--`	`mstat(14) sstat( 2)`
`ran8x32`	`--`	`mstat(14) sstat( 2)`
`rgn`	`--`	`mstat(13) sstat(13)`
`rout`	`--`	`mstat(14) sstat( 2)`
`set1ch`	`--`	`mstat(14) sstat( 2)`
`seymour1`	`--`	`mstat(14) sstat( 2)`
`seymour`	`--`	`mstat(14) sstat( 2)`
`swath2`	`--`	`mstat(14) sstat( 2)`
`swath`	`--`	`mstat(14) sstat( 2)`
`markshare1`	`--`	`mstat(14) sstat( 2)`
`markshare2`	`--`	`mstat(14) sstat( 2)`
`mas74`	`--`	`mstat(14) sstat( 2)`
`bell5`	`--`	`mstat(14) sstat( 2)`
`noswot`	`--`	`mstat(14) sstat( 2)`

CBC21: optimal: Back to top

Modelname	Time (CBC21)	Obj (CBC21)
`10teams`	`50.7800`	`924.00000000`
`acc-tight-0`	`6.4600`	`0.00000000`
`acc-tight-1`	`9.5200`	`0.00000000`
`acc-tight-2`	`1402.1500`	`0.00000000`
`acc-tight-4`	`3.8300`	`0.00000000`
`acc-tight-5`	`367.3000`	`0.00000000`
`air03`	`1.8800`	`340160.00000000`
`air04`	`226.1600`	`56137.00000000`
`air05`	`94.3600`	`26374.00000000`
`bal8x12`	`0.2600`	`471.55000000`
`bc1`	`1299.5800`	`3.33836255`
`bell3a`	`2.6500`	`878430.31600000`
`bienst1`	`39.5700`	`46.75000000`
`binkar10_1`	`1571.8700`	`6742.20002400`
`bk4x3`	`0.0100`	`350.00000000`
`blend2`	`4.4400`	`7.59898500`
`cap6000`	`259.8800`	`-2451377.00000000`
`dano3_3`	`209.1500`	`576.34463303`
`dano3_4`	`265.1000`	`576.43522471`
`dano3_5`	`658.1500`	`576.92491596`
`dcmulti`	`6.3000`	`188182.00000000`
`dsbmip`	`1.5400`	`-306.76901203`
`egout`	`0.0400`	`568.10070000`
`enigma`	`3.1900`	`0.00000000`
`fiber`	`4.4300`	`405935.18000000`
`fixnet6`	`8.3700`	`3983.00000000`
`gen`	`0.2400`	`112313.36271800`
`gesa2`	`8.0200`	`25779856.37169790`
`gesa2_o`	`36.7500`	`25779856.37169790`
`gesa3`	`1.5900`	`27991042.64838270`
`gesa3_o`	`15.5500`	`27991042.64838270`
`gr4x6`	`0.0200`	`202.35000000`
`gt2`	`1.0200`	`21166.00000000`
`harp2`	`181.0900`	`-73899069.00000000`
`irp`	`42.9500`	`12159.49283600`
`khb05250`	`0.6900`	`106940226.00000000`
`l152lav`	`11.6000`	`4722.00000000`
`lseu`	`1.8500`	`1120.00000000`
`mas284`	`29.2400`	`91405.72368220`
`mas76`	`184.5200`	`40005.05414200`
`misc03`	`3.2200`	`3360.00000000`
`misc06`	`2.0300`	`12850.86073738`
`misc07`	`96.8000`	`2810.00000000`
`mitre`	`11.3200`	`115155.00000000`
`mod008`	`4.5100`	`307.00000000`
`mod010`	`0.8600`	`6548.00000000`
`mod011`	`169.2100`	`-54558535.01422730`
`modglob`	`12.8600`	`20740508.08630820`
`neos2`	`477.7900`	`454.86970173`
`neos4`	`14.5000`	`-4.8603440750590E+10`
`neos5`	`10.9200`	`-4.8603440750590E+10`
`neos6`	`1594.1900`	`83.00000000`
`nw04`	`28.7400`	`16862.00000000`
`p0033`	`0.0300`	`3089.00000000`
`p0201`	`8.2300`	`7615.00000000`
`p0282`	`4.2000`	`258411.00000000`
`p0548`	`0.3700`	`8691.00000000`
`p2756`	`7.3600`	`3124.00000000`
`pk1`	`95.2200`	`11.00000000`
`pp08acuts`	`59.5200`	`7350.00000000`
`pp08a`	`49.0300`	`7350.00000000`
`prod1`	`186.3900`	`-56.00000000`
`qiu`	`318.1900`	`-132.87313695`
`qnet1`	`6.6800`	`16029.69268100`
`qnet1_o`	`5.9600`	`16029.69268100`
`ran10x10a`	`5.2200`	`1499.00000000`
`ran10x10b`	`2.3700`	`3073.00000000`
`ran10x10c`	`3.5700`	`13007.00000000`
`ran10x12`	`3.2300`	`2714.00000000`
`ran10x26`	`40.2900`	`4270.00000000`
`ran12x12`	`55.6300`	`2291.00000000`
`ran12x21`	`275.5300`	`3664.00000000`
`ran13x13`	`154.5000`	`3252.00000000`
`ran16x16`	`1599.3000`	`3823.00000000`
`ran17x17`	`23.2400`	`1373.00000000`
`ran4x64`	`2.2900`	`9711.00000000`
`ran6x43`	`3.2800`	`6330.00000000`
`ran8x32`	`27.6200`	`5247.00000000`
`rentacar`	`8.0900`	`28882470.94755350`
`rgn`	`4.0600`	`82.19999924`
`rlp2`	`4.7000`	`19.00000000`
`rout`	`178.5100`	`1077.56000000`
`seymour1`	`1498.0300`	`410.76370139`
`stein27`	`2.9400`	`18.00000000`
`stein45`	`63.2600`	`30.00000000`
`swath1`	`369.6800`	`379.07129575`
`swath2`	`871.4900`	`385.19969295`
`vpm1`	`0.1200`	`20.00000000`
`vpm2`	`1.9700`	`13.75000000`
`bell5`	`2.8600`	`8966406.49152000`

CBC21: feasible: Back to top

Modelname	Time (CBC21)	Obj (CBC21)
`arki001`	`1803.4400`	`7581399.75958207`
`bc`	`1803.1200`	`7.00000000`
`bienst2`	`1800.7900`	`54.60000000`
`dano3mip`	`1887.0600`	`756.62500000`
`danoint`	`1801.4700`	`65.66666667`
`fast0507`	`1803.5600`	`179.00000000`
`mkc1`	`1801.1800`	`-607.20700000`
`mkc`	`1801.4000`	`-548.01200000`
`neos1`	`1801.4600`	`19.00000000`
`neos3`	`1801.6000`	`549.52300713`
`ran14x18`	`1803.4000`	`3736.00000000`
`set1ch`	`1802.7900`	`54537.75000000`
`seymour`	`1802.3400`	`431.00000000`
`swath`	`1802.0100`	`501.95221100`
`markshare1`	`1803.0900`	`10.00000000`
`markshare2`	`1802.5800`	`15.00000000`
`mas74`	`1802.9400`	`11801.18572900`
`noswot`	`1806.0200`	`-41.00000000`

CBC21: fail: Back to top

Modelname	Time (CBC21)	Status (CBC21)
`acc-tight-3`	`--`	`mstat(14) sstat( 3)`
`acc-tight-6`	`--`	`mstat(14) sstat( 3)`

CBC12: all -- CBC21: all : Back to top

Rows with light red background in the model name mark inconsistencies, caused by negative gaps or objective values of one solver that are better than the objestive estimate of the other solver.
A "(max)" behind a model names indicates that this model is a maximization model.

A model is counted as solved if the gap reported by the solver is at most 1e-5. For time and timeratios, a shifted geometric mean is used, where unsolved instances are counted with twice the timelimit (1800 seconds). The shift is 10s for time and 0.0001 for timeratios. For gaps, an arithmetic mean is used. Only instances with relative gap are counted. Instances without a gap are counted with 1.

Modelname	Time (CBC12)	Time (CBC21)	Ratio (CBC12/CBC21)	Obj (CBC12)	Obj (CBC21)	ObjEst (CBC12)	ObjEst (CBC21)	Gap (CBC12)	Gap (CBC21)
`10teams`	`1800.3200`	`50.7800`	---	`mstat(14) sstat( 2)`	`924.00000000`	---	`924.00000000`	`---`	`0.0000`
`acc-tight-0`	`36.1500`	`6.4600`	`5.596`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-1`	`397.4500`	`9.5200`	`41.749`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-2`	`NA`	`1402.1500`	---	`mstat(13) sstat(13)`	`0.00000000`	---	`0.00000000`	`---`	`0.0000`
`acc-tight-3`	`NA`	`1801.5100`	---	`mstat(13) sstat(13)`	`mstat(14) sstat( 3)`	---	---	---	---
`acc-tight-4`	`105.8300`	`3.8300`	`27.632`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`acc-tight-5`	`NA`	`367.3000`	---	`mstat(13) sstat(13)`	`0.00000000`	---	`0.00000000`	`---`	`0.0000`
`acc-tight-6`	`NA`	`1801.3600`	---	`mstat(13) sstat(13)`	`mstat(14) sstat( 3)`	---	---	---	---
`air03`	`5.0600`	`1.8800`	`2.691`	`340160.00000000`	`340160.00000000`	`340160.00000000`	`340160.00000000`	`0.0000`	`0.0000`
`air04`	`124.9700`	`226.1600`	`0.553`	`56137.00000000`	`56137.00000000`	`56137.00000000`	`56137.00000000`	`0.0000`	`0.0000`
`air05`	`348.7400`	`94.3600`	`3.696`	`26374.00000000`	`26374.00000000`	`26374.00000000`	`26374.00000000`	`0.0000`	`0.0000`
`arki001`	`1800.7300`	`1803.4400`	---	`mstat(14) sstat( 2)`	`7581399.75958207`	---	`7580417.05770240`	`---`	`0.0001`
`bal8x12`	`1.0100`	`0.2600`	`3.885`	`471.55000000`	`471.55000000`	`471.55000000`	`471.55000000`	`0.0000`	`0.0000`
`bc1`	`NA`	`1299.5800`	---	`mstat(13) sstat(13)`	`3.33836255`	---	`3.33836255`	`---`	`0.0000`
`bc`	`1801.5600`	`1803.1200`	---	`mstat(14) sstat( 2)`	`7.00000000`	---	`5.03262958`	`---`	`0.3909`
`bell3a`	`15.2900`	`2.6500`	`5.770`	`878430.31600000`	`878430.31600000`	`878430.31600000`	`878430.31600000`	`0.0000`	`0.0000`
`bienst1`	`NA`	`39.5700`	---	`mstat(13) sstat(13)`	`46.75000000`	---	`46.75000000`	`---`	`0.0000`
`bienst2`	`NA`	`1800.7900`	---	`mstat(13) sstat(13)`	`54.60000000`	---	`52.77974380`	`---`	`0.0345`
`binkar10_1`	`1801.6600`	`1571.8700`	---	`mstat(14) sstat( 2)`	`6742.20002400`	---	`6742.20002400`	`---`	`0.0000`
`bk4x3`	`0.0000`	`0.0100`	`---`	`350.00000000`	`350.00000000`	`350.00000000`	`350.00000000`	`0.0000`	`0.0000`
`blend2`	`14.1500`	`4.4400`	`3.187`	`7.59898500`	`7.59898500`	`7.59898500`	`7.59898500`	`0.0000`	`0.0000`
`cap6000`	`57.7900`	`259.8800`	`0.222`	`-2451377.00000000`	`-2451377.00000000`	`-2451377.00000000`	`-2451377.00000000`	`0.0000`	`0.0000`
`dano3_3`	`NA`	`209.1500`	---	`mstat(13) sstat(13)`	`576.34463303`	---	`576.34463303`	`---`	`0.0000`
`dano3_4`	`NA`	`265.1000`	---	`mstat(13) sstat(13)`	`576.43522471`	---	`576.43522471`	`---`	`0.0000`
`dano3_5`	`NA`	`658.1500`	---	`mstat(13) sstat(13)`	`576.92491596`	---	`576.92491596`	`---`	`0.0000`
`dano3mip`	`NA`	`1887.0600`	---	`mstat(13) sstat(13)`	`756.62500000`	---	`576.61143751`	`---`	`0.3122`
`danoint`	`1800.4100`	`1801.4700`	---	`mstat(14) sstat( 2)`	`65.66666667`	---	`63.64905485`	`---`	`0.0317`
`dcmulti`	`2.5200`	`6.3000`	`0.400`	`188182.00000000`	`188182.00000000`	`188182.00000000`	`188182.00000000`	`0.0000`	`0.0000`
`dsbmip`	`46.7700`	`1.5400`	`30.370`	`-306.76901203`	`-306.76901203`	`-306.76901203`	`-306.76901203`	`0.0000`	`0.0000`
`egout`	`0.0200`	`0.0400`	`---`	`568.10070000`	`568.10070000`	`568.10070000`	`568.10070000`	`0.0000`	`0.0000`
`enigma`	`14.6200`	`3.1900`	`4.583`	`0.00000000`	`0.00000000`	`0.00000000`	`0.00000000`	`0.0000`	`0.0000`
`fast0507`	`1811.0100`	`1803.5600`	---	`mstat(14) sstat( 2)`	`179.00000000`	---	`172.35111895`	`---`	`0.0386`
`fiber`	`4.4900`	`4.4300`	`1.014`	`405935.18000000`	`405935.18000000`	`405935.18000000`	`405935.18000000`	`0.0000`	`0.0000`
`fixnet6`	`8.7200`	`8.3700`	`1.042`	`3983.00000000`	`3983.00000000`	`3983.00000000`	`3983.00000000`	`0.0000`	`0.0000`
`gen`	`0.4800`	`0.2400`	`2.000`	`112313.36271800`	`112313.36271800`	`112313.36271800`	`112313.36271800`	`0.0000`	`0.0000`
`gesa2`	`89.8500`	`8.0200`	`11.203`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`0.0000`	`0.0000`
`gesa2_o`	`500.3600`	`36.7500`	`13.615`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`25779856.37169790`	`0.0000`	`0.0000`
`gesa3`	`5.2900`	`1.5900`	`3.327`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`0.0000`	`0.0000`
`gesa3_o`	`7.0600`	`15.5500`	`0.454`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`27991042.64838270`	`0.0000`	`0.0000`
`gr4x6`	`0.0200`	`0.0200`	`---`	`202.35000000`	`202.35000000`	`202.35000000`	`202.35000000`	`0.0000`	`0.0000`
`gt2`	`0.4700`	`1.0200`	`0.461`	`21166.00000000`	`21166.00000000`	`21166.00000000`	`21166.00000000`	`0.0000`	`0.0000`
`harp2`	`1800.8100`	`181.0900`	---	`mstat(14) sstat( 2)`	`-73899069.00000000`	---	`-73899069.00000000`	`---`	`0.0000`
`irp`	`87.6500`	`42.9500`	`2.041`	`12159.49283600`	`12159.49283600`	`12159.49283600`	`12159.49283600`	`0.0000`	`0.0000`
`khb05250`	`0.2800`	`0.6900`	`0.406`	`106940226.00000000`	`106940226.00000000`	`106940226.00000000`	`106940226.00000000`	`0.0000`	`0.0000`
`l152lav`	`35.7100`	`11.6000`	`3.078`	`4722.00000000`	`4722.00000000`	`4722.00000000`	`4722.00000000`	`0.0000`	`0.0000`
`lseu`	`2.1400`	`1.8500`	`1.157`	`1120.00000000`	`1120.00000000`	`1120.00000000`	`1120.00000000`	`0.0000`	`0.0000`
`mas284`	`63.5000`	`29.2400`	`2.172`	`91405.72368220`	`91405.72368220`	`91405.72368220`	`91405.72368220`	`0.0000`	`0.0000`
`mas76`	`424.9300`	`184.5200`	`2.303`	`40005.05414200`	`40005.05414200`	`40005.05414200`	`40005.05414200`	`0.0000`	`0.0000`
`misc03`	`9.8400`	`3.2200`	`3.056`	`3360.00000000`	`3360.00000000`	`3360.00000000`	`3360.00000000`	`0.0000`	`0.0000`
`misc06`	`0.8300`	`2.0300`	`0.409`	`12850.86073738`	`12850.86073738`	`12850.86073738`	`12850.86073738`	`0.0000`	`0.0000`
`misc07`	`95.1000`	`96.8000`	`0.982`	`2810.00000000`	`2810.00000000`	`2810.00000000`	`2810.00000000`	`0.0000`	`0.0000`
`mitre`	`8.6200`	`11.3200`	`0.761`	`115155.00000000`	`115155.00000000`	`115155.00000000`	`115155.00000000`	`0.0000`	`0.0000`
`mkc1`	`1800.6000`	`1801.1800`	---	`mstat(14) sstat( 2)`	`-607.20700000`	---	`-607.21000000`	`---`	`0.0000`
`mkc`	`1800.5000`	`1801.4000`	---	`mstat(14) sstat( 2)`	`-548.01200000`	---	`-571.95000135`	`---`	`0.0419`
`mod008`	`1.2200`	`4.5100`	`0.271`	`307.00000000`	`307.00000000`	`307.00000000`	`307.00000000`	`0.0000`	`0.0000`
`mod010`	`8.3100`	`0.8600`	`9.663`	`6548.00000000`	`6548.00000000`	`6548.00000000`	`6548.00000000`	`0.0000`	`0.0000`
`mod011`	`264.7600`	`169.2100`	`1.565`	`-54558535.01422730`	`-54558535.01422730`	`-54558535.01422730`	`-54558535.01422730`	`0.0000`	`0.0000`
`modglob`	`38.7200`	`12.8600`	`3.011`	`20740508.08630820`	`20740508.08630820`	`20740508.08630820`	`20740508.08630820`	`0.0000`	`0.0000`
`neos1`	`1800.6300`	`1801.4600`	---	`mstat(14) sstat( 2)`	`19.00000000`	---	`14.83297749`	`---`	`0.2809`
`neos2`	`30.9400`	`477.7900`	`0.009`	`454.86469703`	`454.86970173`	`454.86469703`	`+INF`	`0.0000`	`+INF`
`neos3`	`224.6600`	`1801.6000`	`0.062`	`368.84275100`	`549.52300713`	`368.84275100`	`-1794.26238767`	`0.0000`	`1.3063`
`neos4`	`168.6800`	`14.5000`	`11.633`	`-4.8603440750589E+10`	`-4.8603440750590E+10`	`-4.8603440750589E+10`	`-4.8603440750590E+10`	`0.0000`	`0.0000`
`neos5`	`165.2900`	`10.9200`	`15.136`	`-4.8603440750589E+10`	`-4.8603440750590E+10`	`-4.8603440750589E+10`	`-4.8603440750590E+10`	`0.0000`	`0.0000`
`neos6`	`1801.3700`	`1594.1900`	---	`mstat(14) sstat( 2)`	`83.00000000`	---	`83.00000000`	`---`	`0.0000`
`nw04`	`49.5300`	`28.7400`	`1.723`	`16862.00000000`	`16862.00000000`	`16862.00000000`	`16862.00000000`	`0.0000`	`0.0000`
`p0033`	`0.2400`	`0.0300`	`8.000`	`3089.00000000`	`3089.00000000`	`3089.00000000`	`3089.00000000`	`0.0000`	`0.0000`
`p0201`	`15.9700`	`8.2300`	`1.940`	`7615.00000000`	`7615.00000000`	`7615.00000000`	`7615.00000000`	`0.0000`	`0.0000`
`p0282`	`4.8200`	`4.2000`	`1.148`	`258411.00000000`	`258411.00000000`	`258411.00000000`	`258411.00000000`	`0.0000`	`0.0000`
`p0548`	`12.7100`	`0.3700`	`34.351`	`8691.00000000`	`8691.00000000`	`8691.00000000`	`8691.00000000`	`0.0000`	`0.0000`
`p2756`	`NA`	`7.3600`	---	`mstat(13) sstat(13)`	`3124.00000000`	---	`3124.00000000`	`---`	`0.0000`
`pk1`	`447.1800`	`95.2200`	`4.696`	`11.00000000`	`11.00000000`	`11.00000000`	`11.00000000`	`0.0000`	`0.0000`
`pp08acuts`	`763.5900`	`59.5200`	`12.829`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`0.0000`	`0.0000`
`pp08a`	`35.7800`	`49.0300`	`0.730`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`7350.00000000`	`0.0000`	`0.0000`
`prod1`	`123.2600`	`186.3900`	`0.661`	`-56.00000000`	`-56.00000000`	`-56.00000000`	`-56.00000000`	`0.0000`	`0.0000`
`qiu`	`1800.1100`	`318.1900`	---	`mstat(14) sstat( 2)`	`-132.87313695`	---	`-132.87313695`	`---`	`0.0000`
`qnet1`	`8.1900`	`6.6800`	`1.226`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`0.0000`	`0.0000`
`qnet1_o`	`5.9500`	`5.9600`	`0.998`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`16029.69268100`	`0.0000`	`0.0000`
`ran10x10a`	`10.4600`	`5.2200`	`2.004`	`1499.00000000`	`1499.00000000`	`1499.00000000`	`1499.00000000`	`0.0000`	`0.0000`
`ran10x10b`	`4.5800`	`2.3700`	`1.932`	`3073.00000000`	`3073.00000000`	`3073.00000000`	`3073.00000000`	`0.0000`	`0.0000`
`ran10x10c`	`12.0600`	`3.5700`	`3.378`	`13007.00000000`	`13007.00000000`	`13007.00000000`	`13007.00000000`	`0.0000`	`0.0000`
`ran10x12`	`9.6200`	`3.2300`	`2.978`	`2714.00000000`	`2714.00000000`	`2714.00000000`	`2714.00000000`	`0.0000`	`0.0000`
`ran10x26`	`537.9800`	`40.2900`	`13.353`	`4270.00000000`	`4270.00000000`	`4270.00000000`	`4270.00000000`	`0.0000`	`0.0000`
`ran12x12`	`248.1500`	`55.6300`	`4.461`	`2291.00000000`	`2291.00000000`	`2291.00000000`	`2291.00000000`	`0.0000`	`0.0000`
`ran12x21`	`1800.0200`	`275.5300`	---	`mstat(14) sstat( 2)`	`3664.00000000`	---	`3664.00000000`	`---`	`0.0000`
`ran13x13`	`534.5600`	`154.5000`	`3.460`	`3252.00000000`	`3252.00000000`	`3252.00000000`	`3252.00000000`	`0.0000`	`0.0000`
`ran14x18`	`1801.8300`	`1803.4000`	---	`mstat(14) sstat( 2)`	`3736.00000000`	---	`3566.84442142`	`---`	`0.0474`
`ran16x16`	`1800.0400`	`1599.3000`	---	`mstat(14) sstat( 2)`	`3823.00000000`	---	`3823.00000000`	`---`	`0.0000`
`ran17x17`	`251.3200`	`23.2400`	`10.814`	`1373.00000000`	`1373.00000000`	`1373.00000000`	`1373.00000000`	`0.0000`	`0.0000`
`ran4x64`	`9.3100`	`2.2900`	`4.066`	`9711.00000000`	`9711.00000000`	`9711.00000000`	`9711.00000000`	`0.0000`	`0.0000`
`ran6x43`	`4.2400`	`3.2800`	`1.293`	`6330.00000000`	`6330.00000000`	`6330.00000000`	`6330.00000000`	`0.0000`	`0.0000`
`ran8x32`	`1800.0100`	`27.6200`	---	`mstat(14) sstat( 2)`	`5247.00000000`	---	`5247.00000000`	`---`	`0.0000`
`rentacar`	`11.6400`	`8.0900`	`1.439`	`28882470.94755350`	`28882470.94755350`	`28882470.94755350`	`28882470.94755350`	`0.0000`	`0.0000`
`rgn`	`NA`	`4.0600`	---	`mstat(13) sstat(13)`	`82.19999924`	---	`82.19999924`	`---`	`0.0000`
`rlp2`	`97.6400`	`4.7000`	`20.774`	`19.00000000`	`19.00000000`	`19.00000000`	`19.00000000`	`0.0000`	`0.0000`
`rout`	`1801.5800`	`178.5100`	---	`mstat(14) sstat( 2)`	`1077.56000000`	---	`1077.56000000`	`---`	`0.0000`
`set1ch`	`1801.4900`	`1802.7900`	---	`mstat(14) sstat( 2)`	`54537.75000000`	---	`54266.88862148`	`---`	`0.0050`
`seymour1`	`1802.2400`	`1498.0300`	---	`mstat(14) sstat( 2)`	`410.76370139`	---	`410.76370139`	`---`	`0.0000`
`seymour`	`1802.0600`	`1802.3400`	---	`mstat(14) sstat( 2)`	`431.00000000`	---	`409.76245173`	`---`	`0.0518`
`stein27`	`2.1700`	`2.9400`	`0.738`	`18.00000000`	`18.00000000`	`18.00000000`	`18.00000000`	`0.0000`	`0.0000`
`stein45`	`57.4100`	`63.2600`	`0.908`	`30.00000000`	`30.00000000`	`30.00000000`	`30.00000000`	`0.0000`	`0.0000`
`swath1`	`579.6000`	`369.6800`	`1.568`	`379.07129575`	`379.07129575`	`379.07129575`	`379.07129575`	`0.0000`	`0.0000`
`swath2`	`1800.6400`	`871.4900`	---	`mstat(14) sstat( 2)`	`385.19969295`	---	`385.19969295`	`---`	`0.0000`
`swath`	`1800.6400`	`1802.0100`	---	`mstat(14) sstat( 2)`	`501.95221100`	---	`348.79997283`	`---`	`0.4391`
`vpm1`	`1.3800`	`0.1200`	`11.500`	`20.00000000`	`20.00000000`	`20.00000000`	`20.00000000`	`0.0000`	`0.0000`
`vpm2`	`9.6500`	`1.9700`	`4.898`	`13.75000000`	`13.75000000`	`13.75000000`	`13.75000000`	`0.0000`	`0.0000`
`markshare1`	`1803.9500`	`1803.0900`	---	`mstat(14) sstat( 2)`	`10.00000000`	---	`0.00000000`	`---`	`10.0000`
`markshare2`	`1803.0400`	`1802.5800`	---	`mstat(14) sstat( 2)`	`15.00000000`	---	`0.00000000`	`---`	`15.0000`
`mas74`	`1800.0400`	`1802.9400`	---	`mstat(14) sstat( 2)`	`11801.18572900`	---	`11621.83426653`	`---`	`0.0154`
`bell5`	`1802.7200`	`2.8600`	---	`mstat(14) sstat( 2)`	`8966406.49152000`	---	`8966406.49152000`	`---`	`0.0000`
`noswot`	`1800.5900`	`1806.0200`	---	`mstat(14) sstat( 2)`	`-41.00000000`	---	`-43.00000000`	`---`	`0.0465`
mean	209.57	88.58	2.67	---	---	---	---	0.38	0.07
unsolved	36.36%	18.18%