]> git.ipfire.org Git - thirdparty/openembedded/openembedded-core-contrib.git/commit
bitbake/codeparser: Improve cache handling
authorRichard Purdie <richard.purdie@linuxfoundation.org>
Fri, 27 May 2011 15:14:48 +0000 (16:14 +0100)
committerRichard Purdie <richard.purdie@linuxfoundation.org>
Fri, 27 May 2011 16:24:12 +0000 (17:24 +0100)
commit9f27563d66523f5af1028f173d53ee75e0877d46
treec9334c3ba6d4823ae05a42bde9a165c56a6728a0
parent18b6482ad19352d47b2f8145d28f6329d94f2d53
bitbake/codeparser: Improve cache handling

The current codeparser cache handling hurts performance badly even
over a couple of cores and certainly on many core systems, it can
spent huge amounts of time in the codeparser cache save functions.

This patch reworks the cache handling so that each parsing thread
saves out its own "differences" file compared to any existing core
cache and then the main bitbake thread picks these up and merges
things back together.

This was tested on systems with small and large numbers of cores
and was found to perform orders of magnitude better in all cases
despite the more complex code.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
lib/bb/codeparser.py
lib/bb/cooker.py