]> git.ipfire.org Git - thirdparty/openembedded/openembedded-core-contrib.git/log
thirdparty/openembedded/openembedded-core-contrib.git
9 years agooeqa/selftest/wic: add test case for sparse images
Joshua Lock [Fri, 8 Apr 2016 09:14:19 +0000 (10:14 +0100)] 
oeqa/selftest/wic: add test case for sparse images

Add a testcase to build a directdisk image and check that the
used disk size is less than the apparent size, as wic now
assembles images as sparse files.

(From OE-Core rev: 2b8299eb6b911e64d9a05b86c07b489d15eeaa5e)

Signed-off-by: Joshua Lock <joshua.lock@collabora.co.uk>
Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agowic/utils/partitionedfs.py: assemble .wic images as sparse files
Joshua Lock [Fri, 8 Apr 2016 09:14:18 +0000 (10:14 +0100)] 
wic/utils/partitionedfs.py: assemble .wic images as sparse files

The individual partitions created by wic are sparse but without
this change the assembled image is written as one (potentially
very) large file.

Preserve sparseness in the assembled image by passing the sparse
conversion symbol.

[YOCTO #9099]

(From OE-Core rev: 5fd592fbae2e046bcb8c3a6c3ef4993fe0400676)

Signed-off-by: Joshua Lock <joshua.lock@collabora.co.uk>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoimage-vm.bbclass/image_types.bbclass: IMAGE_NAME -> IMAGE_LINK_NAME
Robert Yang [Thu, 7 Apr 2016 13:33:27 +0000 (06:33 -0700)] 
image-vm.bbclass/image_types.bbclass: IMAGE_NAME -> IMAGE_LINK_NAME

If we create hdddirect in the first time, and run bitbake to create
vmimg in the second time, then the previouse created
${IMAGE_LINK_NAME}.hdddirect may can not be found since it contains the
data string which are different. Use IMAGE_LINK_NAME to fix the problem.

(From OE-Core rev: 4aa8f67867a05bdf4a5ba90c8235740910662847)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoimage_types.bbclass: fix elf
Robert Yang [Thu, 7 Apr 2016 13:27:37 +0000 (06:27 -0700)] 
image_types.bbclass: fix elf

Fixed:
| DEBUG: Executing shell function do_image_elf
| Cannot open `/path/to/tmp/sysroots/qemux86-64/usr/src/kernel/bzImage': (null)
| WARNING: exit code 1 from a shell command.

The bzImage is in DEPLOY_DIR_IMAGE

(From OE-Core rev: 24536aa578e483fc2a8594628befa4c78a05681c)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoimage_types.bbclass: set nodesize for btrfs
Robert Yang [Fri, 8 Apr 2016 07:15:19 +0000 (00:15 -0700)] 
image_types.bbclass: set nodesize for btrfs

The default value is 16K which is too big to create image for
core-image-minimal:
rootfs.btrfs is too small to make a usable filesystem
Minimum size for each btrfs device is 41943040.

Use 4K as ext2/3/4 to fix the problem.

(From OE-Core rev: a3e4dc0d800fbae3674b1657c872f70589fc893e)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolibxml2: fix AM_PATH_XML2
Robert Yang [Fri, 8 Apr 2016 10:14:21 +0000 (03:14 -0700)] 
libxml2: fix AM_PATH_XML2

The code: suppose $1 == 2.7:
verdep=ifelse([$1], [], [], [>= $1])
results in:
verdep=>= 2.7
This is wrong in shell:
bash: 2.7: command not found

Use quotation marks to fix the problem.

(From OE-Core rev: 190b57a5f130f8a48d417ad472c0131c49302ee1)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agouseradd_base.bbclass: prevent variable expansion in $opts
Mark Asselstine [Fri, 8 Apr 2016 21:46:27 +0000 (17:46 -0400)] 
useradd_base.bbclass: prevent variable expansion in $opts

Many user/group operations will involve hashes which will include '$'
followed by a number or even possibly an env. variable name. Passing
$opts to flock requires that we take additional precautions to prevent
the unexpected expansion of these instances.

This was found by an image which used usermod operations to set the
password hash for root. The image could not be logged-in to and
examining /etc/shadow clearly showed that $0 and other $* variables
had been expanded unexpectedly. This change returnes the behavior to
what existed prior to commit 2ebf697b46c42cee8bfa6d2e6087397f8cce385c
[useradd_base.bbclass: replace retry logic with flock].

(From OE-Core rev: d80065642c5a1c95a298b235a8d575460147ede1)

Signed-off-by: Mark Asselstine <mark.asselstine@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoextrausers.bbclass: drop retry count for perform_user/group* calls
Mark Asselstine [Fri, 8 Apr 2016 21:46:26 +0000 (17:46 -0400)] 
extrausers.bbclass: drop retry count for perform_user/group* calls

Commit 2ebf697b46c42cee8bfa6d2e6087397f8cce385c [useradd_base.bbclass:
replace retry logic with flock] dropped the 3rd (retry) parameter for
these functions. These are simply being ignored now but we should
remove the retry count to avoid confusion.

(From OE-Core rev: 4ec99da681a6cd164ae177554b23c4fdf2194e2a)

Signed-off-by: Mark Asselstine <mark.asselstine@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobuild-perf-test: add eSDK installed size to metrics
Ross Burton [Wed, 6 Apr 2016 15:59:03 +0000 (16:59 +0100)] 
build-perf-test: add eSDK installed size to metrics

(From OE-Core rev: 57040305dea7e2167adb47c136a7b85f09ee7d24)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agorpm: brace expansion is a bashism
Ross Burton [Wed, 6 Apr 2016 12:20:29 +0000 (13:20 +0100)] 
rpm: brace expansion is a bashism

The constuct rm *.{a,la} is a bashism and as tasks are run under /bin/sh this
may not work as expected.  Expand the {a,la} to two separate calls, and remove
the architecture-specific macro deletion as they are not installed in the first
place anymore.

(From OE-Core rev: 0edd06d15d2501ed0961681b56ecbb4ca5e75647)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoopenssl.inc: minor packaging cleanup
Andre McCurdy [Thu, 7 Apr 2016 00:42:05 +0000 (17:42 -0700)] 
openssl.inc: minor packaging cleanup

libcrypto.so was explicitly added to FILES_${PN}-dev as part of moving
libcrypto from libdir -> base_libdir to support dhclient [1].

However, the line has been unnecessary since ${base_libdir}/lib*.so
files started to be included in FILES_${PN}-dev by default [2] (and
it's still unnecessary now, after moving libcrypto from back to libdir
to support ntp [3]).

 [1] http://git.openembedded.org/openembedded-core/commit/?id=01ea85f7f6c53c66c76d6f832518b28bf06ec072
 [2] http://git.openembedded.org/openembedded-core/commit/?id=66c36bcb7d9368718453265e58bd5e3c854c786a
 [3] http://git.openembedded.org/openembedded-core/commit/?id=0be2ab32f690a2fcba0e821abe11460958bbc6dc

Also define FILES_libssl using SOLIBS instead of a hardcoded pattern.

(From OE-Core rev: 3f81b516e2f23683ce6129bb79bcc08263cb7fe1)

Signed-off-by: Andre McCurdy <armccurdy@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosystemd-systemctl-native: fix unit detection
Ross Burton [Wed, 6 Apr 2016 19:45:57 +0000 (20:45 +0100)] 
systemd-systemctl-native: fix unit detection

The regexs were too strict and didn't allow for trailing whitespace.

[ YOCTO #9337 ]

(From OE-Core rev: 0395162aa45a416db6a0a38e7ee6c0f808272393)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoapr-util: fix path in rules.mk for nativesdk
Robert Yang [Thu, 7 Apr 2016 07:34:32 +0000 (00:34 -0700)] 
apr-util: fix path in rules.mk for nativesdk

Fixed when build nativesdk-apr-util:
| gawk: fatal: can't open source file `/opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/share/build-1/make_exports.awk' for reading (No such file or directory)

The ${S} should be ${B}.

(From OE-Core rev: ba29845a5b9bf16cda2230540d7ce17d0f82e8fa)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobdwgc: installed-vs-shipped for nativesdk
Robert Yang [Thu, 7 Apr 2016 07:34:31 +0000 (00:34 -0700)] 
bdwgc: installed-vs-shipped for nativesdk

Fixed:
ERROR: nativesdk-bdwgc-7.4.2-r0 do_package: QA Issue: nativesdk-bdwgc: Files/directories were installed but not shipped in any package:
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/share
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/share/gc
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/share/gc/porting.html
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/share/gc/gcinterface.html
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/share/gc/gcdescr.html
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/share/gc/README.solaris2

[snip]

This was caused by hardcode of datadir.

(From OE-Core rev: 7bbe8e79f5c010a12b8b0ec2693d55539fd67994)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolibsolv: fix installed-vs-shipped for nativesdk
Robert Yang [Thu, 7 Apr 2016 07:34:30 +0000 (00:34 -0700)] 
libsolv: fix installed-vs-shipped for nativesdk

Fixed:
ERROR: nativesdk-libsolv-0.6.19-r0 do_package: QA Issue: nativesdk-libsolv: Files/directories were installed but not shipped in any package:
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man3
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man1
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man3/libsolv-constantids.3
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man3/libsolv.3
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man3/libsolv-history.3
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man3/libsolv-pool.3
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man3/libsolv-bindings.3
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man1/mergesolv.1
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man1/testsolv.1
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man1/installcheck.1
  /opt/poky/2.0+snapshot/sysroots/x86_64-pokysdk-linux/usr/man/man1/dumpsolv.1

It checks ${CMAKE_INSTALL_PREFIX}/share/man when configure, but it may
not exist when crosscompile, for example, when CMAKE_INSTALL_PREFIX="/",
it is OK, but when CMAKE_INSTALL_PREFIX="/some/path/else", then it
doesn't exist, and the man dir would be set to "/usr/man" which is
incorrect.

(From OE-Core rev: fc4d721e047989a3521267e26de123759741ffa3)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodesktop-file-utils-native: disable emacs
Robert Yang [Thu, 7 Apr 2016 09:54:24 +0000 (02:54 -0700)] 
desktop-file-utils-native: disable emacs

Fixed when len(TMPDIR) == 410:
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0    [vsyscall]
| /bin/bash: line 12:   903 Aborted    emacs --batch $am__subdir_includes -L

(From OE-Core rev: 23c375198d73a5dec4646b04e3fd1d4cb005565a)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agotoaster: add DL_DIR and SSTATE_DIR to oe toasterconf
Ed Bartosh [Wed, 6 Apr 2016 17:00:42 +0000 (18:00 +0100)] 
toaster: add DL_DIR and SSTATE_DIR to oe toasterconf

Add the DL_DIR and SSTATE_DIR to the toasterconf with defaults set

We now support per project sharing of the DL_DIR and SSTATE_DIR
in toaster.

(From OE-Core rev: 615da66f2c82accc138bc63907fa91115cac19a6)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agotoaster.bbclass: strip task from the target
Ed Bartosh [Thu, 7 Apr 2016 13:11:46 +0000 (14:11 +0100)] 
toaster.bbclass: strip task from the target

Current code in toaster_buildhistory_dump assumes that bitbake
target doesn't contain task name. It uses target as a part of
path to the files with data that it analizes. It fails to find
files if target contains task name. Stripping task from the
target should solve this.

(From OE-Core rev: 901c4f96c87bb557e747245685b7942624915670)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agox11-common: Add PACKAGECONFIG for screen blanking
Jussi Kukkonen [Thu, 7 Apr 2016 11:49:44 +0000 (14:49 +0300)] 
x11-common: Add PACKAGECONFIG for screen blanking

when "blank" is not in PACKAGECONFIG, explicitly set dpms and
screensaver off. The intention here is to make it easier to
create builds that should not blank the screen (just remove
"blank" from x11-common PACKAGECONFIG).

Also remove a unneeded "find -exec rm" from do_install.

Partly fixes [YOCTO #7278].

(From OE-Core rev: 32ac0bfb0167cb350be5d4b8faca490956dd7d93)

Signed-off-by: Jussi Kukkonen <jussi.kukkonen@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoopkg-utils: re-do find/ls code to not fail on filenames with spaces
Denys Dmytriyenko [Fri, 8 Apr 2016 04:57:08 +0000 (00:57 -0400)] 
opkg-utils: re-do find/ls code to not fail on filenames with spaces

(From OE-Core rev: e3e305135d258bee3ae30a2c7262b886d710b986)

Signed-off-by: Denys Dmytriyenko <denys@ti.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoimage-live.bbclass: fix iso + efi only
Robert Yang [Fri, 8 Apr 2016 02:20:25 +0000 (19:20 -0700)] 
image-live.bbclass: fix iso + efi only

When the user only builds iso + efi only, the syslinux-native which
provides isohybrid is required to build iso, so add syslinux-native to
DEPENDS.

(From OE-Core rev: dd1db8a578979a16d993a73b6f8a5720f2849932)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoAdd missing runtime dependency to python-pygobject
Chris Trobridge [Thu, 7 Apr 2016 20:18:12 +0000 (21:18 +0100)] 
Add missing runtime dependency to python-pygobject

(From OE-Core rev: c895676679b951836c909eb962190f5817662882)

Signed-off-by: Chris Trobridge <christrobridge@hotmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodevtool: Create unlocked-sigs.inc containing items in the workspace
Randy Witt [Thu, 7 Apr 2016 23:34:53 +0000 (16:34 -0700)] 
devtool: Create unlocked-sigs.inc containing items in the workspace

When a recipe is added to the workspace, the signatures for the tasks
will change. This means that bitbake must be told to allow the
signatures to be different if they are in locked-sigs.inc.

This is done by creating an unlocked-sigs.inc file which contains all
the recipes in the workspace each time devtool reads the workspace.

So not only will necessary things get added, previously added items will
be removed by virtue of them no longer being in the workspace.

This also makes sure that the extensible sdk picks up unlocked-sigs.inc
as part of the configuration.

[YOCTO #9195]

(From OE-Core rev: 6b2b5ffdcb8bf885a1c756ea132e9d2c55e13dcd)

Signed-off-by: Randy Witt <randy.e.witt@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosstatesig.py: Add a method to "unlock" recipes
Randy Witt [Thu, 7 Apr 2016 23:34:52 +0000 (16:34 -0700)] 
sstatesig.py: Add a method to "unlock" recipes

In order to support workflows using devtool where a user might want to
modify tasks that exist in locked-sigs.inc, there must be a way to unlock
recipes.

This patch adds that support by allowing the user to add recipes to
SIGGEN_UNLOCKED_RECIPES. Recipes that exist in that variable will have
all their tasks unlocked, as well as any tasks that depend on that
recipe.

For example if foo->bar->baz, if you unlock baz, it will also unlock bar
so that foo can be rebuilt without explicitly specifying bar as being
unlocked.

[YOCTO #9195]

(From OE-Core rev: 8a8fc54d824767a6a94d12a4ace98b0bdbb1aa25)

Signed-off-by: Randy Witt <randy.e.witt@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopopulate_sdk_ext.bbclass: Enable locked sigs errors
Randy Witt [Thu, 7 Apr 2016 23:34:51 +0000 (16:34 -0700)] 
populate_sdk_ext.bbclass: Enable locked sigs errors

With the extensible sdk we want there to be an error if a task tries to
run without signatures that match locked-sigs.inc. This patch enables
that error.

[YOCTO #9195]

(From OE-Core rev: fad9bbba1154d68b5dc808d2976aa6484cd49c91)

Signed-off-by: Randy Witt <randy.e.witt@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosstatesig.py: Improve the SIGGEN_LOCKEDSIGS_TASKSIG_CHECK message
Randy Witt [Thu, 7 Apr 2016 23:34:50 +0000 (16:34 -0700)] 
sstatesig.py: Improve the SIGGEN_LOCKEDSIGS_TASKSIG_CHECK message

The previous message when signatures didn't match between the metadata
and the locked signatures file, the message output was a bit confusing.

Now the message should be of the form:

The zlib-native:do_install sig is computed to be
53531910a2a7848432da89def942a91a, but the sig is locked to
d25ba9035f7ccb308e51bbe1066e8d27 in SIGGEN_LOCKEDSIGS_t-x86-64

which will hopefully be more useful in understanding the problem.

[YOCTO #9195]

(From OE-Core rev: 49eeabfff8bbea69401db41f7219e29acf47af73)

Signed-off-by: Randy Witt <randy.e.witt@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosstatesig.py: Split single locked sigs check into multiple checks
Randy Witt [Thu, 7 Apr 2016 23:34:49 +0000 (16:34 -0700)] 
sstatesig.py: Split single locked sigs check into multiple checks

Add the SIGGEN_LOCKEDSIGS_TASKSIG_CHECK and
SIGGEN_LOCKEDSIGS_SSTATE_EXISTS_CHECK variables to replace
SIGGEN_LOCKEDSIGS_CHECK_LEVEL.

SIGGEN_LOCKEDSIGS_TASKSIG_CHECK will no control whether there is a
warning or error if a task's hash in the locked signature file doesn't match
the computed hash from the current metadata.

SIGGEN_LOCKEDSIGS_SSTATE_EXISTS_CHECK will control whther there is a
warning or error if a task that supports sstate is in the locked
signature file, but no sstate exists for the task.

Previously you could only have warning/errors for both controlled by
SIGGEN_LOCKEDSIGS_CHECK_LEVEL. This was an issue in the extensible sdk,
because we know sstate won't exist for certain items in the reverse
dependencies list for tasks. However, we still want to error if task
signatures don't match.

[YOCTO #9195]

(From OE-Core rev: 0fe2a5e5ffd01e926d0f3d4c78ad9910296e2d1a)

Signed-off-by: Randy Witt <randy.e.witt@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agotoasterconf.json: Set default distro to nodistro
Khem Raj [Sat, 24 Oct 2015 23:39:38 +0000 (16:39 -0700)] 
toasterconf.json: Set default distro to nodistro

This makes it self-sufficient with OE-Core
Generate ext4 instead of ext3, most of Qemu
targets in oe-core now use ext4

(From OE-Core rev: 3d82961ce28866f0363a8cf1bbb2ffcaa9605a33)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodev-manual: Updated poky-floating-revisions file snippit example.
Scott Rifenbark [Fri, 8 Apr 2016 15:30:13 +0000 (08:30 -0700)] 
dev-manual: Updated poky-floating-revisions file snippit example.

Discovered typo in the file... "naivte" instead of "native".

Fixed.

(From yocto-docs rev: baa9fb2b553db425c8a5cfca04d913963e24d0a0)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodev-manual: set correct task name for do_kernel_configme
Yi Zhao [Fri, 8 Apr 2016 15:27:38 +0000 (08:27 -0700)] 
dev-manual: set correct task name for do_kernel_configme

(From yocto-docs rev: bb48ab8518ee89c23a251e98a011d652d6e49af8)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopoky-floating-revisions: Fix typo
Richard Purdie [Fri, 8 Apr 2016 15:24:15 +0000 (16:24 +0100)] 
poky-floating-revisions: Fix typo

(From meta-yocto rev: 8b8c3fa97826f76c3b21ae9bc7e7a99a7edafbf4)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agotoasterconf.json: Add DL_DIR and SSTATE_DIR to poky toasterconf
Sujith H [Wed, 6 Apr 2016 17:04:08 +0000 (18:04 +0100)] 
toasterconf.json: Add DL_DIR and SSTATE_DIR to poky toasterconf

Add the DL_DIR and SSTATE_DIR to the toasterconf with defaults set

We now support per project sharing of the DL_DIR and SSTATE_DIR
in toaster.

[YOCTO #8422]

(From meta-yocto rev: 3ef8917f03a3900585281a50168cffdff4e05d06)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobuild-appliance-image: Update to master head revision
Richard Purdie [Wed, 6 Apr 2016 22:54:57 +0000 (23:54 +0100)] 
build-appliance-image: Update to master head revision

(From OE-Core rev: 5ebea1114d54120d5ff5d8a6cd148110d0fda23f)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopoky: Convetion is 2.1, not 2.1.0
Richard Purdie [Wed, 6 Apr 2016 22:54:14 +0000 (23:54 +0100)] 
poky: Convetion is 2.1, not 2.1.0

(From meta-yocto rev: 35487c9e30a99c66d7a21483ae510cc0218efcd5)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobuild-appliance-image: Update to master head revision
Richard Purdie [Wed, 6 Apr 2016 22:34:09 +0000 (23:34 +0100)] 
build-appliance-image: Update to master head revision

(From OE-Core rev: 28e7f572041aa7b641eb83c988bd5421fa6a9b6c)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopoky.conf: Bump version for 2.1.0 krogoth release
Richard Purdie [Wed, 6 Apr 2016 22:29:44 +0000 (23:29 +0100)] 
poky.conf: Bump version for 2.1.0 krogoth release

(From meta-yocto rev: e1d41fc7971643f137c6df4391ecbbd66e434171)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: Update version to 1.30.0
Richard Purdie [Wed, 6 Apr 2016 22:31:27 +0000 (23:31 +0100)] 
bitbake: Update version to 1.30.0

(Bitbake rev: 292bffc8412cd0ddc0c6d16e872c7801e1a67890)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobuild-appliance-image: Update to master head revision
Richard Purdie [Wed, 6 Apr 2016 22:13:25 +0000 (23:13 +0100)] 
build-appliance-image: Update to master head revision

(From OE-Core rev: db701beaf4da2c83bf6e9c687901806cf686ad18)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodocumentation: Fixed references using the DISTRO_NAME variable
Scott Rifenbark [Wed, 6 Apr 2016 19:32:22 +0000 (12:32 -0700)] 
documentation: Fixed references using the DISTRO_NAME variable

With the introduction of a DISTRO_NAME_NO_CAP variable, the occurrences
of the DISTRO_NAME variable had to be checked to see if they really
should be using the "NO_CAP" variable instead.  Output and actual
branch names are case-sensitive.

(From yocto-docs rev: 711a3255538298dd3c4bd2af8ad13bc2d159c872)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodocumentation: Updated release date in manual history tables.
Scott Rifenbark [Wed, 6 Apr 2016 18:55:43 +0000 (11:55 -0700)] 
documentation: Updated release date in manual history tables.

Updated to "April 2016" for all manuals that use this table.

(From yocto-docs rev: 4d3753cc92c446668b0c383736c2071e24e53dd2)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodev-manual, ref-manual, sdk-manual: Removing oprofile references.
Scott Rifenbark [Wed, 6 Apr 2016 17:31:54 +0000 (10:31 -0700)] 
dev-manual, ref-manual, sdk-manual: Removing oprofile references.

Fixes [YOCTO #9264]

I handled the occurrences of "oprofile" and "tools-profile" throughout
as I could.  They are not all done yet.  These in this commit have
been removed.

(From yocto-docs rev: d76e264ea210846ad8080134bacd56462ba69d24)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoMakefile: Removed adt-manual support
Scott Rifenbark [Wed, 6 Apr 2016 00:32:40 +0000 (17:32 -0700)] 
Makefile: Removed adt-manual support

(From yocto-docs rev: 84abe03de1cff7952b5d0428e7433f094dde2b02)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agomega-manual: Removed the adt title .PNG file.
Scott Rifenbark [Wed, 6 Apr 2016 00:32:14 +0000 (17:32 -0700)] 
mega-manual: Removed the adt title .PNG file.

(From yocto-docs rev: b98f02b7ded825ef6bde3df0a201f9aaac9ebdfe)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoREADME: Updated to remove the ADT manual and add the SDK manual.
Scott Rifenbark [Wed, 6 Apr 2016 00:26:43 +0000 (17:26 -0700)] 
README: Updated to remove the ADT manual and add the SDK manual.

(From yocto-docs rev: 61474479f84e2f611684db152e7682275f8f19c3)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agomega-manual.sed: Removed adt-manual processing
Scott Rifenbark [Wed, 6 Apr 2016 00:21:08 +0000 (17:21 -0700)] 
mega-manual.sed: Removed adt-manual processing

(From yocto-docs rev: 4cbf38bf860ae0c21d87e7b761ad0d0d4b0a70ab)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoyocto-project-qs: Updated the minnowboard example.
Scott Rifenbark [Tue, 5 Apr 2016 20:02:43 +0000 (13:02 -0700)] 
yocto-project-qs: Updated the minnowboard example.

Fixes [YOCTO #9386]

Added some missing information:

 * Added instruction to be in the poky directory before cloning
   the meta-intel repository.

 * Removed the "source" part of the string for the bitbake-layer
   command.

 * Added text to describe that the user needs to be sure that the
   same branches are in play for poky and meta-intel before they
   launch the build.

(From yocto-docs rev: 65461624691a566a5849c6d9df7b269c3de2eba7)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopoky.ent: Added lower-case distro name variable.
Scott Rifenbark [Tue, 5 Apr 2016 20:00:51 +0000 (13:00 -0700)] 
poky.ent: Added lower-case distro name variable.

I added a variable named DISTRO_NAME_NO_CAP that can be used
to resolve to the branch name as it is needed on command lines
and as it appears in output.

(From yocto-docs rev: 595d81c31b0dcb442b351b05600da9480a9573b5)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agokernel-dev: Applied review comments to "Adding Recipe-Space Kernel Features"
Scott Rifenbark [Mon, 4 Apr 2016 20:51:15 +0000 (13:51 -0700)] 
kernel-dev: Applied review comments to "Adding Recipe-Space Kernel Features"

Fixes [YOCTO #4047]

I went through and fixed a few areas where reviewers said there
was "quirky" phrasing.  They might have been right in a few
places.

(From yocto-docs rev: 66fb97838f338ed3f787ec18f62702ef726ceffc)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoref-manual: Updated the PREFERRED_VERSION variable description.
Scott Rifenbark [Mon, 4 Apr 2016 20:35:40 +0000 (13:35 -0700)] 
ref-manual: Updated the PREFERRED_VERSION variable description.

Fixes [YOCTO #8595]

Applied some wording changes as part of the review process from
Richard Purdie.

(From yocto-docs rev: 3c4fc3cbdecb7e3c8287a915b82bc5469288d5db)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodev-manual: Added new section describing hardware and non-hardware config
Scott Rifenbark [Mon, 4 Apr 2016 20:10:27 +0000 (13:10 -0700)] 
dev-manual: Added new section describing hardware and non-hardware config

Fixes [YOCTO #5092]

Added a new subsection to the "Configuring the Kernel" section to
describe the part of the configuration audit phase that deals
with non-hardware and hardware options.

(From yocto-docs rev: 2545c3f2cf45ffcc9bf9f388d929c8242b74b011)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoref-manual: Updated verbiage on proxy handling
Scott Rifenbark [Fri, 1 Apr 2016 18:15:28 +0000 (11:15 -0700)] 
ref-manual: Updated verbiage on proxy handling

Fixes [YOCTO #9313]

Update the DL_DIR variable description to add a cross-reference
to the wiki page that talks about working behind a firewall.

Updated the 14.12 FAQ entry with new information about working
behind the firewall.

(From yocto-docs rev: 056e6881951023e62a7363ba60fe73cd6d2932b6)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoref-manual: Updated PREFERRED_VERSION variable description
Scott Rifenbark [Fri, 1 Apr 2016 17:14:25 +0000 (10:14 -0700)] 
ref-manual: Updated PREFERRED_VERSION variable description

Fixes [YOCTO #8595]

Added some examples on how to force the version.

(From yocto-docs rev: 4a98ce1ed623cd9763731453316f2ff8d8b8b82a)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoref-manual: Updated debugging tips and tricks
Scott Rifenbark [Thu, 31 Mar 2016 23:45:29 +0000 (16:45 -0700)] 
ref-manual: Updated debugging tips and tricks

Fixes [YOCTO #9336]

I updated the "Debugging" section within the "Tips and Tricks"
section.  The list of items did not provide detail on two
BitBake command-line options you could use to dump out
signature data into .sigdata files.  Also, the .sigdata files
were incorrectly referred to as .siginfo files.

(From yocto-docs rev: 7836c386f4f7c011de710b6ec9f6be13045dc559)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agokernel-dev: Added new "Adding Recipe-Space Kernel Features" section.
Scott Rifenbark [Thu, 31 Mar 2016 21:42:10 +0000 (14:42 -0700)] 
kernel-dev: Added new "Adding Recipe-Space Kernel Features" section.

Fixes [YOCTO #4047]

I added a new section describing how to add kernel features
from within a kernel recipe through the KERNEL_FEATURES
variable and the SRC_URI statement.

(From yocto-docs rev: d30925c65e3f49b2ba481f1e7f9cac98fe86f6af)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agokernel-dev: Updated the "Kernel Metadata Location" section.
Scott Rifenbark [Thu, 31 Mar 2016 21:26:53 +0000 (14:26 -0700)] 
kernel-dev: Updated the "Kernel Metadata Location" section.

Fixes [YOCTO #8272]

I re-wrote the section to basically consider kernel metadata
coming from either inside the recipe (recipe-space) or from
outside the recipe, which would be like a "kernel-cache".
The re-write eliminated the term "in-tree" regarding where
kernel metadata could reside.

(From yocto-docs rev: d358c00fbb779328bd472494023ecb802da15d59)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosdk-manual: Removed three sections of writer notes.
Scott Rifenbark [Thu, 31 Mar 2016 15:27:08 +0000 (08:27 -0700)] 
sdk-manual: Removed three sections of writer notes.

(From yocto-docs rev: f8aad4a55a38d4fe19dc8a83787e933c3fe15255)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosdk-manual: Applied review edits.
Scott Rifenbark [Tue, 29 Mar 2016 17:10:36 +0000 (10:10 -0700)] 
sdk-manual: Applied review edits.

(From yocto-docs rev: a00f0e593965063edc97672cdd70869d5d7ce179)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosdk-manual: Added sections in Appendix B.
Scott Rifenbark [Sat, 26 Mar 2016 18:10:13 +0000 (11:10 -0700)] 
sdk-manual: Added sections in Appendix B.

(From yocto-docs rev: 955f08c8d49fabd6022570e4d0a7442f06f6049b)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodev-manual, profile-manual: Removed oprofile section and link
Scott Rifenbark [Fri, 25 Mar 2016 18:37:16 +0000 (11:37 -0700)] 
dev-manual, profile-manual: Removed oprofile section and link

Fixes [YOCTO #9264]

I commented out a large section that had to do with running
oprofile.  Also, located and removed the link to that section
from the profile-manual.

(From yocto-docs rev: 63d6e754f994693c9a4d4b8211c6ef5f817c31f7)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: bitbake: update LICENSE file with QUnit details
Elliot Smith [Wed, 6 Apr 2016 13:49:13 +0000 (14:49 +0100)] 
bitbake: bitbake: update LICENSE file with QUnit details

QUnit is now included in Toaster's test suite and distributed
with its source code.

(Bitbake rev: 540c0c8d6aeec5391aa4f76614db6905afabba2c)

Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: tests: browser Add test to run the js unit tests
Michael Wood [Mon, 4 Apr 2016 10:52:49 +0000 (11:52 +0100)] 
bitbake: tests: browser Add test to run the js unit tests

(Bitbake rev: 81ccbf243050a5a9245d2de4c1de342771c09a59)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: views jsunittest Add MACHINE and an extra layer to test project
Michael Wood [Mon, 4 Apr 2016 10:47:31 +0000 (11:47 +0100)] 
bitbake: toaster: views jsunittest Add MACHINE and an extra layer to test project

Add set a MACHINE if needed and add a layer. When we're running in the
context of the django unit tests we don't have these defaults setup for
the project so add them.

(Bitbake rev: a0c1432f32930a17e10d50c08c2aa84a0659514b)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: tests Set MACHINE for the test projects
Michael Wood [Fri, 1 Apr 2016 10:47:32 +0000 (11:47 +0100)] 
bitbake: toaster: tests Set MACHINE for the test projects

(Bitbake rev: 6288a3bd6678ed1c7863cfde6eb33b7c28207777)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: Add quint to project so that it can be used offline
Michael Wood [Fri, 1 Apr 2016 10:32:35 +0000 (11:32 +0100)] 
bitbake: toaster: Add quint to project so that it can be used offline

Currently we're using a hosted version of quint however this means that the
testing has to be online or have a cached version of quint. Add the
files to Toaster to be able to use offline.

(Bitbake rev: fc5024e2ed0e4ec2ee234a42fd0403c70c3f819e)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: add rev dep column to image detail pages
Dave Lerner [Wed, 6 Apr 2016 13:44:41 +0000 (14:44 +0100)] 
bitbake: toaster: add rev dep column to image detail pages

Add a column to the custom image pages that shows the reverse
dependencies in a format matching the dependencies column:
  - either blank or a button showing the count of reverse dependencies,
  - when the button is clicked, a popover appears showing the list
    of reverse dependencies, with each package's size, and the total
    size of all of the reverse dependencies.

The implementation adds a packages table method to retreive the reverse
dependency total size, and adds a separate 'popover' html template. Both
of these changes follow the pattern for the dependencies column.

[YOCTO #9163]

(Bitbake rev: 2f978dccaa1ec82c7ad350bdc1cd9500000984eb)

Signed-off-by: Dave Lerner <dave.lerner@windriver.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: buildinfohelper: work around unicode exceptions
Joshua Lock [Wed, 6 Apr 2016 12:50:23 +0000 (13:50 +0100)] 
bitbake: buildinfohelper: work around unicode exceptions

We have been seeing UnicodeDecodeErrors when handling the
ImagePkgList MetadataEvent in ORMWrapper's
save_target_file_information() if the event includes filenames
that include non-ASCII characters.

In the short term work around this by converting paths to the
unicode type when passing them to Django's ORM. This is a bit of
a hack but it's too late in the cycle to do anything more invasive.

[YOCTO #9142]

(Bitbake rev: f50fff03b3de02e73a3cc2eb9935f7c345dbddc4)

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toasterui: update build in internal state
Ed Bartosh [Wed, 6 Apr 2016 16:46:48 +0000 (17:46 +0100)] 
bitbake: toasterui: update build in internal state

buildinfohelper stores current Build object in its internal
state. Any changes to Build object will be lost if internal
state is not updated as current buildinfohelper code
saves Build object from internal state when build is
completed.

This bug causes incorrect build state when build is cancelled.
Updating internal state should fix it.

Note, that this commit updates internal state after status of
the build is changed to Build.CANCELLED. There are several other
places in the code where Build object is updated without updating
internal state. They should be carefully analyzed and fixed.

(Bitbake rev: d056cf40fc55530cb1736aedfb9a3c355884991e)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: buildinfohelper: fix KeyError
Ed Bartosh [Wed, 6 Apr 2016 16:46:47 +0000 (17:46 +0100)] 
bitbake: buildinfohelper: fix KeyError

When bitbake doesn't need to build anything it still sends
ImagePkgList event with empty 'pkgdata', 'imgdata' and 'filedata'
fields. This causes crash in buildinfohelper code as it's assumed
that above mentioned fields always have data keyed by build target:

ERROR: u'core-image-minimal'
Traceback (most recent call last):
  File "toasterui.py", line 423, in main
    buildinfohelper.store_target_package_data(event)
  File "buildinfohelper.py", line 1218, in store_target_package_data
    imgdata = BuildInfoHelper._get_data_from_event(event)['imgdata'][target.target]
KeyError: u'core-image-minimal'

Fixed this by using dict.get method with empty dictionary as default
return value instead of trying to get value without checking if target
key is in the data.

(Bitbake rev: c39cc463e6d9594bf2c5ac8bb74e834f6f2cf7c8)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: get bitbake location from BBBASEDIR
Ed Bartosh [Wed, 6 Apr 2016 16:46:46 +0000 (17:46 +0100)] 
bitbake: toaster: get bitbake location from BBBASEDIR

It was incorrectly assumed in the current code that bitbake is in
../bitbake/bin/ directory. It's not always the case.
Using bitbake from $BBBASEDIR should be .

(Bitbake rev: 6c9e3375d278bee712c41f07428bc82108b9aaae)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: export BBBASEDIR variable
Ed Bartosh [Wed, 6 Apr 2016 16:46:45 +0000 (17:46 +0100)] 
bitbake: toaster: export BBBASEDIR variable

This variable will be used in localhost controller code
to determine correct bitbake location, so it has to be
exported.

(Bitbake rev: 429d47325aadb74d476e5b7f4738f2dfe26cde95)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: update projectconf.html for DL_DIR and SSTATE_DIR
Sujith H [Wed, 6 Apr 2016 16:46:44 +0000 (17:46 +0100)] 
bitbake: toaster: update projectconf.html for DL_DIR and SSTATE_DIR

Modified the projectconf.html to include DL_DIR and
SSTATE_DIR. Updated the script section in the html
to handle the changes made by the user on DL_DIR
and SSTATE_DIR. Included validation check for the
folder names.

[YOCTO #8422]

(Bitbake rev: bd9f8973d4c9c0722874a058466b1b911112500e)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: update view to support DL_DIR and SSTATE_DIR
Sujith H [Wed, 6 Apr 2016 16:46:43 +0000 (17:46 +0100)] 
bitbake: toaster: update view to support DL_DIR and SSTATE_DIR

Update toaster's views.py to support DL_DIR and SSTATE_DIR for
page projectconf.html. Removed DL_DIR and SSTATE_DIR from
blacklist. Initial value of DL_DIR and SSTATE_DIR comes from
BuildEnvironment.

[YOCTO #8422]

(Bitbake rev: 9f672d7ba503d17175eef37ec03a5779e4c9f792)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: use empty token
Ed Bartosh [Wed, 6 Apr 2016 16:46:42 +0000 (17:46 +0100)] 
bitbake: toaster: use empty token

If client xmlrpc token is not provided in the command line, bitbake
generates random token. Server token in --server-only mode is always
empty. This doesn't allow clients with non-empty tokens to connect
to the server. Specifying empty token should stop generation of
random token and make it possible for clients to communicate with
the server.

(Bitbake rev: b54ec2d7cb9f2fb4ff1e8af11b6ecf97d181272c)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: runbuilds Clean up runbuilds
Michael Wood [Wed, 6 Apr 2016 16:46:41 +0000 (17:46 +0100)] 
bitbake: toaster: runbuilds Clean up runbuilds

- Organise the imports into logical groups
- Fix 80 col wrapping
- Remove catch all exceptions
- Log to the toaster log
- Use QuerySet functions such as .first() and Q()

(Bitbake rev: c382f550c62437954205c7dd9c7e1891d5d03945)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: runbuilds Make runbuilds aware of the build CANCELLED state
Michael Wood [Wed, 6 Apr 2016 16:46:40 +0000 (17:46 +0100)] 
bitbake: toaster: runbuilds Make runbuilds aware of the build CANCELLED state

Add handlers to make sure we remove the BuildEnvironment LOCK when we
have cancelled a build.

(Bitbake rev: 23d0a7f9664450a09c2610631b38590a09b33744)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: models Exclude the CANCELLED builds from get_number_of_builds
Michael Wood [Wed, 6 Apr 2016 16:46:39 +0000 (17:46 +0100)] 
bitbake: toaster: models Exclude the CANCELLED builds from get_number_of_builds

Don't count CANCELLED builds when returning the number of builds.

(Bitbake rev: c3c29fd4eb5116b771e8e16281d4e3cdf4fae165)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: mrb_section template Add build cancel button
Michael Wood [Wed, 6 Apr 2016 16:46:38 +0000 (17:46 +0100)] 
bitbake: toaster: mrb_section template Add build cancel button

Add the cancel build button to the mrb section template and add the event
handlers to cancelABuild.
Also clean up the calls to startABuild to use the updated libtoaster methods
and to make the code consistent with it's cancelABuild counterpart.

Co-Author: Sujith H <sujith.h@gmail.com>

(Bitbake rev: 6b82ffca1aa9ca2d0feec64b15466bc8ba160011)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: tables BuildsTable exclude cancelled builds
Sujith H [Wed, 6 Apr 2016 16:46:37 +0000 (17:46 +0100)] 
bitbake: toaster: tables BuildsTable exclude cancelled builds

Exclude cancelled builds from showing in the builds table

[YOCTO #6787]

(Bitbake rev: a724d6aa7515e712a1d656e46e1d0f3bf7d4cea9)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: buildinfohelper: Add handler for cancelling a build
Michael Wood [Wed, 6 Apr 2016 16:46:36 +0000 (17:46 +0100)] 
bitbake: buildinfohelper: Add handler for cancelling a build

When a build is cancelled the build (action) is complete if it has been
caused the request being cancelled then update the build outcome
accordingly.

(Bitbake rev: d94d12914d351bf560b06d6f4e45c294b04ecaa3)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: bldcontrol models Add a cancelling state the BuildRequest
Michael Wood [Wed, 6 Apr 2016 16:46:35 +0000 (17:46 +0100)] 
bitbake: toaster: bldcontrol models Add a cancelling state the BuildRequest

To accurately reflect the state of a build request we also need a
cancelling state. This is set when we've started a build and then for
whatever reason cancel it, cancelling is not instantaneous so we have
this state to indicate that a cancel is in progress.

Also add a state transition guard. As the state of a BuildRequest can
currently be modified by three processes; Toastergui,
Runbuilds/bldcontrol and the buildinofhelper we cannot say for sure
which process will be running at the time of cancellation so in order to
avoid one of these processes making an incorrect transition only allow
transitions of state to increase.

e.g. CREATED -> QUEUED -> INPROGRESS
And to ignore such requested changes such as
INPROGRESS -> CREATED

(Bitbake rev: 449598c8e6be75bd0c9d59e7bdf859d1d6f83858)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: models Add cancelled state to build outcome
Sujith H [Wed, 6 Apr 2016 16:46:34 +0000 (17:46 +0100)] 
bitbake: toaster: models Add cancelled state to build outcome

A new state CANCELLED is introduced to, distinguish
the state of build.

[YOCTO #6787]

(Bitbake rev: 404f406fecae879703bcfe96f3b65086b115fa8a)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: update BuildEnvironmentController and BitbakeController
Sujith H [Wed, 6 Apr 2016 16:46:33 +0000 (17:46 +0100)] 
bitbake: toaster: update BuildEnvironmentController and BitbakeController

Remove getBBController function from BuildEnvironmentController.
The constructor of BitbakeController is updated appropriately so that
call can be made to connect to running server.
The call to startBBServer is removed from bbcontroller and  handledin
localhostbecontroller.

[YOCTO #6787]

(Bitbake rev: e15151106aae21d3b164ca868be42bd63905f0a1)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: libtoaster Update implementation of startABuild and cancelABuild
Michael Wood [Wed, 6 Apr 2016 16:46:32 +0000 (17:46 +0100)] 
bitbake: toaster: libtoaster Update implementation of startABuild and cancelABuild

Update the implementation of startABuild and cancelAbuild to reflect
changes to the backend api. We now have a dedicated endpoint to make
calls into so add this url to libtoaster.ctx and allow passing null in
as a url value to indicate that we want to use the current project

Also:
 - Fix some documentation comments
 - Add the convenience of passing in an array of targets to startABuild

(Bitbake rev: 61a21d96abab113cbd13376cdb8b08a426b50538)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: xhr Update the implementation of the build cancellation request
Michael Wood [Wed, 6 Apr 2016 16:46:31 +0000 (17:46 +0100)] 
bitbake: toaster: xhr Update the implementation of the build cancellation request

Update the implementation of the backend api for cancelling builds with
the new cancelling BuildRequest state and cancelled Build state.
Also added some docstring about general usage.

Co-Author: Sujith H <sujith.h@gmail.com>

(Bitbake rev: 0d76084f5d896e4199e1446e2d6d43190a4fcc3a)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: Move xhr calls for starting and stopping builds
Michael Wood [Wed, 6 Apr 2016 16:46:30 +0000 (17:46 +0100)] 
bitbake: toaster: Move xhr calls for starting and stopping builds

Move the backend xhr implementation of the build request changes
into it's own file and out of the ToasterTable definition.
It used to live in the views.py but in a hope of starting to collate logical
groups of views move this to a new file called api.

(Bitbake rev: 29572f0e6bd3b5e8315f3b93d55bdb8967b86bc3)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: bldcontrol Add forceShutDown function to BitbakeController
Sujith H [Wed, 6 Apr 2016 16:46:29 +0000 (17:46 +0100)] 
bitbake: toaster: bldcontrol Add forceShutDown function to BitbakeController

Add forceShutDown function to BitbakeController class. This function
provides a mechanism to cancel the build from toaster. An API which
can be used safely to cancel build and hence shutdown running bitbake
server.

[YOCTO #6787]

(Bitbake rev: 89dc2ee8f5b7255538082ce4f6cb5277839875a8)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toasterui: shutdown on BuildCompleted event
Ed Bartosh [Wed, 6 Apr 2016 16:46:28 +0000 (17:46 +0100)] 
bitbake: toasterui: shutdown on BuildCompleted event

toasterui exits event loop on one of the following events:
CommandCompleted, CommandFailed or CommandExit.
Unfortunately none of them come from bitbake when build fails.
This is normai if toasterui runs in observer mode. However, if it's
in build mode this causes toasterui to stuck in the infinite loop
waiting for new events.

The only event we can rely on is BuildCompleted as it always
comes from bitbake unlike 3 above mentioned events.

Modified the code to always shutdown toasterui in build mode
on BuildCompleted event.

(Bitbake rev: 9cd60f98b13cf7b1c518851a51e1cbaa596d8f81)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: use bash explicitly
Ed Bartosh [Wed, 6 Apr 2016 16:46:27 +0000 (17:46 +0100)] 
bitbake: toaster: use bash explicitly

Toaster can't run builds on Ubuntu as default /bin/sh points
to dash there. The reason is that oe-init-build-env can't
be sourced under dash for various reasons. It can be fixed
or work arounded, but it wouldn't fix builds for older releases.
Explicitly using bash to start builds should fix the issue.

(Bitbake rev: e4352603b21d43a8b5d9ee417c036fff0a263d40)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: fix jethro build
Ed Bartosh [Wed, 6 Apr 2016 16:46:26 +0000 (17:46 +0100)] 
bitbake: toaster: fix jethro build

The keys 'started', 'ended', 'cpu_time_user', 'disk_io_read' and
'disk_io_write' were added to the event recently, so they don't
exist in the events generated by bitbake server from older releases.

Checking if task_to_update structure has these keys before using
them should fix build of older releases.

(Bitbake rev: 79611d0ea742263074fbb0bf5f1e39df75fd9f55)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: update conf/local.conf
Ed Bartosh [Wed, 6 Apr 2016 16:46:25 +0000 (17:46 +0100)] 
bitbake: toaster: update conf/local.conf

Added 'INHERIT+="toaster buildhistory"' line to the conf/local conf
when Toaster starts. It should make commandline builds to provide
all required information to Toaster backend.

(Bitbake rev: 1271cf430087c66f87c46689b37b8a3538c35739)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: stop bitbake server after the build
Ed Bartosh [Wed, 6 Apr 2016 16:46:24 +0000 (17:46 +0100)] 
bitbake: toaster: stop bitbake server after the build

Bitbake server is used only during the build. There is no need
in keeping server running after the build.

Running bitbake -m in the subshell after the build should stop
the server.

(Bitbake rev: 062c68e3e7d00834118fe07ceb0899874be714ae)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: add new parameter to _shellcmd
Ed Bartosh [Wed, 6 Apr 2016 16:46:23 +0000 (17:46 +0100)] 
bitbake: toaster: add new parameter to _shellcmd

Added 'nowait' parameter to _shellcmd method to support
running chain of commands in a subshell.

This is going to be used to stop bitbake server after
the build.

(Bitbake rev: 89fae3c8712bfaac48686c58b480e40c1abdcfdc)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: reimplement triggerBuild
Ed Bartosh [Wed, 6 Apr 2016 16:46:22 +0000 (17:46 +0100)] 
bitbake: toaster: reimplement triggerBuild

Reimplemented triggerBuild method to support one build directory
per project:
 - start bitbake server from the cloned repository
 - don't run observer
 - run bitbake build directly instead of triggering it
   through xmlrpc

[YOCTO #7880]
[YOCTO #9058]
[YOCTO #8958]

(Bitbake rev: aba8e19bf609196f749e185d43571f706707e408)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: modified setLayers API
Ed Bartosh [Wed, 6 Apr 2016 16:46:21 +0000 (17:46 +0100)] 
bitbake: toaster: modified setLayers API

Removed updating of bblayers.conf. It will be done in runBuild method.
Changed return value: return list of layers.
Removed _updateBBLayers method.

(Bitbake rev: 198bf7e6b8d7f847f2619b71c6bd86a9a76156c9)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: add brbe parameter to triggerBuild
Ed Bartosh [Wed, 6 Apr 2016 16:46:20 +0000 (17:46 +0100)] 
bitbake: toaster: add brbe parameter to triggerBuild

Called triggerBuild with brbe parameter instead of adding TOASTER_BRBE
variable to the database and fetching it in triggerBuild.

(Bitbake rev: 669bb3f6865d8bb89cd94ef9d0eba3346c47d7b2)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: remove release API
Ed Bartosh [Wed, 6 Apr 2016 16:46:19 +0000 (17:46 +0100)] 
bitbake: toaster: remove release API

This API is quite dangerous as it removes build directory.
It's not used anywhere and most probably will not be used in future
as toaster is going to have one build directory per project.

(Bitbake rev: ef9e126227d3bdee86c1592e2baa43d21e6a32df)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: remove startBBServer API
Ed Bartosh [Wed, 6 Apr 2016 16:46:18 +0000 (17:46 +0100)] 
bitbake: toaster: remove startBBServer API

We still will have to run bitbake server, but it will be done
different way and the code will be in triggerBuild function.

Removed startBBServer API from BuildEnvironmentController and
LocalhostBEController classes.

(Bitbake rev: a8f986d73a84f28fa8b116b91fb30c5d2cd4edbe)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toasterui: fix brbe reporting
Ed Bartosh [Wed, 6 Apr 2016 16:46:17 +0000 (17:46 +0100)] 
bitbake: toasterui: fix brbe reporting

buildinfohelper.brbe is lost when buildinfohelper is closed.
This causes incorrect report of brbe when build is done.

Saved brbe attribute before closing buildinfohelper and used
it to report correct brbe.

Got rid of useless and confusing 'ToasterUI build done 1'
log message.

(Bitbake rev: 5d7cce0d0ed70f6b3ebd6cbad300d86964a13398)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: buildinfohelper: improve handling of providermap
Ed Bartosh [Wed, 6 Apr 2016 16:46:16 +0000 (17:46 +0100)] 
bitbake: buildinfohelper: improve handling of providermap

DepTreeGenerated event doesn't contain 'providermap' data in jethro.
Modified buildinfohelper to handle events without this data. This
should make it possible to handle jethro events coming from jethro
bitbake server by the latest buildinfohelper.

(Bitbake rev: f6dcb1c9967f042beae024146781cb8235a9e1f2)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: uievent: improve BBUIEventQueue code
Ed Bartosh [Wed, 6 Apr 2016 16:46:15 +0000 (17:46 +0100)] 
bitbake: uievent: improve BBUIEventQueue code

Return value of self.BBServer.registerEventHandler differs between
jethro and master. To be able to build jethro toaster should be
able to communicate with jethro bitbake server i.e. it must work
with both old and new registerEventHandler call.

(Bitbake rev: f356c154016c428a3b53af61a075de6f14d9d1d9)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>