]> git.ipfire.org Git - thirdparty/openembedded/openembedded-core-contrib.git/log
thirdparty/openembedded/openembedded-core-contrib.git
8 years agowic: add /boot mount point to fstab by default
Ed Bartosh [Fri, 28 Jul 2017 09:29:27 +0000 (12:29 +0300)] 
wic: add /boot mount point to fstab by default

wic avoided adding /boot to fstab for no reason.
This exception was hardcoded in the wic code.

There is no need for this as mountpoint in .wks file is an optional
field. It can be used only if user wants to have partitions
automatically mounted on system boot.

[YOCTO #11662]

(From OE-Core rev: 2376b05512ddb8c4ec3aaf1df11071f536a76bd9)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: rootfs: make copied rootfs unique
Ed Bartosh [Fri, 28 Jul 2017 09:29:26 +0000 (12:29 +0300)] 
wic: rootfs: make copied rootfs unique

Used unique suffix (line number from .wks file) for the
copied rootfs directory to avoid possible conflicts.

(From OE-Core rev: 01efc234a8caab67ed3138ab2de9bbd82ce97b44)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: rootfs: fix rootfs path reporting
Ed Bartosh [Fri, 28 Jul 2017 09:29:25 +0000 (12:29 +0300)] 
wic: rootfs: fix rootfs path reporting

wic gets rootfs paths from partition object property
'rootfs_dir' and shows them in final report.

rootfs plugin sets this property to the temporary path,
which causes temporary paths appearing in the report.

Changed the code to prevent storing temporary rootfs path
in part.rootfs_dir. This should fix the report.

(From OE-Core rev: 28d2d7d6f79df08431187c7debaab2a3fa516671)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: use absolute paths in rootfs plugin
Ed Bartosh [Fri, 28 Jul 2017 09:29:24 +0000 (12:29 +0300)] 
wic: use absolute paths in rootfs plugin

Using relative paths can cause copyhardlinktree API to fail as
it changes current directory when working. Converted all paths
to absolute paths using os.path.realpath.

(From OE-Core rev: a1c83cebe986e211dfc31be5cbd748f53fc298df)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: copy rootfs directory before changing fstab
Ed Bartosh [Tue, 25 Jul 2017 11:26:36 +0000 (14:26 +0300)] 
wic: copy rootfs directory before changing fstab

wic updates /etc/fstab on root partition if there are
valid mount points in .wks

When wic runs from bitbake this can cause incorrect results
or even breakage of other tasks working with the same rootfs
directory in parallel with do_image_wic.

Implemented copying rootfs directory to a temporary location
using copyhardlinktree before updating fstab to avoid conflicts with
other tasks working with the same rootfs directory.

(From OE-Core rev: 92e1c7d47e695eb4ce1a863cd0f6c49dca1c2339)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage_types.bbclass: ignore tar exit code 1
Ed Bartosh [Fri, 28 Jul 2017 09:29:22 +0000 (12:29 +0300)] 
image_types.bbclass: ignore tar exit code 1

tar exists with 1 and produces warning "file changed as we read it"
if content is changed while tar archives it. Even hardlinking content
causes tar to fail this way as it changes file ctime.

Other tasks running in parallel with do_image_tar may need to hardlink
rootfs content in order to change it, e.g. do_image_wic does this to
update etc/fstab.

Ignored tar exit code 1 to be able to hardlink rootfs content while
do_rootfs_tar is tarring it.

[RP: Removed bashism]

(From OE-Core rev: 402b4cffbb4c58cfee93db18192f2b218ee0ae35)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosystemtap: ensure systemtap-native is available
Saul Wold [Tue, 25 Jul 2017 01:58:25 +0000 (18:58 -0700)] 
systemtap: ensure systemtap-native is available

Since we are adding the addto_sysroot that that is specific to the
native recipe, we must split this into a seperate -native .bb recipe.

When systemtap-native is built, the intention is that it's usable
from the native sysroot when done, ensure it's there with a forced
addto_recipe_sysroot task, we also don't want to clean the sysroot
when RM_WORK is enabled otherwise we loose the binaries.

[YOCTO #11403]

(From OE-Core rev: 98fba18e93abe8efce0a5b40d51e178c9de4d1e5)

Signed-off-by: Saul Wold <sgw@linux.intel.com>
(cherry picked from commit 2fdb59741b4fdeaa4aee10812c4a409cdc11a02d)
Signed-off-by: Saul Wold <sgw@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agooeqa/core/runner: OEStreamLogger don't buffer test execution writes
Aníbal Limón [Wed, 26 Jul 2017 15:04:10 +0000 (10:04 -0500)] 
oeqa/core/runner: OEStreamLogger don't buffer test execution writes

Since OEQA framework uses Python logging functionality to report test
results there is a class that wraps PyUnit writes into logging commands
(OEStreamLogger), so don't buffer the actual test execution to have
insight of what is currently executing.

This fix will change a little the test output format adding an '\n'
previous the test result, for example:

From:

test_nonmatching_checksum (lic_checksum.LicenseTests) ... ok

To:

test_nonmatching_checksum (lic_checksum.LicenseTests)
 ... ok

This is because the new line added by the PyUnit StreamLogger because
currently we don't have a manner to identify when a test execution
starts at report level (write msg).

[YOCTO #11827]

(From OE-Core rev: 4c2276469f58a88f864eb374c00dbbaace702de4)

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agooeqa/{core,selftest}: Add support to validate if a specified test case isn't found
Aníbal Limón [Wed, 26 Jul 2017 15:04:09 +0000 (10:04 -0500)] 
oeqa/{core,selftest}: Add support to validate if a specified test case isn't found

If some test module/case is specified to run and isn't found the OEQA
framework didn't notice it, so complete the implementation using
modules_required and validate for the test case prescense.

Raise an exception when the test module/case required isn't found.

[YOCTO #11645]

(From OE-Core rev: e50b415aaaa1581473f85f0a8afa278b5f95129b)

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolibpcre: upgrade 8.40 -> 8.41
Andrej Valek [Fri, 21 Jul 2017 14:59:03 +0000 (16:59 +0200)] 
libpcre: upgrade 8.40 -> 8.41

(From OE-Core rev: 07c5eb7f9232ecd4a094040cbe85af2727bd2bd5)

Signed-off-by: Andrej Valek <andrej.valek@siemens.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoncurses: add SYSROOT_DESTDIR for siteconfig_gencache
Jackie Huang [Wed, 31 May 2017 08:27:16 +0000 (16:27 +0800)] 
ncurses: add SYSROOT_DESTDIR for siteconfig_gencache

After switching to Recipe Specific Sysroots, ncurses
will not be populated in its own sysroots, then
siteconfig_gencache fails to find some headers,
so add ${SYSROOT_DESTDIR}/${includedir} into the
search list to fix the issue.

(From OE-Core rev: 2ef34f7fb60ecdff29aae1d54a90a2e765c15e1e)

Signed-off-by: Jackie Huang <jackie.huang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agositeinfo: fix siteinfo_get_files to work with RSS
Jackie Huang [Wed, 31 May 2017 08:27:17 +0000 (16:27 +0800)] 
siteinfo: fix siteinfo_get_files to work with RSS

The siteconfig cache files in ACLOCALDIR setup by autotools.bbclass
has been dropped after switching to RSS, so change the siteconfig
search path back to SITECONFIG_SYSROOTCACHE and the parameter
name changed from aclocalcache to sysrootcache.

(From OE-Core rev: 5b1454304483a0bc725b32fd5458e5281c68112f)

Signed-off-by: Jackie Huang <jackie.huang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodebianutils: set higher priority than busybox for run-parts
Jackie Huang [Tue, 25 Jul 2017 08:38:55 +0000 (16:38 +0800)] 
debianutils: set higher priority than busybox for run-parts

debianutils-run-parts should have higher priority than
busybox (which is 50), so set the priority to 60 for
debianutils-run-parts.

(From OE-Core rev: 56f6fc7d6de0a46046ea2abcc392b1da88e398ec)

Signed-off-by: Jackie Huang <jackie.huang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopackage/bbclass: sources are packaged separately from debug.
Juan M Cruz Alcaraz [Tue, 25 Jul 2017 23:07:52 +0000 (16:07 -0700)] 
package/bbclass: sources are packaged separately from debug.

The configuration variable PACKAGE_DEBUG_SPLIT_STYLE includes
the new mode debug-with-srcpkg that instructs the system to
remove the source files from the debug package but include them in
a separate package with a "-src" suffix in the name.

[YOCTO #9998]

(From OE-Core rev: b8f9ffa37f67172a01837c88c861dc736d267569)

Signed-off-by: Juan M Cruz Alcaraz <juan.m.cruz.alcaraz@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agomodule.bbclass: move make scripts earlier
California Sullivan [Thu, 27 Jul 2017 18:14:06 +0000 (11:14 -0700)] 
module.bbclass: move make scripts earlier

Some out of tree modules require the scripts for configuration. For
example, backport-iwlwifi.

(From OE-Core rev: 7a045f6df2366026d28fe8d36e6d594ce5aa559a)

Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoRevert "core-image-minimal-initramfs: use initramfs-framework by default"
Richard Purdie [Sat, 29 Jul 2017 20:08:43 +0000 (21:08 +0100)] 
Revert "core-image-minimal-initramfs: use initramfs-framework by default"

This reverts commit 28fc6ba761ed4a47efa7c43e7f7dff5e2fe72b5e since it causes
runqemu.RunqemuTests.test_boot_machine_iso and runqemu.RunqemuTests.test_boot_deploy_hddimg
to fail in oe-selftest.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobsp/help: include a warning showing deprecation of create-layer plugin
Leonardo Sandoval [Tue, 25 Jul 2017 22:41:55 +0000 (15:41 -0700)] 
bsp/help: include a warning showing deprecation of create-layer plugin

This plugin will be removed starting 2.5 development in favour
of using 'bitbake-layers create-layer' script/plugin, offering a single
script to manage layers.

(From meta-yocto rev: 76dd79e345d8edb22fc7aefd31f2a1f150916718)

Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: tests/fetch: fix GitShallowTest.test_bitbake
Christopher Larson [Fri, 28 Jul 2017 19:47:53 +0000 (13:47 -0600)] 
bitbake: tests/fetch: fix GitShallowTest.test_bitbake

`git fetch --tags` seems to interact badly with `mirror=fetch`, resulting in
the regular branches not being fetched, so drop the unnecessary `--tags`. This
fixes this unit test failure: `bb.fetch2.FetchError: Fetcher failure: Unable
to resolve 'master' in upstream git repository in git ls-remote output for
/tmp/tmp4ag_mgmn/gitsource`

[YOCTO #11698]

(Bitbake rev: 2d0203fae08c5ff8dc3e9afaa9a819abc4a1af6f)

Signed-off-by: Christopher Larson <chris_larson@mentor.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: main: Always return 0 for bitbake --kill-server
Richard Purdie [Fri, 28 Jul 2017 15:19:56 +0000 (16:19 +0100)] 
bitbake: main: Always return 0 for bitbake --kill-server

If the server isn't running return 0 as to do otherwise complicates
scripts which do cleanup of bitbake servers which would potentially
be memory resident.

(Bitbake rev: 0f85c54385f325f3ebbf911b35bbac11b8863b6b)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Clean up server communication timeout errors
Richard Purdie [Fri, 28 Jul 2017 14:46:20 +0000 (15:46 +0100)] 
bitbake: process: Clean up server communication timeout errors

This timeout path was commonly hit due to errors starting the server. Now we
have a better way to handle that, the retry logic can be improved and cleaned
up. This patch:

* Makes the timeout 5s rather than intervals of 1s with a message. Paul
  noted some commands can take around 1s to run on a server which has just
  been started on a loaded system.
* Allows a broke connection to exit immediately rather than retrying something
  which will never work.
* Drops the Ctrl+C masking, we shouldn't need that anymore and any issues
  would be better handled in other ways.

This should make things clearer and less confusing for users and is much cleaner
code too.

(Bitbake rev: 8633b7cd03cfaba3e0359aa5da22fc76b66768c7)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Don't leak open pipes upon reconnection
Richard Purdie [Fri, 28 Jul 2017 14:42:50 +0000 (15:42 +0100)] 
bitbake: process: Don't leak open pipes upon reconnection

If we reconnect to the server, stop leaking pipes and clean up
after ourselves.

(Bitbake rev: f41e4e971e807157be68cf4496580494b8b60643)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process/cooker: Allow UI process to know if the cooker was started successfully
Richard Purdie [Fri, 28 Jul 2017 14:40:02 +0000 (15:40 +0100)] 
bitbake: process/cooker: Allow UI process to know if the cooker was started successfully

Currently if the server fails to start, the user sees no error message and
the server will be repeatedly attempted to be started until some longer
timeouts expire. There are error messages in the cookerdeamon log but
nobody thinks to look there.

Add in a pipe which can be used to tell the starting process whether the cooker
did actually start or not. If it fails to start, no further attempts can be
made and if present, the log file can be shown to the user.

[YOCTO #11834]

(Bitbake rev: 57000d44beb1aeba37dfc70782b0d6418943acc5)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Move socket keep alive into BitBakeProcessServerConnection
Richard Purdie [Fri, 28 Jul 2017 14:37:29 +0000 (15:37 +0100)] 
bitbake: process: Move socket keep alive into BitBakeProcessServerConnection

This cleans up the socket keep alive into better class structured code
and adds cleanup of the open file descriptors upon shutdown.

(Bitbake rev: 77fd3a3a29a569e212374b27aea742ddbaafcdd5)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Allow BBUIEventQueue to exit cleanly
Richard Purdie [Fri, 28 Jul 2017 14:33:32 +0000 (15:33 +0100)] 
bitbake: process: Allow BBUIEventQueue to exit cleanly

Currently the monitoring thread exits with some error code or runs indefinitely. Allow
closure of the pipe its monitoring to have the thread exit cleanly/silently.

(Bitbake rev: 930d077637928213e13a07c78fee3bf7a8c37ebf)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Ensure ConnectionReader/Writer have fileno() and close() methods
Richard Purdie [Fri, 28 Jul 2017 14:32:25 +0000 (15:32 +0100)] 
bitbake: process: Ensure ConnectionReader/Writer have fileno() and close() methods

Expose the underlying close() and fileno() methods which allow connection
monitoring and cleanup.

(Bitbake rev: f79187f4ebfad7969be47b429995e7f7a3e33c1e)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: event: Don't write duplicate logs to stdout and stderr in no UI case
Richard Purdie [Fri, 28 Jul 2017 14:27:28 +0000 (15:27 +0100)] 
bitbake: event: Don't write duplicate logs to stdout and stderr in no UI case

This code would duplicate messages to stdout and stderr when no UI connected
and there were error level messages.

Rework the code so it either uses stderr (for errors and above) or
stdout for warnings/debug but not both for the same messages.

(Bitbake rev: 45cff5734ba2ba8c8d36d17d722a5804d39b258b)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoyocto-project-qs, ref-manual: Upgraded tar to 1.27 from 1.24
Scott Rifenbark [Wed, 26 Jul 2017 00:05:45 +0000 (17:05 -0700)] 
yocto-project-qs, ref-manual: Upgraded tar to 1.27 from 1.24

The minimum version of tar is now 1.27. This was changed in both
the yocto-project-qs and ref-manual.

(From yocto-docs rev: b0fe513e08de860e94a3617fd62382430e321c77)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodev-manual: Added Links for specific container use
Scott Rifenbark [Tue, 25 Jul 2017 23:57:04 +0000 (16:57 -0700)] 
dev-manual: Added Links for specific container use

At the end of the section that describes how to set up the
development machine for CROPS, I added some user links for more
information based on the type of container the use is interested
in.

(From yocto-docs rev: 6888d8454839bbb2ecdf96ce421c7d8723931d65)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodev-manua: Added Crops setup section.
Scott Rifenbark [Fri, 21 Jul 2017 20:57:25 +0000 (13:57 -0700)] 
dev-manua: Added Crops setup section.

(From yocto-docs rev: e2ba131b98705f98463030dde043d858b500690d)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodev-manual: Added steps to set up native linux host
Scott Rifenbark [Thu, 20 Jul 2017 15:14:00 +0000 (08:14 -0700)] 
dev-manual: Added steps to set up native linux host

Fixes [YOCTO #11630]

Added content for steps to set up a native Linux host for using
the Yocto Project.

(From yocto-docs rev: d8a18d382c584dbdfa7f5f190a92cc7cde0f9601)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agocore-image-minimal-initramfs: use initramfs-framework by default
Ng, Wei Tee [Sun, 23 Jul 2017 23:51:57 +0000 (16:51 -0700)] 
core-image-minimal-initramfs: use initramfs-framework by default

Use the initramfs-framework for initialization by default due to
the modularity and expansibility.

[YOCTO #10987]

(From OE-Core rev: 28fc6ba761ed4a47efa7c43e7f7dff5e2fe72b5e)

Signed-off-by: Ng, Wei Tee <wei.tee.ng@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoinitramfs-framework: include install-efi module in recipe for installation
Ng, Wei Tee [Sun, 23 Jul 2017 23:51:56 +0000 (16:51 -0700)] 
initramfs-framework: include install-efi module in recipe for installation

Utilized the existing init-install-efi.sh script and renamed it to
install-efi.sh to manage the installation process of images in
initramfs-framework model. This script will be executed when
"install" option is being chosen in the grub menu and install
the image on the target platform. A new install-efi module is
being added in the recipe to handle the installation process
using initramfs-framework.

[YOCTO #10989]

(From OE-Core rev: 41b34441c22143cbabace3d794ead05801afb7a0)

Signed-off-by: Ng, Wei Tee <wei.tee.ng@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoinitramfs-framework: module to support boot live image
Ng, Wei Tee [Sun, 23 Jul 2017 23:51:55 +0000 (16:51 -0700)] 
initramfs-framework: module to support boot live image

setup-live module is a new module being introduced to integrate the
functionality of init-live.sh into new scriptlet named setup-live in
order to support the live boot image. The udev-extraconf rdepends is
being added to perform automounting. It gets to run before the rootfs
and finish module.

The setup-live scriplet include the changes for:

- Create a conditional loop for the bootparam_root variable. If it is
not set, then it will boot from ROOT_IMAGE. Else, it will boot normally
which is not from removable media.

- Gives a standard path to the original boot disk mount which can be
used to. While /media/sda is a good guess, it isn't always right, nor
is it a good assumption that only one boot disk is in the system.

- The current rootfs module has no support for rootfs images, currently
it only support for rootfs partitions for wic image. Therefore, there
is a need to assign the rootfs image for live image.

[YOCTO #11701]

(From OE-Core rev: 4d3300e85a8e65207a415b9cf84c9fa1f71b0406)

Signed-off-by: Ng, Wei Tee <wei.tee.ng@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodbus/dbus-test: upgrade to 1.10.20
Chen Qi [Mon, 24 Jul 2017 09:51:13 +0000 (17:51 +0800)] 
dbus/dbus-test: upgrade to 1.10.20

(From OE-Core rev: 96c54b2ceee7cdeb40efaa3f224766c5ea65d181)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosysstat: upgrade to 11.5.7
Chen Qi [Mon, 24 Jul 2017 09:51:12 +0000 (17:51 +0800)] 
sysstat: upgrade to 11.5.7

(From OE-Core rev: 6ee5abcc67c35d390d12bbc906787b87df80be3b)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosudo: upgrade to 1.8.20p2
Chen Qi [Mon, 24 Jul 2017 09:51:11 +0000 (17:51 +0800)] 
sudo: upgrade to 1.8.20p2

The checksum for doc/LICENSE is changed, but the content only changes
year from '2013' to '2017', so the license remains the same.

(From OE-Core rev: e1d27852bf21be49db574ed207bc90d42c4bd898)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agocups: upgrade to 2.2.4
Chen Qi [Mon, 24 Jul 2017 09:51:10 +0000 (17:51 +0800)] 
cups: upgrade to 2.2.4

(From OE-Core rev: 6547285f855d9826c2055ea97ceb07eb81aeb841)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodiffutils: upgrade to 3.6
Chen Qi [Mon, 24 Jul 2017 09:51:09 +0000 (17:51 +0800)] 
diffutils: upgrade to 3.6

diffutils-3.5-gcc7.patch is removed as it's merged in this version.

do_configure_prepend is removed to solve the following configure error.

  error: possibly undefined macro: gl_TYPE_WINT_T_PREREQ

A workaround patch is made to fix the following compilation error for glibc.

  error: dereferencing pointer to incomplete type 'const struct rpl_option'

(From OE-Core rev: 0c09f9f5700696670b2a9d0466124309100eb296)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopciutils: upgrade to 3.5.5
Chen Qi [Mon, 24 Jul 2017 09:51:08 +0000 (17:51 +0800)] 
pciutils: upgrade to 3.5.5

(From OE-Core rev: d1e05e9cbddea40ff582fae4ec7e2e7a4f52fd8f)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowebkitgtk: update to 2.16.6
Alexander Kanavin [Mon, 24 Jul 2017 14:28:17 +0000 (17:28 +0300)] 
webkitgtk: update to 2.16.6

(From OE-Core rev: 198ccdbefa481f725492b5d8834213fe26431be5)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agompg123: update to 1.25.4
Alexander Kanavin [Mon, 24 Jul 2017 14:28:15 +0000 (17:28 +0300)] 
mpg123: update to 1.25.4

(From OE-Core rev: 97a4e2d564807caba5e527d95871972464c261c6)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agovala: upgrade to 0.36.4
Alexander Kanavin [Mon, 24 Jul 2017 14:28:13 +0000 (17:28 +0300)] 
vala: upgrade to 0.36.4

(From OE-Core rev: 03d0beec5b5e6cadbda398a28c754811a71e529e)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoepiphany: upgrade to 3.24.3
Alexander Kanavin [Mon, 24 Jul 2017 14:28:11 +0000 (17:28 +0300)] 
epiphany: upgrade to 3.24.3

(From OE-Core rev: 10de5bf834bf95af05fa8b1c67f0f42a47c6a34e)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobash-completion: upgrade to 2.7
Alexander Kanavin [Mon, 24 Jul 2017 14:28:10 +0000 (17:28 +0300)] 
bash-completion: upgrade to 2.7

(From OE-Core rev: ec5938795c44163303d8708d3386947567c05f28)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobtrfs-tools: upgrade to 4.11.1
Alexander Kanavin [Mon, 24 Jul 2017 14:28:09 +0000 (17:28 +0300)] 
btrfs-tools: upgrade to 4.11.1

(From OE-Core rev: c1152321e3bcf7a61103d77759da17575155225c)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoicu: update to 59.1
Alexander Kanavin [Mon, 24 Jul 2017 14:28:08 +0000 (17:28 +0300)] 
icu: update to 59.1

License checksum change due to copyright year update.

Latest icu will not compile with anything less than C++11, so
drop the enforcement of an earlier C++ version. This should be okay,
as there is now a fix in place for the problem of mixing native gcc 4/5
compiled code:
http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=c21cec84886d9c70396e9be0ceb9a8ef300b54be

(From OE-Core rev: b002f44ed5a07b42deb8cccdb192e12091cd654f)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agomirrors.bbclass: provide git repo fallbacks using the https protocol
Andre McCurdy [Wed, 26 Jul 2017 00:18:36 +0000 (17:18 -0700)] 
mirrors.bbclass: provide git repo fallbacks using the https protocol

Use MIRRORS to provide git repo fallbacks using the https protocol,
for cases where git native protocol fetches may fail due to local
firewall rules, etc.

These rules should cover all git native repos used by recipes within
oe-core, with the exception of mtd-utils, for which there's currently
no upstream alternative to the git native protocol for anonymous
access ( see http://git.infradead.org/mtd-utils.git ).

(From OE-Core rev: abb8895d5b42a5dc171360a261a2652acd14ee7e)

Signed-off-by: Andre McCurdy <armccurdy@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agognu-config: update SRC_URI to new savannah.gnu.org hostname
Andre McCurdy [Wed, 26 Jul 2017 00:18:35 +0000 (17:18 -0700)] 
gnu-config: update SRC_URI to new savannah.gnu.org hostname

http://sv.gnu.org/ now redirects to http://savannah.gnu.org/

(From OE-Core rev: cf21f45fc7fa7a70df48e9eb6bdf38d0aa902f9b)

Signed-off-by: Andre McCurdy <armccurdy@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agokernel-devsrc: Remove .kernel-meta from package
sweeaun [Wed, 26 Jul 2017 00:25:00 +0000 (17:25 -0700)] 
kernel-devsrc: Remove .kernel-meta from package

[YOCTO #11730]

Include .kernel-meta directory in the prune list of the find to
prevent .kernel-meta directory included into installable package.

(From OE-Core rev: 3bcf227dc68f215b2d4d7b58aeea71d237ac719e)

Signed-off-by: sweeaun <swee.aun.khor@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoeudev: update to 3.2.2
Alexander Kanavin [Wed, 26 Jul 2017 10:41:02 +0000 (13:41 +0300)] 
eudev: update to 3.2.2

(From OE-Core rev: b3175533438801a4244bc2eb102fd72613f74289)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoharfbuzz: upgrade to 1.4.7
Maxin B. John [Wed, 26 Jul 2017 13:47:27 +0000 (16:47 +0300)] 
harfbuzz: upgrade to 1.4.7

1.4.6 -> 1.4.7

(From OE-Core rev: c05beaee30f4389fb59693e6690ab156214bcc74)

Signed-off-by: Maxin B. John <maxin.john@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agogo: centralize definition of COMPATIBLE_HOST
Joe Slater [Wed, 26 Jul 2017 22:14:23 +0000 (15:14 -0700)] 
go: centralize definition of COMPATIBLE_HOST

Put it in goarch.bbclass which all go related recipes inherit.

(From OE-Core rev: 9e899bbc081cb932c1492f6d6802b908d70ef42f)

Signed-off-by: Joe Slater <jslater@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage_types_wic: add dependency to e2fsprogs-native
Ed Bartosh [Wed, 26 Jul 2017 16:21:30 +0000 (19:21 +0300)] 
image_types_wic: add dependency to e2fsprogs-native

Added e2fsprogs-native to the list of default dependencies for
wic (WKS_FILE_DEPENDS_DEFAULT) as all fs-related utilities
have to be in this list.

Thanks to Patrick Ohly for noticing this.

[YOCTO #11817]

(From OE-Core rev: b1d9f5ba5d75c6e4dae10d9d9b2c03fd3099721d)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agooe-selftest: wic: change mkfs.btrfs options
Ed Bartosh [Wed, 26 Jul 2017 16:22:29 +0000 (19:22 +0300)] 
oe-selftest: wic: change mkfs.btrfs options

test_mkfs_extraopts test case fails on ab with error caused
by using -K --mixed options:
 output: extent-tree.c:2696: btrfs_reserve_extent: BUG_ON `ret` triggered, value -28

For this test case it's not important to use particular options,
so changing options to anything less influential is OK.

Changed extra options for mkfs.btrfs to '--quiet' to fix the failure.

(From OE-Core rev: 6a1489f8deb2b26181ca340a0f6ef62aa18a5188)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agorpm: allow to enable RPM file signing
Lans Zhang [Thu, 27 Jul 2017 06:03:42 +0000 (14:03 +0800)] 
rpm: allow to enable RPM file signing

RPM file signing is enabled with --with-imaevm during configuration.
If enabled, the RPM signing tool rpmsign will call libimaevm.so provided
by the recipe ima-evm-utils.

(From OE-Core rev: 9d7797e4374c111f0dff523fd49354bcc33dc2af)

Signed-off-by: Lans Zhang <jia.zhang@windriver.com>
Signed-off-by: Jia Zhang <lans.zhang2008@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic-tools: add dependency to e2fsprogs-native
Ed Bartosh [Thu, 27 Jul 2017 06:54:04 +0000 (09:54 +0300)] 
wic-tools: add dependency to e2fsprogs-native

Added e2fsprogs-native to the list of dependencies for wic-tools
as all fs-related utilities have to be in this list.

(From OE-Core rev: d0ebcf62109d6a131e02cd4c0f04bba203ed6579)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agorunqemu: chmod 0o777 for lockdir
Robert Yang [Wed, 12 Apr 2017 02:04:31 +0000 (02:04 +0000)] 
runqemu: chmod 0o777 for lockdir

Multi-users may run qemu on the same host, all of them should be able to
create or remove lock in lockdir, so set lockdir's mode to 0o777.

Note, os.mkdir()'s mode is default to 0o777, but the current umask value is
first masked out, so use os.chmod() to set it.

(From OE-Core rev: 4a5d21dbdc88982c2c90e660811b84983eaebeb7)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agorunqemu: validate combos
Robert Yang [Thu, 13 Jul 2017 08:09:34 +0000 (01:09 -0700)] 
runqemu: validate combos

Error out ealier if the combos is invalid, e.g.:
$ runqemu tmp/deploy/images/qemux86/bzImage-qemux86.bin tmp/deploy/images/qemux86/core-image-minimal-qemux86.wic

This will fail at kernel panic, no we check and error out early. We can
add other checkings in the future.

[YOCTO #11286]

(From OE-Core rev: 8c6f253dfb4899324e91dd5d082190909e2bd25d)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agorunqemu: check tar.bz2 and .tar.gz
Robert Yang [Thu, 13 Jul 2017 07:31:17 +0000 (00:31 -0700)] 
runqemu: check tar.bz2 and .tar.gz

Handle them as nfs, so that cmd like the following can be boot:
$ runqemu tmp/deploy/images/qemux86/core-image-minimal-qemux86.tar.bz2

[YOCTO #11286]

(From OE-Core rev: 552093d1f60ca335d95bcfc9d6070ec551ebe6c0)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agorunqemu: check qbconfload before running bitbake
Robert Yang [Thu, 13 Jul 2017 07:28:46 +0000 (00:28 -0700)] 
runqemu: check qbconfload before running bitbake

If qbconfload (.qemuboot.conf is found) is present, we can get
DEPLOY_DIR_IMAGE from it rather than "bitbake -e".

(From OE-Core rev: 89e97033a8a27a695567c321ed0ebf17f23f8d9b)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agorunqemu: add --debug and --quiet
Robert Yang [Thu, 13 Jul 2017 06:05:47 +0000 (23:05 -0700)] 
runqemu: add --debug and --quiet

And move some debug info into logger.debug(), this can make it easy to
read key messages like errors or warnings.

I checked meta/lib/oeqa/ they don't depend on these messages. And I have
run "oe-selftest -a", it doesn't break anything.

[YOCTO #10474]

(From OE-Core rev: e696425e7627edada128b40304fddc84d8d56ba7)

Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: bitbake-diffsigs: fix regression after recent server changes
Paul Eggleton [Thu, 27 Jul 2017 12:51:49 +0000 (14:51 +0200)] 
bitbake: bitbake-diffsigs: fix regression after recent server changes

We were bridging the gap between the server and UI here by calling a
bb.siggen.find_siginfo, a function defined and set on that module from
the metadata. This worked from the UI side before but since the recent
server changes is no longer accessible. Create a new command so this can
execute on the server side and return the result by way of a new event.

(We're still running compare_sigfiles() on the signature generator but
that isn't quite the same thing and does still work.)

Fixes [YOCTO #11844].

(Bitbake rev: fdcea991baa4f83d9c98d468d7b49c8c388a4a15)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: lib/fetch2/__init__.py: Fix unpack comment
Mark Hatle [Wed, 26 Jul 2017 15:20:35 +0000 (10:20 -0500)] 
bitbake: lib/fetch2/__init__.py: Fix unpack comment

(Bitbake rev: b8f477de204ab5d0680b2b7c42370d13395be46c)

Signed-off-by: Mark Hatle <mark.hatle@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: lib/bb/utils.py: Add missing debug level
Mark Hatle [Wed, 26 Jul 2017 15:20:34 +0000 (10:20 -0500)] 
bitbake: lib/bb/utils.py: Add missing debug level

(Bitbake rev: a0cd748d2f830a305da086eff3462875f64f2a70)

Signed-off-by: Mark Hatle <mark.hatle@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agognome-themes-standard: Fix packages so dev-pkgs image generation works
Richard Purdie [Wed, 26 Jul 2017 08:52:43 +0000 (09:52 +0100)] 
gnome-themes-standard: Fix packages so dev-pkgs image generation works

A change from Ross removed the dual -dev/-dbg packages but this broke
deb/ipk rootfs constuction due to a dependency on a package which doesn't
exist (for dev-pkgs images). Remove the dependency on that package to
allow images to build.

(From OE-Core rev: 51b3ee298635b11d5784caaa0ac1c8f4034c25a5)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: fetch2/__init__.py: replace stray logger.warn() with logger.warning()
Andre McCurdy [Tue, 25 Jul 2017 21:30:01 +0000 (14:30 -0700)] 
bitbake: fetch2/__init__.py: replace stray logger.warn() with logger.warning()

Update stray usage of deprecated logger.warn(), which was introduced
to fetch2/__init__.py after all other instances had been replaced by
logger.warning():

  http://git.openembedded.org/bitbake/commit/?id=5a53e7d7b017769a6eb0f0a6335735a1fe51a5ec
  http://git.openembedded.org/bitbake/commit/?id=676a5f592e8507e81b8f748d58acfea7572f8796

(Bitbake rev: 1b14f115a9e929e29e91e8ac70826a3fe7259961)

Signed-off-by: Andre McCurdy <armccurdy@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage: Fix "metadata is not deterministic" when chaining 2+ CONVERSION_CMDs
Tom Rini [Tue, 25 Jul 2017 19:58:09 +0000 (15:58 -0400)] 
image: Fix "metadata is not deterministic" when chaining 2+ CONVERSION_CMDs

When we have more than one CONVERSION_CMD being used, for example
ext4.gz.sha256sum we will see errors about "metadata is not
deterministic".  This is because we do not have a stable order of
intermediate files that will be removed in the generated shell command.
We fix this by calling sorted() on the set of rm_tmp_images so that we
will have a stable hash again.

Cc: Patrick Ohly <patrick.ohly@intel.com>
(From OE-Core rev: 98a2afeb3a53bec7a72a4a9846e1dba636cc6f3d)

Signed-off-by: Tom Rini <trini@konsulko.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agooeqa/buildperf: Add 'bitbake -m' on sync function to ensure bitbake is unloaded
Jose Perez Carranza [Tue, 25 Jul 2017 20:06:28 +0000 (13:06 -0700)] 
oeqa/buildperf: Add 'bitbake -m' on sync function to ensure bitbake is unloaded

Add 'bitbake -m' to the sync method and ensure all process related to
bitbake are correctly unloaded before doing the different measurements.
Also add a call to sync funtion on Test4 before final measurment of
eSDK deploy dir disk usage.

(From OE-Core rev: 9210c9ce051dfffaa7afa36bb4a926cea289ffd4)

Signed-off-by: Jose Perez Carranza <jose.perez.carranza@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agovalgrind: fix upstream version check
Alexander Kanavin [Mon, 24 Jul 2017 14:28:18 +0000 (17:28 +0300)] 
valgrind: fix upstream version check

(From OE-Core rev: f4e86314dac536755b2489a5b442b0f36909cae5)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agooprofile: fix upstream version check
Alexander Kanavin [Mon, 24 Jul 2017 14:28:16 +0000 (17:28 +0300)] 
oprofile: fix upstream version check

(From OE-Core rev: 7ca10a92b9f7a9102d44e3b110a485917fa0224a)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage_types.bbclass: Make u-boot signed images more versatile
Tom Rini [Fri, 21 Jul 2017 22:06:34 +0000 (18:06 -0400)] 
image_types.bbclass: Make u-boot signed images more versatile

With the introduction of chaining compression/conversion support we can
convert the old image_types_uboot.bbclass code that did a hand-chaining
of a set of ${filesystem}.${compression} into generic and arbitrary
support to sign whatever the user wants to sign for their image.

This, for the record, does remove setting a valid compression type in
the record in favour of just saying none.  This is not a generally
useful feature in U-Boot and I believe being versatile in terms of being
able to pass in arbitrary compressions is more important.

(From OE-Core rev: 65f27122950a35a67ce39ae4cfe93d0dca6b0dab)

Signed-off-by: Tom Rini <trini@konsulko.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage.bbclass: Correct chaining compression support
Tom Rini [Fri, 21 Jul 2017 22:06:33 +0000 (18:06 -0400)] 
image.bbclass: Correct chaining compression support

When chaining of compression/conversion types was added, we had a new
way to handle doing things like "ext4.bz2.sha256sum" or
"ext2.gz.u-boot".  However, because the U-Boot image class isn't
included normally, it wasn't properly converted at the time.  After the
support was added the "clean" argument that the .u-boot code uses no
longer functions.  The fix for this inadvertently broke chaining
compression/conversion.  First, correct the u-boot conversion code.

Fixes: 46bc438374de ("image.bbclass: do exact match for rootfs type")
Cc: Zhenhua Luo <zhenhua.luo@nxp.com>
Cc: Richard Purdie <richard.purdie@linuxfoundation.org>
Cc: Patrick Ohly <patrick.ohly@intel.com>
(From OE-Core rev: 0a7ce0b971a208956cb895ba5a869ec8c5d94703)

Signed-off-by: Tom Rini <trini@konsulko.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopackage_rpm.bbclass: disable generation of .build-id links
Alexander Kanavin [Mon, 24 Jul 2017 15:27:03 +0000 (18:27 +0300)] 
package_rpm.bbclass: disable generation of .build-id links

As we're not using them and they're getting in the way of
reproducibility.

[YOCTO #11718]

(From OE-Core rev: 1bd3ed18379c330c1c733dc9f043dbbe8aa0d254)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agognome-themes-standard: don't generate multiple -dev and -dbg packages
Ross Burton [Tue, 25 Jul 2017 11:51:52 +0000 (12:51 +0100)] 
gnome-themes-standard: don't generate multiple -dev and -dbg packages

(From OE-Core rev: b56e33fa439429f6d93860a49653ba1b16e00bbb)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolibpng: use SourceForge mirror
Ross Burton [Mon, 24 Jul 2017 20:34:49 +0000 (21:34 +0100)] 
libpng: use SourceForge mirror

The Gentoo mirror also deletes old versions when they're not used, so revert
back to the canonical SourceForge site, adding /older-releases/ to MIRRORS to
handle new releases moving the version we want.

Original idea by Maxin B. John <maxin.john@intel.com>.

(From OE-Core rev: 791a3493c88c9c249f21f6d893b2061e1d8a0af6)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoelfutils: use HTTP instead of FTP to fetch
Ross Burton [Mon, 24 Jul 2017 14:17:38 +0000 (15:17 +0100)] 
elfutils: use HTTP instead of FTP to fetch

FTP is inferiour to HTTP is all respects, so use the HTTP URL for the tarball.

(From OE-Core rev: 6a9e38be6e9dcbeff033944f9a3a18e3838af10d)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoexternalsrc: place copy of git index into /tmp and do not use copyfile2
Enrico Scholz [Mon, 24 Jul 2017 11:14:02 +0000 (13:14 +0200)] 
externalsrc: place copy of git index into /tmp and do not use copyfile2

Using shutil.copy2() to copy .git/index to a temporary file tries to
copy SELinux attributes which might fail for confined users in SELinux
environments.

E.g. our builders are running in docker containers and modification of
sources (inclusive updated of .git/index) is done outside.  Trying to
copy .git/index fails with

| $ python3 -c 'import shutil; shutil.copy2("index", "a")'
| ...
| PermissionError: [Errno 13] Permission denied: 'a'

and an AVC like

| denied  { relabelto } for  pid=18043 comm="python3" name="a" dev="dm-29" ino=1067553 scontext=system_u:system_r:container_t:s0:c39,c558 tcontext=unconfined_u:object_r:build_file_t:s0 tclass=file permissive=0

is created.  This can not be solved by adapting the SELinux policy because
this is a very deep constraint violation:

| constrain file { create relabelfrom relabelto } ((u1 == u2 -Fail-)  or (t1 == can_change_object_identity -Fail-) ); Constraint DENIED
|
| Possible cause is the source user (system_u) and target user (unconfined_u) are different.

I do not see much sense in using 'shutil.copy2()' here; 'shutil.copyfile()'
seems to be a better choice (target file is created in a secure way by
tempfile.NamedTemporaryFile()).

By placing the tempfile into /tmp we avoid potential problems related to
git's 'core.sharedRepository'.  As a (positive) side effect, the source
tree will not be modified anymore (at least by this part of code) which
prevented to mount it read-only from somewhere else.

(From OE-Core rev: 3c3c8ecc61dfed68987750d79b5482ab2f6fa02f)

Signed-off-by: Enrico Scholz <enrico.scholz@sigma-chemnitz.de>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobuildtools-tarball: drop deltask package/packagedata
Ming Liu [Mon, 24 Jul 2017 05:01:25 +0000 (07:01 +0200)] 
buildtools-tarball: drop deltask package/packagedata

They are redundant since nopackages are being inherited.

(From OE-Core rev: 71af69fa898e5614920710ca9e0cea832a2401e4)

Signed-off-by: Ming Liu <peter.x.liu@external.atlascopco.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agouninative-tarball: drop deltask package/packagedata
Ming Liu [Mon, 24 Jul 2017 04:59:12 +0000 (06:59 +0200)] 
uninative-tarball: drop deltask package/packagedata

They are redundant since nopackages are being inherited.

(From OE-Core rev: 2414e9f286d34af2db5982a988b78362decb7961)

Signed-off-by: Ming Liu <peter.x.liu@external.atlascopco.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopackage-index: inherit nopackages
Ming Liu [Mon, 24 Jul 2017 04:55:52 +0000 (06:55 +0200)] 
package-index: inherit nopackages

Drop deltask do_package* syntax, inheriting nopackages instead.

(From OE-Core rev: 2eee6c4ac9ce1b020e9a6658a957459f1915fdb1)

Signed-off-by: Ming Liu <peter.x.liu@external.atlascopco.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic-tools: ensure pseudo is available
Paul Eggleton [Tue, 25 Jul 2017 09:12:10 +0000 (11:12 +0200)] 
wic-tools: ensure pseudo is available

wic will attempt to use pseudo from the wic-tools sysroot to run, but it
was only sure to be in there if do_install had executed - which is not
the case if it had been restored from sstate, in which case it failed
horribly as seen when running the wic.Wic.test_fs_types and
test_mkfs_extraopts tests on the Yocto Project autobuilder recently. Add
an explicit dependency on pseudo-native to ensure it's always there.

(From OE-Core rev: ada7408a55ec58e4aa1b094462f8a681e60be613)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoadd fedora-26 to the SANITY_TESTED_DISTROS
Benjamin Esquivel [Sun, 23 Jul 2017 07:19:26 +0000 (07:19 +0000)] 
add fedora-26 to the SANITY_TESTED_DISTROS

tested the quickstart guide on Fedora 26 and confirmed that it
can build a core-image-sato and run the image via runqemu.

(From meta-yocto rev: 4e719fb77d035123d0e2ff84d10cb68c7cc8eccd)

Signed-off-by: Benjamin Esquivel <code@esquibits.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: fetch/wget: mitigate a wget race condition when listing FTP directories
Ross Burton [Mon, 24 Jul 2017 21:42:01 +0000 (22:42 +0100)] 
bitbake: fetch/wget: mitigate a wget race condition when listing FTP directories

When wget is fetching a listing for a directory over FTP it writes to a
temporary file called .listing in the current directory.  If there are many such
operations happening in parallel - for example during 'bitbake world -c
checkpkg' - then up to BB_NUMBER_THREADS instances of wget will be racing to
write to, read, and delete the same file.

This results in various failures such as the file disappearing before wget has
processed it or the file changing contents, which causes checkpkg to randomly
fail.

Mitigate the race condition by creating a temporary directory to run wget in
when doing directory listings.

[ YOCTO #11828 ]

(Bitbake rev: 91d4ca93df092cf86ab84faaa94cc66ff9f43057)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Change timeout warning to a note
Richard Purdie [Mon, 24 Jul 2017 13:10:58 +0000 (14:10 +0100)] 
bitbake: process: Change timeout warning to a note

The warning message currently shown can occur more frequently than previously
if a previous bitbake server is shutting down and we're reconnecting to a new
server. Change it to a note message to match the higher level connection
logging retry messages and so as not to interfer with selftests.

(Bitbake rev: b7514340cd6a2753eb217b059229bb279c3849ec)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: cooker/process: Drop server_main function
Richard Purdie [Mon, 24 Jul 2017 12:44:05 +0000 (13:44 +0100)] 
bitbake: cooker/process: Drop server_main function

Now that there is only one server, this abstraction is no longer needed
and causes indrection/confusion. The server shutdown is also broken with
the cooker post_server calls happening too late, leading to "lock held"
warnings in the logs if PRServ is enabled.

Remove the abstraction and put the shutdown calls in the right order
with respect to the locking.

(Bitbake rev: c0ddde7cf680225127d6285685652b905ed176c3)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: prserv/serv: Improve process exit handling
Richard Purdie [Mon, 24 Jul 2017 12:39:12 +0000 (13:39 +0100)] 
bitbake: prserv/serv: Improve process exit handling

The server shutdown is currenlty laggy and race prone. This patch:

* adds a waitpid so that no zombie server is left around if its not
  running in daemon mode.
* adds a quit "sentinal" using a pipe so that we're not sitting in
  a socket poll() until timeout in order just to quit.
* use a select() call to poll the socket and the pipe for a quit signal.

The net result of this change is that the prserv exits with the cooker server
and it does so immediately and doesn't wait for the select/poll calls to
timeout. This makes bitbake a lot more responsive for startup/shutdown and
doesn't cause UI timeout errors as often when prserv is used.

(Bitbake rev: 0b5a837477d18442caf97dd0fa14a806c54f5842)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopoky: Remove machine specific kernel overrides
brian avery [Fri, 21 Jul 2017 19:39:53 +0000 (12:39 -0700)] 
poky: Remove machine specific kernel overrides

This patch removes the machine specific overrides in poky.conf for all
the qemu machines.  With this patch, if you set
PREFERRED_VERSION_linux-yocto="X%" then all the qemu machines as well as
the sample hardware boards will use that version. Without this patch,
the hardware boards would have used version X but the qemu machines
would have needed to have a PREFERRED_VERSION_linux-yocto_qemuarm="X%"
for qemuarm to use that version, for example.  If we need to force a
specific machine (hardware or qemu) to a particular default version we
should add it to the machine conf files for that machine, not in the
distro conf.

(From meta-yocto rev: 6b194a137dcedcae7e4b03f9ebed822d44f53fe2)

Signed-off-by: brian avery <brian.avery@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agometa-yocto-bsp: Remove superfluous kernel set
brian avery [Fri, 21 Jul 2017 19:39:52 +0000 (12:39 -0700)] 
meta-yocto-bsp: Remove superfluous kernel set

The genericx86 and genericx86-64 machine confs do not need to set the
PREFERRED_PROVIDER_virtual/kernel as they will use the one set by the
distribution. If there needed to be a different version for one of these
machines in the future, we could add it in to the machine.conf.

(From meta-yocto rev: 89dd8159fc83f54d7fe234b619a28f5d97519156)

Signed-off-by: brian avery <brian.avery@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolinux-yocto: only suggest default kernel type
Joe Slater [Thu, 20 Jul 2017 23:19:51 +0000 (16:19 -0700)] 
linux-yocto: only suggest default kernel type

The distro should set a default kernel type (?=) which could be
overriden by local.conf (=) or extensions (templates).  The kernel itself
should only use "??=" to provide a value which allows builds to succeed.

(From OE-Core rev: d3a41fbd94462efc8c6f1b55f6fb54001b447c45)

Signed-off-by: Joe Slater <jslater@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agocve-check.bbclass: use "+git" as separator in PV instead of "git+"
Mikko Rapeli [Thu, 20 Jul 2017 13:23:11 +0000 (16:23 +0300)] 
cve-check.bbclass: use "+git" as separator in PV instead of "git+"

PV is the recipe major version number. cve-check tries to map that to
NVD database release versions of the component. If the recipe sources
are taken from git, the PV can be automatically modified to include
git details, but the syntax is like 233+gitAUTOINC+a1e2ef7ec9.
In CVE checks we want to remove the git details and just use the major
version information, in this example 233.

Thus use "+git" as the separator and use the first part before the separator
as SW product version number in CVE check.

Fixes version number for e.g. systemd recipe. If systemd PV is
233+gitAUTOINC+a1e2ef7ec9 there will be no matches from CVE database where
latest release mentioned is plain 233. If the filter is set to +git, then
CVE PV is 233 and issues like this are detected by do_cve_check:

https://nvd.nist.gov/vuln/detail/CVE-2017-1000082

(From OE-Core rev: db8815abe3db60b0510fb378bf6d82172c2f2768)

Signed-off-by: Mikko Rapeli <mikko.rapeli@bmw.de>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agogstreamer1.0-python: add new recipe
Martin Kelly [Tue, 18 Jul 2017 18:46:54 +0000 (11:46 -0700)] 
gstreamer1.0-python: add new recipe

Previously, we had a gst-python recipe, but it supported only GStreamer
0.1. After GStreamer switched the Python bindings to use GObject
introspection, we were no longer able to build the bindings, and they
were dropped in this patch:

https://patchwork.openembedded.org/patch/93793/

However, at this point, we have a gobject-introspection class, so we can
use the bindings again, this time with GStreamer 1.0.

(From OE-Core rev: 6650bd1b9c770b01525356f9a1fabd758360ee8f)

Signed-off-by: Martin Kelly <mkelly@xevo.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoffmpeg: fix pkg-config utilization
Nicolas Dechesne [Thu, 20 Jul 2017 14:55:11 +0000 (16:55 +0200)] 
ffmpeg: fix pkg-config utilization

in config.log we can see:
WARNING: aarch64-linaro-linux-pkg-config not found, library detection may fail.

ffmpeg configure script is not looking for pkg-config at the rigt place since it
is assuming cross compilation. let's force its value in the recipe.

This patches 'fixes' library detection, so it also adds:

--disable-libxcb
--disable-libxcb-shm
--disable-libxcb-xfixes
--disable-libxcb-shape

Which were dangling configure options, which started to be enabled after the
pkg-config fix, so they need now to be explicitely disabled. Follow up patch
will enable these options when DISTRO_FEATURES has x11.

(From OE-Core rev: 3d5f11f0a1fd036e28a1d3f0c3169d8e21cc1358)

Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoovmf-shell-image.bb: simplify dependencies
Patrick Ohly [Fri, 21 Jul 2017 06:25:13 +0000 (08:25 +0200)] 
ovmf-shell-image.bb: simplify dependencies

The image consists only of the EFI system partition, therefore
we can avoid depending on the default wic tools.

(From OE-Core rev: f147b2502ae53d63a884a46e994ae18e12ec4ef6)

Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoffmpeg: add PACKAGECONFIG for sdl2
Nicolas Dechesne [Thu, 20 Jul 2017 20:56:34 +0000 (22:56 +0200)] 
ffmpeg: add PACKAGECONFIG for sdl2

Enabling sdl2 will bring ffplay applications, which can be handy when working
with ffmpeg.

(From OE-Core rev: 5c880eb08ec29e169b9f6b7d6f2e0598a0395d30)

Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agokernel.bbclass: set CVE_PRODUCT to linux_kernel if not set by recipe
Mikko Rapeli [Thu, 20 Jul 2017 13:23:10 +0000 (16:23 +0300)] 
kernel.bbclass: set CVE_PRODUCT to linux_kernel if not set by recipe

It is used by NVD database CVE's like:

https://nvd.nist.gov/vuln/detail/CVE-2017-7273

Setting this in kernel.bbclass fixes CVE reporting for all users of
the class.

(From OE-Core rev: 2e3d325440a50265c73f7d2e782530a02458bc33)

Signed-off-by: Mikko Rapeli <mikko.rapeli@bmw.de>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agocve-check.bbclass: use weak assignment for default CVE_PRODUCT
Mikko Rapeli [Thu, 20 Jul 2017 13:23:09 +0000 (16:23 +0300)] 
cve-check.bbclass: use weak assignment for default CVE_PRODUCT

This way also bbclasses can override it. For example kernel.bbclass
could set CVE_PRODUCT to linux_kernel for all users of the class
which compile Linux kernels.

(From OE-Core rev: 74672a7de5ada45ab8e25b89cbdea3ec33b63b7f)

Signed-off-by: Mikko Rapeli <mikko.rapeli@bmw.de>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowpa-supplicant_2.6.bb: set CVE_PRODUCT to wpa_supplicant
Mikko Rapeli [Thu, 20 Jul 2017 13:23:08 +0000 (16:23 +0300)] 
wpa-supplicant_2.6.bb: set CVE_PRODUCT to wpa_supplicant

It is used in NVD database CVE's like:

https://nvd.nist.gov/vuln/detail/CVE-2015-1863

(From OE-Core rev: cc3882ca2fea2c5a8830311eeb7840ae98da9b3c)

Signed-off-by: Mikko Rapeli <mikko.rapeli@bmw.de>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosqlite3.inc: set CVE_PRODUCT to sqlite
Mikko Rapeli [Thu, 20 Jul 2017 13:23:07 +0000 (16:23 +0300)] 
sqlite3.inc: set CVE_PRODUCT to sqlite

It is used in NVD for CVE's like:

https://nvd.nist.gov/vuln/detail/CVE-2016-6153

(From OE-Core rev: cec6f26f4d2f16c9a58fac5a6344e3d43b36ed09)

Signed-off-by: Mikko Rapeli <mikko.rapeli@bmw.de>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoquota_4.03.bb: set CVE_PRODUCT to linux_diskquota
Mikko Rapeli [Thu, 20 Jul 2017 13:23:06 +0000 (16:23 +0300)] 
quota_4.03.bb: set CVE_PRODUCT to linux_diskquota

It is used in NVD for CVE's like:

https://nvd.nist.gov/vuln/detail/CVE-2012-3417

(From OE-Core rev: 07be7cb9405e4a6289edad8afb3a50c1f8651620)

Signed-off-by: Mikko Rapeli <mikko.rapeli@bmw.de>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolttng-ust_2.9.1.bb: set CVE_PRODUCT to ust
Mikko Rapeli [Thu, 20 Jul 2017 13:23:05 +0000 (16:23 +0300)] 
lttng-ust_2.9.1.bb: set CVE_PRODUCT to ust

It is used in NVD for CVE's like:

https://nvd.nist.gov/vuln/detail/CVE-2010-3386

(From OE-Core rev: 1c6643f139911ab27618d20f9d4ca609235a680b)

Signed-off-by: Mikko Rapeli <mikko.rapeli@bmw.de>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>