]> git.ipfire.org Git - thirdparty/openembedded/openembedded-core-contrib.git/log
thirdparty/openembedded/openembedded-core-contrib.git
8 years agogo: Remove -fPIE -pie from SECURITY_PIE_CFLAGS
Khem Raj [Mon, 24 Jul 2017 00:47:48 +0000 (17:47 -0700)] 
go: Remove -fPIE -pie from SECURITY_PIE_CFLAGS

External compilers will explicitly pass -fPIE -pie flags
unlike internal toolchain which does not use them, so the build
fails with external toolchains because, its passing these
flags to linker when building with -r option and fails to link

| /mnt/a/oe/build/tmp/work/corei7-64-bec-linux/go/1.8.3-r0/recipe-sysroot-native/usr/bin/x86_64-bec-linux/x86_64-bec-linux-ld: -r and -pie may not be used together

(From OE-Core rev: bb89849b5edb05a953586d190826a67ba87c1c5a)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agokexec-tools: Remove -fPIE -pie from SECURITY_PIE_CFLAGS
Khem Raj [Mon, 24 Jul 2017 00:47:47 +0000 (17:47 -0700)] 
kexec-tools: Remove -fPIE -pie from SECURITY_PIE_CFLAGS

(From OE-Core rev: 7685bac83504e8de6c02d93e39e40f38e51994bb)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolibsdl: Pass --tag option to libtool invocation
Khem Raj [Mon, 24 Jul 2017 00:47:46 +0000 (17:47 -0700)] 
libsdl: Pass --tag option to libtool invocation

Helps in fixing errors when using external toolchain
and hardening flags

(From OE-Core rev: 33ab086517c629158fd10d1818cad619883743db)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolibproxy: Remove PIE flags from SECURITY_PIE_CFLAGS
Khem Raj [Mon, 24 Jul 2017 00:47:45 +0000 (17:47 -0700)] 
libproxy: Remove PIE flags from SECURITY_PIE_CFLAGS

External compilers will explicitly pass -fPIE -pie flags
unlike internal toolchain which does not use them, so the build
fails with external toolchains because, its passing these
flags to linker when building shared library, which is not
correct it should just use -fPIC

Fixes errors e.g.
| /mnt/a/oe/build/tmp/work/corei7-64-bec-linux/libproxy/0.4.14-r0/recipe-sysroot-native/usr/bin/x86_64-bec-linux/x86_64-bec-linux-ld: ../libmodman/libmodman.a(module_manager.cpp.o): relocation R_X86_64_PC32 against symbol `_ZNSt8_Rb_treeINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESt4pairIKS5_St6vectorIPN9libmodman14base_extensionESaISB_EEESt10_Select1stISE_ESt4lessIS5_ESaISE_EE8_M_eraseEPSt13_Rb_tree_nodeISE_E' can not be used when making a shared object; recompile with -fPIC

(From OE-Core rev: 8c8c01f8e68026228a3b76528a0039acf682c201)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoossp-uuid, libffi, libgcrypt: Pass --tag=CC option to libtool
Khem Raj [Mon, 24 Jul 2017 00:47:43 +0000 (17:47 -0700)] 
ossp-uuid, libffi, libgcrypt: Pass --tag=CC option to libtool

libtool tries to guess the --tag value based on CC/CXX environment
variables and the compile commandline generated by makefiles. This
heuristics however fails when we construct CC variables in OE
and add security flags to it, especially -fPIE -pie which are added
by external compilers e.g. clang particularly. It fails because
libtool removed PIE flags from compiler cmdline intelligently
if it figures out that its building a library, which means that
the CC variable passed from cmdline does not match with the compiler
cmdline constructed by libtool and we end up with errors like

| arm-bec-linux-musleabi-libtool: compile: unable to infer tagged configuration
| arm-bec-linux-musleabi-libtool:   error: specify a tag with '--tag'

This works with internal gcc toolchain because we configure gcc for
PIE when hardening is selected and dont pass -fPIE -pie options explicitly
but this is not an option for clang, and some external gcc toolchains
using older gcc

This patch adds the --tag option to help libtool set correct tags
in packages where it cant get it right via its heuristics

(From OE-Core rev: 0505075ae8d339ba097aebb82b4d0ae62f87c0a9)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodevtool: fix handling of errors during task execution
Paul Eggleton [Mon, 7 Aug 2017 10:03:44 +0000 (12:03 +0200)] 
devtool: fix handling of errors during task execution

* If an error is logged while executing a task, we need to ensure we
  exit instead of assuming everything went OK.
* If we receive CookerExit, the server is shutting down and we need to
  stop waiting for events and probably exit (knotty does this). This
  will occur if an exception or bb.fatal() happens during an event
  handler.

This fixes a couple of issues highlighted when using devtool upgrade or
modify on a non-supported recipe with intel-iot-refkit together with
bitbake master, but I'd be very surprised if it were hard to reproduce
in other scenarios.

(From OE-Core rev: 65e644368fc9c294af96906528ee0cf30305e0a6)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake.conf: whitelist BB_SERVER_TIMEOUT from config hash
Paul Eggleton [Mon, 7 Aug 2017 10:03:43 +0000 (12:03 +0200)] 
bitbake.conf: whitelist BB_SERVER_TIMEOUT from config hash

We don't need to reparse recipes just because BB_SERVER_TIMEOUT changed,
so exclude it from the config hash.

(From OE-Core rev: a686fcabacd49fdb814e646305c1f33fee1d5abf)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoterminal: wait for terminal task to finish before procedding
Leonardo Sandoval [Mon, 7 Aug 2017 19:21:51 +0000 (12:21 -0700)] 
terminal: wait for terminal task to finish before procedding

This commit generalizes the work done in [1] and [2], both fixing
issues on several areas (the former with -c patch and gnome-terminal and
the latter with -c menuconfig and several terminals, including
gnome-terminal and tmux). The main idea is to get the PID
from the new spawned terminal and loop there until finished.

[1] 76e8ab47c9: terminal: Fix gnome-terminal to work with recent versions
[2] 7d02ea283b: cml1.bbclass: wait until menuconfig terminal finishes

(From OE-Core rev: 55707401d5bfb1f7686c273fc2d0db89df206395)

Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoRevert "cml1.bbclass: wait until menuconfig terminal finishes"
Leonardo Sandoval [Mon, 7 Aug 2017 19:21:50 +0000 (12:21 -0700)] 
Revert "cml1.bbclass: wait until menuconfig terminal finishes"

This reverts commit d2ebee7c3a0c8ab9a09ebad12a2fda51f8d10954.

(From OE-Core rev: da7bc68c399bbcd1baf946931200eba72268b0b3)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosstatetests: Use python function instead of bitbake-diffsigs script
Leonardo Sandoval [Mon, 7 Aug 2017 21:33:50 +0000 (14:33 -0700)] 
sstatetests: Use python function instead of bitbake-diffsigs script

Using a python function instead of launching a subprocess fasten the
diffsigs computation.

[YOCTO #11651]

(From OE-Core rev: 5dd65cf50273519fa45bd056b9ff342d9984a382)

Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodiffstat: exclude aclocal
Ross Burton [Tue, 8 Aug 2017 10:09:01 +0000 (11:09 +0100)] 
diffstat: exclude aclocal

Instead of moving aclocal.m4 to acinclude.m4 in a custom do_configure, simply
tell autoreconf not to run aclocal.

(From OE-Core rev: 5cc53ea9347035f96a721ab057a338eded5c5c67)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodiffstat: use HTTP mirror for SRC_URI
Ross Burton [Tue, 8 Aug 2017 10:09:00 +0000 (11:09 +0100)] 
diffstat: use HTTP mirror for SRC_URI

The Invisible Mirror FTP service is currently down, and FTP is horrible, so
switch to the HTTP mirror.

(From OE-Core rev: f31461f8ea11e82dbe14454a1149d9ec2120404d)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoqemux86 qemux86-64: Enable pci
He Zhe [Mon, 31 Jul 2017 13:11:33 +0000 (21:11 +0800)] 
qemux86 qemux86-64: Enable pci

lspci and some other software require "pci" in MACHINE_FEATURES and PCI
is valid in the qemux86* context.

(From OE-Core rev: aec9a159dbc7a78953da73ba9dfccc9e9c9514a7)

Signed-off-by: He Zhe <zhe.he@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolibrsvg: 2.40.17 -> 2.40.18
Huang Qiyu [Tue, 1 Aug 2017 02:55:30 +0000 (10:55 +0800)] 
librsvg: 2.40.17 -> 2.40.18

Upgrade librsvg from 2.40.17 to 2.40.18.

(From OE-Core rev: 199b1ed7439ee217d860d8940b5738d3c7022113)

Signed-off-by: Huang Qiyu <huangqy.fnst@cn.fujitsu.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: daemonize: Always print any remaning UI events at exit
Richard Purdie [Wed, 2 Aug 2017 05:37:01 +0000 (06:37 +0100)] 
bitbake: daemonize: Always print any remaning UI events at exit

If there are events in the UI queue we want to print them regardless of
whether we're handling an exception or something like SystemExit.

This improves error messages for some other failure cases where currently
no logging would get printed and leave the user confused as to what went
wrong.

(Bitbake rev: 76c4f2c20216719736766e8ae7d089ccd061b71b)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: cooker: Ensure all tasks are shown in task dependency tree
Richard Purdie [Tue, 1 Aug 2017 08:37:37 +0000 (09:37 +0100)] 
bitbake: cooker: Ensure all tasks are shown in task dependency tree

"bitbake -g m4-native -c do_unpack" doesn't list any dependencies in
task-depends.dot. This is because no header describing the task was
added unless a task has dependencies. Tweak the code to fix this.

[YOCTO #10893]

(Bitbake rev: e2fbe728769f09ef4178e2ef4d69a2f60ffe3ebb)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopython: don't include -tests with modules
Mark Asselstine [Tue, 1 Aug 2017 13:51:12 +0000 (09:51 -0400)] 
python: don't include -tests with modules

Although 'test' is listed in the python module list
(https://docs.python.org/3/py-modindex.html) it is meant only to be
used 'internally' by folks developing python itself. Per the
documentation:

  Note The test package is meant for internal use by Python only. It
  is documented for the benefit of the core developers of Python. Any
  use of this package outside of Python’s standard library is
  discouraged as code mentioned here can change or be removed without
  notice between releases of Python.

Per the above it is best not to include this module to discourage
folks who might not head the above warnings. Additionally this module
is one of the largest py modules going, by dropping this unneeded
module from the 'modules' package we can reduce overall image size,
something which is important for many embedded deployments.

The generator scripts as well as the manifests have thus been modified
accordingly, providing a generic mechanism to exclude modules from the
'all modules' package.

(From OE-Core rev: a5bb13a5d7d7a668ca61da6b17884e3b05b95355)

Signed-off-by: Mark Asselstine <mark.asselstine@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: improve generating disk system identifier
Jonathan Liu [Mon, 31 Jul 2017 10:53:39 +0000 (20:53 +1000)] 
wic: improve generating disk system identifier

This should reduce the chance of generating 0xffffffff as the disk
system identifier.

(From OE-Core rev: 5619e72facbc9228d3cf8f844f198e03b536ac8c)

Signed-off-by: Jonathan Liu <net147@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agometa: drop do_bootdirectdisk do_vmimg references
Ming Liu [Mon, 31 Jul 2017 08:56:28 +0000 (10:56 +0200)] 
meta: drop do_bootdirectdisk do_vmimg references

do_bootdirectdisk and do_vmimg had been dropped by commit 929ba563:
[ image: Convert vmdk/vdi/qcow2 to strict CONVERSION_CMD types ]

Also drop the references to them and image-vm.

(From OE-Core rev: 609f7f4ecd17c8299b97d9face098e3cc44fa6eb)

Signed-off-by: Ming Liu <peter.x.liu@external.atlascopco.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoautoconf-archive: GPLv3 + autoconf exception
Patrick Ohly [Mon, 31 Jul 2017 18:28:49 +0000 (20:28 +0200)] 
autoconf-archive: GPLv3 + autoconf exception

The COPYING file specifies pure GPLv3, not GPLv2 & GPLv3, with the
autoconf exception in COPYING.EXCEPTION. OE-core currently has
GPL-3.0-with-GCC-exception for this in meta/conf/licenses.conf, so
this is used here despite the deprecation note for that license
identifier in https://spdx.org/licenses/GPL-3.0-with-autoconf-exception.

(From OE-Core rev: 5849391a1854743af26503db603ad578d8d19e25)

Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agore2c: fix build race
Ross Burton [Tue, 1 Aug 2017 09:25:21 +0000 (10:25 +0100)] 
re2c: fix build race

(From OE-Core rev: 33bd61e34f0d17841f0817bfdcdf87320a6743ec)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agouninative: Allow a local own-mirror to work with uninative
Richard Purdie [Tue, 1 Aug 2017 10:14:14 +0000 (11:14 +0100)] 
uninative: Allow a local own-mirror to work with uninative

The games we play with path manipulation of DL_DIR in uninative mean standard
PREMIRRORS don't work and we can't easily put 'chksum' into the url path from
a url parameter with the current fetcher url handling to make a generic
remapping. We therefore add to PREMIRRORS when we know the chksum to
create a premirror mapping which can work.

[YOCTO #9888]

(From OE-Core rev: 3b0309dbb5d52e9d7abf6fd89cc999ac4cc5d2fb)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: daemonize: clean up code
Richard Purdie [Mon, 31 Jul 2017 11:12:45 +0000 (12:12 +0100)] 
bitbake: daemonize: clean up code

This was originally based on some other code but its mostly misleading
comments now. Massively clean this up and accept its now a total fork.
There are no funciton changes here, just cleanup.

(Bitbake rev: 3daa9001269e5b9156d0eb3299d2628d2d219fff)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: daemonize: Ensure child process exits safely
Richard Purdie [Mon, 31 Jul 2017 10:30:56 +0000 (11:30 +0100)] 
bitbake: daemonize: Ensure child process exits safely

When we create the child, if an exception occurred it was transfering
back into the parent context. We don't want to do that us use a try/finally
to ensure we exit.

We need to ensure a traceback is printed and any queued UI messages which
may not have made it to the client UI at this point.

(Bitbake rev: dec1d2c26f6cb3ffeb44beaab0129cd531a6d08b)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Add some extra server startup logs
Richard Purdie [Mon, 31 Jul 2017 07:55:15 +0000 (08:55 +0100)] 
bitbake: process: Add some extra server startup logs

We have cases where the server is being started but we're not seeing any messages
from it. Add some earlier logging so we can try and better understand where
issues may be occurring.

(Bitbake rev: 10a6a48c0c5a2fe2051e90143e66075356853971)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Reorder server command processing and handle EOFError
Richard Purdie [Mon, 31 Jul 2017 07:09:03 +0000 (08:09 +0100)] 
bitbake: process: Reorder server command processing and handle EOFError

If the connection control socket and the command channel close together,
we can race and hit EOFError exceptions before we close the channel.

Reorder the code to handle this in the correct order and ignore the
EOFError exceptions as they mean the client is disconnecting and shouldn't
terminate the server.

(Bitbake rev: 974281ed72d8366baa16ee85f7e93970689b5956)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: wget: fix FusionForge workaround
Ross Burton [Sat, 29 Jul 2017 17:23:33 +0000 (18:23 +0100)] 
bitbake: wget: fix FusionForge workaround

My previous assertion about FusionForge appears to have been wrong, or
FusionForge has changed behaviour, or both.

FusionForge now mandates that downloads have the Accept header set, despite that
header being optional, and returns a 406 Not Acceptable error if it isn't set.
As we were pretending that 406 was actually 405 (Moved) and tried to handle it as a
redirect this results in an infinite loop until Python kills the recursion.

Delete the handling of 406 as 405, and pass Accept: */* in the headers.

(Bitbake rev: bb70ae0c9aac5ec688026d23a64ac0cac1947187)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: toaster: move to new bitbake xmlrpc default
David Reyna [Sat, 29 Jul 2017 00:14:14 +0000 (17:14 -0700)] 
bitbake: toaster: move to new bitbake xmlrpc default

The bitbake option "-t SERVERTYPE" was deprecated and can be
removed since the desired XMLRPC listener now the default.

The bitbake server port cannot be "-1" anymore and must be
explicitly passed.

There is a race condition for the bblock file to not only
be created but to actually be populated, so a delay test loop
is required (usually only one pass).

The 'xmlrpcclient' is now the class that allows Toaster to for
example kill builds.

The events for populating the recipe parsing now either show only
the final result or are skipped entiredly, so the progress
calculator needs to be changed to not block on the parsing phase.

[YOCTO #11851]

(Bitbake rev: 2aa7ad38f760ec003fb18faa5aa0014cff191a7a)

Signed-off-by: David Reyna <David.Reyna@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: toaster: enable remote HTTP API for status aggregation
David Reyna [Sat, 29 Jul 2017 00:14:13 +0000 (17:14 -0700)] 
bitbake: toaster: enable remote HTTP API for status aggregation

Add support for Toaster aggregators with a set of api links that
return JSON data for (a) builds in progress, (b) builds completed,
(c) specific build data, and (d) an is-alive health ping link.

[YOCTO #11794]

(Bitbake rev: d8e79661c69671dd424dca5cc3f7f2f855b0afed)

Signed-off-by: David Reyna <David.Reyna@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: runqueue: Tweak debug message to make it more readable/diffable
Richard Purdie [Sun, 30 Jul 2017 14:58:01 +0000 (15:58 +0100)] 
bitbake: runqueue: Tweak debug message to make it more readable/diffable

Having this as one huge long line isn't easy to manipulate, split it into
multiple lines for ease of debugging issues.

(Bitbake rev: 5753fe81194f75fbcf4ccdc733cc585d02794cb1)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: fetch2: fix checkstatus fallback to MIRRORS
Ross Burton [Fri, 28 Jul 2017 16:26:23 +0000 (17:26 +0100)] 
bitbake: fetch2: fix checkstatus fallback to MIRRORS

The checkstatus() code was expecting checkstatus to throw exceptions if it
failed, but in general it should return False.

(Bitbake rev: 57be5cc6228518e60f564570a39cebbeb6cf564e)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agomesa: Fix build when building with llvmpipe
Khem Raj [Sat, 29 Jul 2017 07:42:49 +0000 (00:42 -0700)] 
mesa: Fix build when building with llvmpipe

Add following in mesa.inc to enable llvmpipe

PACKAGECONFIG_append_x86 = " gallium-llvm gallium r600"
PACKAGECONFIG_append_x86-64 = " gallium-llvm gallium r600"

This would enable llvmpipe for swrast, to check run this

root@qemux86:~# glxinfo | grep llvm
    Device: llvmpipe (LLVM 5.0, 128 bits) (0xffffffff)
OpenGL renderer string: Gallium 0.4 on llvmpipe (LLVM 5.0, 128 bits)

Backport patches to support llvm 5.0.0+
Add a patch to understand llvm version when llvm is build from git/svn

(From OE-Core rev: da29bc17e4dd748f50b054c5e3afaf8d41bf4077)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agollvm: Add recipe for 5.0
Khem Raj [Thu, 27 Jul 2017 17:40:11 +0000 (10:40 -0700)] 
llvm: Add recipe for 5.0

Based on recipe from meta-oe and clang recipe from meta-clang
Needed by mesa

Fixes
[YOCTO #11529]

(From OE-Core rev: 8724ef9c53e7804ead9ba0f019369b0e4daada63)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agore2c: Transfer recipe from meta-oe and upgrade to 0.16
Khem Raj [Fri, 28 Jul 2017 11:44:24 +0000 (04:44 -0700)] 
re2c: Transfer recipe from meta-oe and upgrade to 0.16

ninja needs it.

(From OE-Core rev: d7d46209a309735b503cfc543799faea1f794055)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoninja: Add recipe
Khem Raj [Fri, 28 Jul 2017 04:52:12 +0000 (21:52 -0700)] 
ninja: Add recipe

llvm is using it, therefore move it from meta-oe

(From OE-Core rev: fc3aef67a95a90e9a485c6b0e93db8cdeab5d3ab)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage: Make do_image_qa a dummy sstate task to match do_image_complete
Richard Purdie [Sun, 30 Jul 2017 15:13:37 +0000 (16:13 +0100)] 
image: Make do_image_qa a dummy sstate task to match do_image_complete

Similar to do_image_complete, make do_image_qa a dummy sstate task
so that rm_work doesn't cause image generation to repeat on every
new build command.

(From OE-Core rev: ca61f5437cb2421a67f002785e644ba215e04aaf)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage/rm_work: Promote do_image_complete to be more sstate like
Richard Purdie [Sun, 30 Jul 2017 15:06:57 +0000 (16:06 +0100)] 
image/rm_work: Promote do_image_complete to be more sstate like

We relied on the missing do_image_complete_setscene task to ensure the dummy
sstate tarball that was created would never be used. This lead to its own
issues and a better fix for SSTATE_SKIP_CREATION has now been merged.

We can therefore make do_image_complete look like a more standard sstate
task which means image generation doesn't keep rerunning when using rm_work.

We do need to turn do_image_complete's stamp into an sstate version to
handle this (it otherwise matches the do_image_* glob).

(From OE-Core rev: 2ff9d40dc88d43567472218cf3d3faf414398c71)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage: Drop before do_build from do_rootfs and do_image
Richard Purdie [Sun, 30 Jul 2017 15:04:54 +0000 (16:04 +0100)] 
image: Drop before do_build from do_rootfs and do_image

do_image_complete has the do_build dependency, these other two tasks
don't need it. If this is present, it complicates the dependency tree
and convinces rm_work that the tasks need to rerun even if they
already did since the stamps are removed.

Drop the unneeded dependency to help resolve this issue.

(From OE-Core rev: f61bcae0926a1ad79032119cc5656c0e862b13af)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosstate: Improve SSTATE_SKIP_CREATION
Richard Purdie [Sun, 30 Jul 2017 15:01:09 +0000 (16:01 +0100)] 
sstate: Improve SSTATE_SKIP_CREATION

Currently, dummy archives are created for skipped sstate tasks. We relied
on these never being installed (the setscene task is missing) however this
leads to odd behaviour as for example the setscene stamps are never looked
at.

Rather than trying to continue with the two separate behaviours, really
skip package creation. We do need the file manipulation steps to install files
under sstate control from a manifest perspective so we only skip at the final
creation step.

(From OE-Core rev: 1e95fc5419a131a5e4091b8ff01639de99284399)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agorm_work: Improve handling for addto_recipe_sysroot
Richard Purdie [Sun, 30 Jul 2017 14:59:34 +0000 (15:59 +0100)] 
rm_work: Improve handling for addto_recipe_sysroot

Rather than requiring each user to handle this individually, handle
addto_recipe_sysroot in the core class. As well as preserving the
sysroot directory, this also ensures the stamp is preserved rather
than rerunning the task every time as currently happens.

(From OE-Core rev: bf8b9858d9ccce27173d13938a83d249294cc473)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolibpng: fix MIRRORS usage
Ross Burton [Fri, 28 Jul 2017 15:55:55 +0000 (16:55 +0100)] 
libpng: fix MIRRORS usage

MIRRORS needs to be pairs of values for the original URL to match and the
location find it on the mirror.

(From OE-Core rev: a649f3da630e8ca2d3ca58b610f3918720dd5229)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoyocto-project-qs: Added section for CROPS.
Scott Rifenbark [Fri, 28 Jul 2017 23:40:30 +0000 (16:40 -0700)] 
yocto-project-qs: Added section for CROPS.

(From yocto-docs rev: 0d6fba532e0247db2cce4e94466f4476114d3e13)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoyocto-project-qs: Added writernotes style to the *.css file.
Scott Rifenbark [Fri, 28 Jul 2017 19:14:16 +0000 (12:14 -0700)] 
yocto-project-qs: Added writernotes style to the *.css file.

This style allows a writer to use the <para role='writernotes'>
tag to have text in the paragraph render in red.

(From yocto-docs rev: 65bb4edcd0a58ea8e17f28f9f5c13e2898c22745)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoyocto-project-qs: Updated overview to account for re-orged material
Scott Rifenbark [Fri, 28 Jul 2017 18:15:53 +0000 (11:15 -0700)] 
yocto-project-qs: Updated overview to account for re-orged material

Because the YP development introductory information was moved to
the ref-manual, and the QS will get a CROPS section inserted,
the introductory section of the QS needed to be updated a bit.

(From yocto-docs rev: e173b762a74678cd660850e4f5bc28712c3d83ac)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoyocto-project-qs, ref-manual: Moved YP intro from QS to ref-manual
Scott Rifenbark [Wed, 26 Jul 2017 19:04:48 +0000 (12:04 -0700)] 
yocto-project-qs, ref-manual: Moved YP intro from QS to ref-manual

Fixes [YOCTO #11630]

The introductory stuff in the QS is really conceptual information and
needs to be in the ref-manual where YP is introduced.  Regarding the
QS, all we really need to do is point to places where the reader can
go to find that stuff out.

Part of this move involved getting the diagram of the YP flow for
the environment from the QS to the ref-manual.  That figure was
named "YP-flow-diagram.png".  It was named "yocto-environment.png"
in the QS but I renamed it when moving it to the ref-manual.  This
caused some edits to the "Makefile" to clean up the figure lists
for tarballs.

(From yocto-docs rev: ab108c0959e3a9f36d25080245482f8a790c8c87)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopoky.ent: Updated CentOS required package
Kristi Rifenbark [Fri, 28 Jul 2017 22:57:51 +0000 (15:57 -0700)] 
poky.ent: Updated CentOS required package

Replaced "python34-pip" package with "python3-pip"
in the list of required packages for CentOS' variable.

(From yocto-docs rev: 5d48ea7953169b4392d6caf0fb8f2f952479f033)

Signed-off-by: Kristi Rifenbark <kristi.rifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopoky.ent: Corrected package duplication
Kristi Rifenbark [Fri, 28 Jul 2017 21:00:31 +0000 (14:00 -0700)] 
poky.ent: Corrected package duplication

Removed duplicated package, "which" in list of
required packages for Fedora's variable.

(From yocto-docs rev: e016735fe7ef0d866d44df1100597ab3f3af7d5f)

Signed-off-by: Kristi Rifenbark <kristi.rifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agouninative: Update to 1.7 uninative release
Richard Purdie [Sat, 29 Jul 2017 07:32:59 +0000 (08:32 +0100)] 
uninative: Update to 1.7 uninative release

This updates to a newer glibc and updates patchelf to include a bugfix
to work with gold.

(From OE-Core rev: a2ab288bd002ebb6e64d46e941fb122e1157ff49)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoautoconf: fix typo in SUMMARY
Denys Dmytriyenko [Fri, 28 Jul 2017 18:49:27 +0000 (14:49 -0400)] 
autoconf: fix typo in SUMMARY

(From OE-Core rev: fb6500144f2244815be3f81908ee3baad373e348)

Signed-off-by: Denys Dmytriyenko <denys@ti.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimagefeatures: Add a test for various hypervisor formats
Tom Rini [Sat, 29 Jul 2017 00:14:36 +0000 (20:14 -0400)] 
imagefeatures: Add a test for various hypervisor formats

We add a new test that will create core-image-minimal for wic.vmdk,
wic.vdi and wic.qcow2.  We then confirm via qemu-img that the resulting
file is of the expected type.

Cc: Ed Bartosh <ed.bartosh@linux.intel.com>
(From OE-Core rev: 1392fdeaf6acc7c8d2ff9a5a2bf6ef2f5928957d)

Signed-off-by: Tom Rini <trini@konsulko.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimagefeatures: Add a test for many CONVERSION_CMDs being chained
Tom Rini [Sat, 29 Jul 2017 00:14:35 +0000 (20:14 -0400)] 
imagefeatures: Add a test for many CONVERSION_CMDs being chained

Add a new test to create a long (and not otherwise useful) image,
ext4.bmap.gz.bz2.lzo.xz.u-boot and also the sha256sum of it.  Check that
the resulting sha256sum is valid.

Cc: Ed Bartosh <ed.bartosh@linux.intel.com>
(From OE-Core rev: ac4402bff547b017284b12c1874d4094c169419d)

Signed-off-by: Tom Rini <trini@konsulko.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimagefeatures: Extend test_bmap to validate gzip
Tom Rini [Sat, 29 Jul 2017 00:14:34 +0000 (20:14 -0400)] 
imagefeatures: Extend test_bmap to validate gzip

We extend the existing test_bmap test to also produce an ext4.bmap.gz
file and then have gzip confirm that it contains valid gzip data.  This
tests that we are able to chain at least 2 CONVERSION_CMDs together.

Cc: Ed Bartosh <ed.bartosh@linux.intel.com>
(From OE-Core rev: 1e9ca92f84d9d5b4e56d47dfd4b3d7f9aba3d21b)

Signed-off-by: Tom Rini <trini@konsulko.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: Switch to using --use-uuid by default
Tom Rini [Sat, 29 Jul 2017 00:14:33 +0000 (20:14 -0400)] 
wic: Switch to using --use-uuid by default

The most portable way to specifiy a root device in a disk image that we
create is to use PARTUUID rather than /dev/sda2.  As background, both
GPT and MBR tables provide valid UUID values for each partition and the
Linux Kernel contains the logic to parse this value.  With this change
we can now boot the default disk images when used as any valid block
device that the included kernel uses.  This for example means that
VirtualBox can be used to run vmdk without changes as it uses IDE for
the virtual disk controller.

Cc: Matt Porter <mporter@konsulko.com>
(From OE-Core rev: 8a58e9bb3e76a9962f1d14a8bdd3f7de675c3492)

Signed-off-by: Tom Rini <trini@konsulko.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage: Convert vmdk/vdi/qcow2 to strict CONVERSION_CMD types
Tom Rini [Sat, 29 Jul 2017 00:14:32 +0000 (20:14 -0400)] 
image: Convert vmdk/vdi/qcow2 to strict CONVERSION_CMD types

The vmdk/vdi/qcow2 IMAGE_FSTYPEs predate wic.  As such, they provide
some similar underlying functionality in order to produce a "disk" image
that in turn can be converted into different formats that various
hypervisor types work with.  They do not however provide the ability for
other disk image types to be converted into these same output types.
Furthermore, they are less flexible than what wic does provide.  This
drops the old style vmdk/vdi/qcow2 types and re-introduces them under
the CONVERSION_CMD framework.  The equivalent of vmdk is now wic.vmdk
and so forth for the other types.

(From OE-Core rev: 929ba563f1bc7195c4981b8e139c432b2cc388ea)

Signed-off-by: Tom Rini <trini@konsulko.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agocml1.bbclass: wait until menuconfig terminal finishes
Leonardo Sandoval [Fri, 28 Jul 2017 01:54:31 +0000 (18:54 -0700)] 
cml1.bbclass: wait until menuconfig terminal finishes

There are at least two terminals types (gnome and tmux) that when
launched to show the kernel's menuconfig, we lost track of the corresponding
process ID, thus there is no way to see when they finish, yielding identical
timestamps before and after menuconfig thus compile's task
is never tainted. This commit takes the solution from [1] but now in the menuconfig's
context.

[1] http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=c706bfbabbf9f7caf2cf509eb91381fb49aa44cb

[YOCTO #11146]

(From OE-Core rev: 7d02ea283b6587f3f79c5846b64b9ba1d6fe8026)

Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoassimp: upgrade to 4.0.0
Kai Kang [Fri, 28 Jul 2017 03:21:06 +0000 (11:21 +0800)] 
assimp: upgrade to 4.0.0

Upgrade assimp to 4.0.0.

* Because there is also an assimp recipe in meta-oe, so update
  DESCRIPTION, HOMEPAGE and SECTION from it.
* Remove redundant license file
* Update EXTRA_OECMAKE to fix library install path for multilib

(From OE-Core rev: e639f8845f78a0a75b9cab81d9a9f6a2810a313c)

Signed-off-by: Kai Kang <kai.kang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: ensure generated disk system identifier is non-zero
Jonathan Liu [Fri, 28 Jul 2017 14:45:27 +0000 (00:45 +1000)] 
wic: ensure generated disk system identifier is non-zero

Zero may be interpreted as no MBR signature present and another
partitioning program might install a new MBR signature.

(From OE-Core rev: f53b5555d6eaa171bc5882cfee807cf62576862d)

Signed-off-by: Jonathan Liu <net147@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoautoconf-archive: simplify and fix recipe
Patrick Ohly [Fri, 28 Jul 2017 14:49:53 +0000 (16:49 +0200)] 
autoconf-archive: simplify and fix recipe

The COPYING file specifies pure GPLv3, not GPLv2 & GPLv3. There is
also the COPYING.EXCEPTION file with the autotools exception, which
gets ignored here in the recipe to keep it simpler.

All of the explicit dependencies seem unnecessary, and RDEPENDS_${PN}
doesn't do anything for native recipes either, so all of that gets
removed.

It also built fine without the m4 and parallel build workarounds.

There's no need to have a separate .inc file.

(From OE-Core rev: 5002004b891895654cbad53555ee46e2ed188630)

Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoautoconf-archive: move from meta-oe to OE-core
Patrick Ohly [Fri, 28 Jul 2017 14:49:52 +0000 (16:49 +0200)] 
autoconf-archive: move from meta-oe to OE-core

Having common macros in OE-core that are needed by autotools based
projects makes sense. For example, tpm2.0-tools in meta-measured
depended on meta-oe only because of autoconf-archive.

This is a verbatim copy of the autoconf-archive recipe in
meta-openembedded rev 1cbd1bc1, with just one change: the patch which
disabled the installation of ax_code_coverage.m4 and
ax_check_enable_debug.m4 and the dependency on gnome-common were
removed.

So now autoconf-archive in OE-core provides them. gnome-common in
meta-oe will be changed to not install them and instead depend on
autoconf-archive.

(From OE-Core rev: 40711432b82fc6efb9e40748532ed68a64fbe628)

Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agorootfsdebugfiles.bbclass: add a optional parameter to choose file mode
Ming Liu [Fri, 28 Jul 2017 14:04:27 +0000 (16:04 +0200)] 
rootfsdebugfiles.bbclass: add a optional parameter to choose file mode

This is in case that sometimes the copied target files might be
expected to have a desired mode, for instance, the ssh keys should not
be too open, otherwise the users will get a "Permission denied" error.

(From OE-Core rev: 0ae4c1eeb1a70bae324347445895c7d312cf503d)

Signed-off-by: Ming Liu <peter.x.liu@external.atlascopco.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agooe-selftest: wic: fix test_quemu
Ed Bartosh [Fri, 28 Jul 2017 09:29:28 +0000 (12:29 +0300)] 
oe-selftest: wic: fix test_quemu

This test case boots the image in qemu and checks for mounted
partitions. As /boot is mounted automatically the test case fails.
Fixed this by adding /boot to the list of mounted partitions.

(From OE-Core rev: e5ba124b01ff6883a08c91daa47343dd09f6260d)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: add /boot mount point to fstab by default
Ed Bartosh [Fri, 28 Jul 2017 09:29:27 +0000 (12:29 +0300)] 
wic: add /boot mount point to fstab by default

wic avoided adding /boot to fstab for no reason.
This exception was hardcoded in the wic code.

There is no need for this as mountpoint in .wks file is an optional
field. It can be used only if user wants to have partitions
automatically mounted on system boot.

[YOCTO #11662]

(From OE-Core rev: 2376b05512ddb8c4ec3aaf1df11071f536a76bd9)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: rootfs: make copied rootfs unique
Ed Bartosh [Fri, 28 Jul 2017 09:29:26 +0000 (12:29 +0300)] 
wic: rootfs: make copied rootfs unique

Used unique suffix (line number from .wks file) for the
copied rootfs directory to avoid possible conflicts.

(From OE-Core rev: 01efc234a8caab67ed3138ab2de9bbd82ce97b44)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: rootfs: fix rootfs path reporting
Ed Bartosh [Fri, 28 Jul 2017 09:29:25 +0000 (12:29 +0300)] 
wic: rootfs: fix rootfs path reporting

wic gets rootfs paths from partition object property
'rootfs_dir' and shows them in final report.

rootfs plugin sets this property to the temporary path,
which causes temporary paths appearing in the report.

Changed the code to prevent storing temporary rootfs path
in part.rootfs_dir. This should fix the report.

(From OE-Core rev: 28d2d7d6f79df08431187c7debaab2a3fa516671)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: use absolute paths in rootfs plugin
Ed Bartosh [Fri, 28 Jul 2017 09:29:24 +0000 (12:29 +0300)] 
wic: use absolute paths in rootfs plugin

Using relative paths can cause copyhardlinktree API to fail as
it changes current directory when working. Converted all paths
to absolute paths using os.path.realpath.

(From OE-Core rev: a1c83cebe986e211dfc31be5cbd748f53fc298df)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agowic: copy rootfs directory before changing fstab
Ed Bartosh [Tue, 25 Jul 2017 11:26:36 +0000 (14:26 +0300)] 
wic: copy rootfs directory before changing fstab

wic updates /etc/fstab on root partition if there are
valid mount points in .wks

When wic runs from bitbake this can cause incorrect results
or even breakage of other tasks working with the same rootfs
directory in parallel with do_image_wic.

Implemented copying rootfs directory to a temporary location
using copyhardlinktree before updating fstab to avoid conflicts with
other tasks working with the same rootfs directory.

(From OE-Core rev: 92e1c7d47e695eb4ce1a863cd0f6c49dca1c2339)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoimage_types.bbclass: ignore tar exit code 1
Ed Bartosh [Fri, 28 Jul 2017 09:29:22 +0000 (12:29 +0300)] 
image_types.bbclass: ignore tar exit code 1

tar exists with 1 and produces warning "file changed as we read it"
if content is changed while tar archives it. Even hardlinking content
causes tar to fail this way as it changes file ctime.

Other tasks running in parallel with do_image_tar may need to hardlink
rootfs content in order to change it, e.g. do_image_wic does this to
update etc/fstab.

Ignored tar exit code 1 to be able to hardlink rootfs content while
do_rootfs_tar is tarring it.

[RP: Removed bashism]

(From OE-Core rev: 402b4cffbb4c58cfee93db18192f2b218ee0ae35)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosystemtap: ensure systemtap-native is available
Saul Wold [Tue, 25 Jul 2017 01:58:25 +0000 (18:58 -0700)] 
systemtap: ensure systemtap-native is available

Since we are adding the addto_sysroot that that is specific to the
native recipe, we must split this into a seperate -native .bb recipe.

When systemtap-native is built, the intention is that it's usable
from the native sysroot when done, ensure it's there with a forced
addto_recipe_sysroot task, we also don't want to clean the sysroot
when RM_WORK is enabled otherwise we loose the binaries.

[YOCTO #11403]

(From OE-Core rev: 98fba18e93abe8efce0a5b40d51e178c9de4d1e5)

Signed-off-by: Saul Wold <sgw@linux.intel.com>
(cherry picked from commit 2fdb59741b4fdeaa4aee10812c4a409cdc11a02d)
Signed-off-by: Saul Wold <sgw@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agooeqa/core/runner: OEStreamLogger don't buffer test execution writes
AnĂ­bal LimĂłn [Wed, 26 Jul 2017 15:04:10 +0000 (10:04 -0500)] 
oeqa/core/runner: OEStreamLogger don't buffer test execution writes

Since OEQA framework uses Python logging functionality to report test
results there is a class that wraps PyUnit writes into logging commands
(OEStreamLogger), so don't buffer the actual test execution to have
insight of what is currently executing.

This fix will change a little the test output format adding an '\n'
previous the test result, for example:

From:

test_nonmatching_checksum (lic_checksum.LicenseTests) ... ok

To:

test_nonmatching_checksum (lic_checksum.LicenseTests)
 ... ok

This is because the new line added by the PyUnit StreamLogger because
currently we don't have a manner to identify when a test execution
starts at report level (write msg).

[YOCTO #11827]

(From OE-Core rev: 4c2276469f58a88f864eb374c00dbbaace702de4)

Signed-off-by: AnĂ­bal LimĂłn <anibal.limon@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agooeqa/{core,selftest}: Add support to validate if a specified test case isn't found
AnĂ­bal LimĂłn [Wed, 26 Jul 2017 15:04:09 +0000 (10:04 -0500)] 
oeqa/{core,selftest}: Add support to validate if a specified test case isn't found

If some test module/case is specified to run and isn't found the OEQA
framework didn't notice it, so complete the implementation using
modules_required and validate for the test case prescense.

Raise an exception when the test module/case required isn't found.

[YOCTO #11645]

(From OE-Core rev: e50b415aaaa1581473f85f0a8afa278b5f95129b)

Signed-off-by: AnĂ­bal LimĂłn <anibal.limon@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agolibpcre: upgrade 8.40 -> 8.41
Andrej Valek [Fri, 21 Jul 2017 14:59:03 +0000 (16:59 +0200)] 
libpcre: upgrade 8.40 -> 8.41

(From OE-Core rev: 07c5eb7f9232ecd4a094040cbe85af2727bd2bd5)

Signed-off-by: Andrej Valek <andrej.valek@siemens.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoncurses: add SYSROOT_DESTDIR for siteconfig_gencache
Jackie Huang [Wed, 31 May 2017 08:27:16 +0000 (16:27 +0800)] 
ncurses: add SYSROOT_DESTDIR for siteconfig_gencache

After switching to Recipe Specific Sysroots, ncurses
will not be populated in its own sysroots, then
siteconfig_gencache fails to find some headers,
so add ${SYSROOT_DESTDIR}/${includedir} into the
search list to fix the issue.

(From OE-Core rev: 2ef34f7fb60ecdff29aae1d54a90a2e765c15e1e)

Signed-off-by: Jackie Huang <jackie.huang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agositeinfo: fix siteinfo_get_files to work with RSS
Jackie Huang [Wed, 31 May 2017 08:27:17 +0000 (16:27 +0800)] 
siteinfo: fix siteinfo_get_files to work with RSS

The siteconfig cache files in ACLOCALDIR setup by autotools.bbclass
has been dropped after switching to RSS, so change the siteconfig
search path back to SITECONFIG_SYSROOTCACHE and the parameter
name changed from aclocalcache to sysrootcache.

(From OE-Core rev: 5b1454304483a0bc725b32fd5458e5281c68112f)

Signed-off-by: Jackie Huang <jackie.huang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodebianutils: set higher priority than busybox for run-parts
Jackie Huang [Tue, 25 Jul 2017 08:38:55 +0000 (16:38 +0800)] 
debianutils: set higher priority than busybox for run-parts

debianutils-run-parts should have higher priority than
busybox (which is 50), so set the priority to 60 for
debianutils-run-parts.

(From OE-Core rev: 56f6fc7d6de0a46046ea2abcc392b1da88e398ec)

Signed-off-by: Jackie Huang <jackie.huang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopackage/bbclass: sources are packaged separately from debug.
Juan M Cruz Alcaraz [Tue, 25 Jul 2017 23:07:52 +0000 (16:07 -0700)] 
package/bbclass: sources are packaged separately from debug.

The configuration variable PACKAGE_DEBUG_SPLIT_STYLE includes
the new mode debug-with-srcpkg that instructs the system to
remove the source files from the debug package but include them in
a separate package with a "-src" suffix in the name.

[YOCTO #9998]

(From OE-Core rev: b8f9ffa37f67172a01837c88c861dc736d267569)

Signed-off-by: Juan M Cruz Alcaraz <juan.m.cruz.alcaraz@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agomodule.bbclass: move make scripts earlier
California Sullivan [Thu, 27 Jul 2017 18:14:06 +0000 (11:14 -0700)] 
module.bbclass: move make scripts earlier

Some out of tree modules require the scripts for configuration. For
example, backport-iwlwifi.

(From OE-Core rev: 7a045f6df2366026d28fe8d36e6d594ce5aa559a)

Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoRevert "core-image-minimal-initramfs: use initramfs-framework by default"
Richard Purdie [Sat, 29 Jul 2017 20:08:43 +0000 (21:08 +0100)] 
Revert "core-image-minimal-initramfs: use initramfs-framework by default"

This reverts commit 28fc6ba761ed4a47efa7c43e7f7dff5e2fe72b5e since it causes
runqemu.RunqemuTests.test_boot_machine_iso and runqemu.RunqemuTests.test_boot_deploy_hddimg
to fail in oe-selftest.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobsp/help: include a warning showing deprecation of create-layer plugin
Leonardo Sandoval [Tue, 25 Jul 2017 22:41:55 +0000 (15:41 -0700)] 
bsp/help: include a warning showing deprecation of create-layer plugin

This plugin will be removed starting 2.5 development in favour
of using 'bitbake-layers create-layer' script/plugin, offering a single
script to manage layers.

(From meta-yocto rev: 76dd79e345d8edb22fc7aefd31f2a1f150916718)

Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: tests/fetch: fix GitShallowTest.test_bitbake
Christopher Larson [Fri, 28 Jul 2017 19:47:53 +0000 (13:47 -0600)] 
bitbake: tests/fetch: fix GitShallowTest.test_bitbake

`git fetch --tags` seems to interact badly with `mirror=fetch`, resulting in
the regular branches not being fetched, so drop the unnecessary `--tags`. This
fixes this unit test failure: `bb.fetch2.FetchError: Fetcher failure: Unable
to resolve 'master' in upstream git repository in git ls-remote output for
/tmp/tmp4ag_mgmn/gitsource`

[YOCTO #11698]

(Bitbake rev: 2d0203fae08c5ff8dc3e9afaa9a819abc4a1af6f)

Signed-off-by: Christopher Larson <chris_larson@mentor.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: main: Always return 0 for bitbake --kill-server
Richard Purdie [Fri, 28 Jul 2017 15:19:56 +0000 (16:19 +0100)] 
bitbake: main: Always return 0 for bitbake --kill-server

If the server isn't running return 0 as to do otherwise complicates
scripts which do cleanup of bitbake servers which would potentially
be memory resident.

(Bitbake rev: 0f85c54385f325f3ebbf911b35bbac11b8863b6b)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Clean up server communication timeout errors
Richard Purdie [Fri, 28 Jul 2017 14:46:20 +0000 (15:46 +0100)] 
bitbake: process: Clean up server communication timeout errors

This timeout path was commonly hit due to errors starting the server. Now we
have a better way to handle that, the retry logic can be improved and cleaned
up. This patch:

* Makes the timeout 5s rather than intervals of 1s with a message. Paul
  noted some commands can take around 1s to run on a server which has just
  been started on a loaded system.
* Allows a broke connection to exit immediately rather than retrying something
  which will never work.
* Drops the Ctrl+C masking, we shouldn't need that anymore and any issues
  would be better handled in other ways.

This should make things clearer and less confusing for users and is much cleaner
code too.

(Bitbake rev: 8633b7cd03cfaba3e0359aa5da22fc76b66768c7)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Don't leak open pipes upon reconnection
Richard Purdie [Fri, 28 Jul 2017 14:42:50 +0000 (15:42 +0100)] 
bitbake: process: Don't leak open pipes upon reconnection

If we reconnect to the server, stop leaking pipes and clean up
after ourselves.

(Bitbake rev: f41e4e971e807157be68cf4496580494b8b60643)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process/cooker: Allow UI process to know if the cooker was started successfully
Richard Purdie [Fri, 28 Jul 2017 14:40:02 +0000 (15:40 +0100)] 
bitbake: process/cooker: Allow UI process to know if the cooker was started successfully

Currently if the server fails to start, the user sees no error message and
the server will be repeatedly attempted to be started until some longer
timeouts expire. There are error messages in the cookerdeamon log but
nobody thinks to look there.

Add in a pipe which can be used to tell the starting process whether the cooker
did actually start or not. If it fails to start, no further attempts can be
made and if present, the log file can be shown to the user.

[YOCTO #11834]

(Bitbake rev: 57000d44beb1aeba37dfc70782b0d6418943acc5)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Move socket keep alive into BitBakeProcessServerConnection
Richard Purdie [Fri, 28 Jul 2017 14:37:29 +0000 (15:37 +0100)] 
bitbake: process: Move socket keep alive into BitBakeProcessServerConnection

This cleans up the socket keep alive into better class structured code
and adds cleanup of the open file descriptors upon shutdown.

(Bitbake rev: 77fd3a3a29a569e212374b27aea742ddbaafcdd5)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Allow BBUIEventQueue to exit cleanly
Richard Purdie [Fri, 28 Jul 2017 14:33:32 +0000 (15:33 +0100)] 
bitbake: process: Allow BBUIEventQueue to exit cleanly

Currently the monitoring thread exits with some error code or runs indefinitely. Allow
closure of the pipe its monitoring to have the thread exit cleanly/silently.

(Bitbake rev: 930d077637928213e13a07c78fee3bf7a8c37ebf)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: process: Ensure ConnectionReader/Writer have fileno() and close() methods
Richard Purdie [Fri, 28 Jul 2017 14:32:25 +0000 (15:32 +0100)] 
bitbake: process: Ensure ConnectionReader/Writer have fileno() and close() methods

Expose the underlying close() and fileno() methods which allow connection
monitoring and cleanup.

(Bitbake rev: f79187f4ebfad7969be47b429995e7f7a3e33c1e)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agobitbake: event: Don't write duplicate logs to stdout and stderr in no UI case
Richard Purdie [Fri, 28 Jul 2017 14:27:28 +0000 (15:27 +0100)] 
bitbake: event: Don't write duplicate logs to stdout and stderr in no UI case

This code would duplicate messages to stdout and stderr when no UI connected
and there were error level messages.

Rework the code so it either uses stderr (for errors and above) or
stdout for warnings/debug but not both for the same messages.

(Bitbake rev: 45cff5734ba2ba8c8d36d17d722a5804d39b258b)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoyocto-project-qs, ref-manual: Upgraded tar to 1.27 from 1.24
Scott Rifenbark [Wed, 26 Jul 2017 00:05:45 +0000 (17:05 -0700)] 
yocto-project-qs, ref-manual: Upgraded tar to 1.27 from 1.24

The minimum version of tar is now 1.27. This was changed in both
the yocto-project-qs and ref-manual.

(From yocto-docs rev: b0fe513e08de860e94a3617fd62382430e321c77)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodev-manual: Added Links for specific container use
Scott Rifenbark [Tue, 25 Jul 2017 23:57:04 +0000 (16:57 -0700)] 
dev-manual: Added Links for specific container use

At the end of the section that describes how to set up the
development machine for CROPS, I added some user links for more
information based on the type of container the use is interested
in.

(From yocto-docs rev: 6888d8454839bbb2ecdf96ce421c7d8723931d65)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodev-manua: Added Crops setup section.
Scott Rifenbark [Fri, 21 Jul 2017 20:57:25 +0000 (13:57 -0700)] 
dev-manua: Added Crops setup section.

(From yocto-docs rev: e2ba131b98705f98463030dde043d858b500690d)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodev-manual: Added steps to set up native linux host
Scott Rifenbark [Thu, 20 Jul 2017 15:14:00 +0000 (08:14 -0700)] 
dev-manual: Added steps to set up native linux host

Fixes [YOCTO #11630]

Added content for steps to set up a native Linux host for using
the Yocto Project.

(From yocto-docs rev: d8a18d382c584dbdfa7f5f190a92cc7cde0f9601)

Signed-off-by: Scott Rifenbark <srifenbark@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agocore-image-minimal-initramfs: use initramfs-framework by default
Ng, Wei Tee [Sun, 23 Jul 2017 23:51:57 +0000 (16:51 -0700)] 
core-image-minimal-initramfs: use initramfs-framework by default

Use the initramfs-framework for initialization by default due to
the modularity and expansibility.

[YOCTO #10987]

(From OE-Core rev: 28fc6ba761ed4a47efa7c43e7f7dff5e2fe72b5e)

Signed-off-by: Ng, Wei Tee <wei.tee.ng@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoinitramfs-framework: include install-efi module in recipe for installation
Ng, Wei Tee [Sun, 23 Jul 2017 23:51:56 +0000 (16:51 -0700)] 
initramfs-framework: include install-efi module in recipe for installation

Utilized the existing init-install-efi.sh script and renamed it to
install-efi.sh to manage the installation process of images in
initramfs-framework model. This script will be executed when
"install" option is being chosen in the grub menu and install
the image on the target platform. A new install-efi module is
being added in the recipe to handle the installation process
using initramfs-framework.

[YOCTO #10989]

(From OE-Core rev: 41b34441c22143cbabace3d794ead05801afb7a0)

Signed-off-by: Ng, Wei Tee <wei.tee.ng@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agoinitramfs-framework: module to support boot live image
Ng, Wei Tee [Sun, 23 Jul 2017 23:51:55 +0000 (16:51 -0700)] 
initramfs-framework: module to support boot live image

setup-live module is a new module being introduced to integrate the
functionality of init-live.sh into new scriptlet named setup-live in
order to support the live boot image. The udev-extraconf rdepends is
being added to perform automounting. It gets to run before the rootfs
and finish module.

The setup-live scriplet include the changes for:

- Create a conditional loop for the bootparam_root variable. If it is
not set, then it will boot from ROOT_IMAGE. Else, it will boot normally
which is not from removable media.

- Gives a standard path to the original boot disk mount which can be
used to. While /media/sda is a good guess, it isn't always right, nor
is it a good assumption that only one boot disk is in the system.

- The current rootfs module has no support for rootfs images, currently
it only support for rootfs partitions for wic image. Therefore, there
is a need to assign the rootfs image for live image.

[YOCTO #11701]

(From OE-Core rev: 4d3300e85a8e65207a415b9cf84c9fa1f71b0406)

Signed-off-by: Ng, Wei Tee <wei.tee.ng@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodbus/dbus-test: upgrade to 1.10.20
Chen Qi [Mon, 24 Jul 2017 09:51:13 +0000 (17:51 +0800)] 
dbus/dbus-test: upgrade to 1.10.20

(From OE-Core rev: 96c54b2ceee7cdeb40efaa3f224766c5ea65d181)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosysstat: upgrade to 11.5.7
Chen Qi [Mon, 24 Jul 2017 09:51:12 +0000 (17:51 +0800)] 
sysstat: upgrade to 11.5.7

(From OE-Core rev: 6ee5abcc67c35d390d12bbc906787b87df80be3b)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agosudo: upgrade to 1.8.20p2
Chen Qi [Mon, 24 Jul 2017 09:51:11 +0000 (17:51 +0800)] 
sudo: upgrade to 1.8.20p2

The checksum for doc/LICENSE is changed, but the content only changes
year from '2013' to '2017', so the license remains the same.

(From OE-Core rev: e1d27852bf21be49db574ed207bc90d42c4bd898)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agocups: upgrade to 2.2.4
Chen Qi [Mon, 24 Jul 2017 09:51:10 +0000 (17:51 +0800)] 
cups: upgrade to 2.2.4

(From OE-Core rev: 6547285f855d9826c2055ea97ceb07eb81aeb841)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agodiffutils: upgrade to 3.6
Chen Qi [Mon, 24 Jul 2017 09:51:09 +0000 (17:51 +0800)] 
diffutils: upgrade to 3.6

diffutils-3.5-gcc7.patch is removed as it's merged in this version.

do_configure_prepend is removed to solve the following configure error.

  error: possibly undefined macro: gl_TYPE_WINT_T_PREREQ

A workaround patch is made to fix the following compilation error for glibc.

  error: dereferencing pointer to incomplete type 'const struct rpl_option'

(From OE-Core rev: 0c09f9f5700696670b2a9d0466124309100eb296)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
8 years agopciutils: upgrade to 3.5.5
Chen Qi [Mon, 24 Jul 2017 09:51:08 +0000 (17:51 +0800)] 
pciutils: upgrade to 3.5.5

(From OE-Core rev: d1e05e9cbddea40ff582fae4ec7e2e7a4f52fd8f)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>