]> git.ipfire.org Git - thirdparty/openembedded/openembedded-core-contrib.git/log
thirdparty/openembedded/openembedded-core-contrib.git
9 years agobdwgc: update to 7.4.4
Alexander Kanavin [Tue, 28 Jun 2016 08:06:11 +0000 (11:06 +0300)] 
bdwgc: update to 7.4.4

Drop 0001-fix-build-with-musl.patch, the problem is fixed upstream.

(From OE-Core rev: d7063e11d2b5dad99e19759137fed734df2e06f5)

Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoterminal: Drop gnome-terminal --disable-factory workarounds
Richard Purdie [Wed, 6 Jul 2016 16:21:59 +0000 (17:21 +0100)] 
terminal: Drop gnome-terminal --disable-factory workarounds

With the new pid monitoring code we have for recent versions of
gnome-terminal we can just drop the --disable-factory code now since
the other solution handles this case as well.

(From OE-Core rev: ed4957c444a2982c19e2f1f96d9afb2a992c1daf)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoterminal: Fix gnome-terminal to work with recent versions
Richard Purdie [Wed, 6 Jul 2016 16:08:57 +0000 (17:08 +0100)] 
terminal: Fix gnome-terminal to work with recent versions

Currently gnome-terminal just returns straight away, opening a terminal in a new
separate process we have no insight into. For patch resolution, this leads to
spawning many different terminal windows, for pydevshell, it just flashes a window
up and then closes.

We need to block until the command completes but gnome-terminal gives us no way
to do this. We therefore write the pid to a file using a "phonehome" wrapper
script, then monitor the pid until it exits.

[YOCTO #7254]
(also fixing do_devpyshell)

(From OE-Core rev: 76e8ab47c936674b8bb9bf1c48de53b30f5bf74a)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopseudo: Upgrade to 1.8.1
Richard Purdie [Tue, 5 Jul 2016 12:18:31 +0000 (13:18 +0100)] 
pseudo: Upgrade to 1.8.1

* Drop patches where the changes exist upstream
* Fetch from git as no tarball is available for 1.8.1
* Move common code to pseudo.inc
* Update patchset in git recipe

(From OE-Core rev: 0c36984d4c501d12fa91cf7371511641585cc256)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooe-selftest: drop test_prepare_unexpected
Paul Eggleton [Thu, 7 Jul 2016 21:17:32 +0000 (09:17 +1200)] 
oe-selftest: drop test_prepare_unexpected

This test refers to a function that no longer exists after the eSDK
install double execution of bitbake has been removed, and since
test_prepare_unexpected is the only test in this module, drop the
entire module. We can easily resurrect it if we have unit tests to add
in the future.

(From OE-Core rev: 7e792a22e62904ed2dafb1ea214911235e3f3efc)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: tests Add selenium test for layerdetails page
Michael Wood [Wed, 6 Jul 2016 17:22:39 +0000 (18:22 +0100)] 
bitbake: toaster: tests Add selenium test for layerdetails page

This tests:
 - Adding remove layer from project
 - Deleting layer
 - Editing layer fields

(Bitbake rev: cabe7e2459fcd561bced2d39ba5bd173576153e5)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: add Layer delete front end feature to layerdetails
Michael Wood [Wed, 6 Jul 2016 17:22:38 +0000 (18:22 +0100)] 
bitbake: toaster: add Layer delete front end feature to layerdetails

Add the front end feature to delete a layer from the layer details page.

[YOCO #9184]

(Bitbake rev: 91815229f60eb9deba7d299f05c69b52ff1df59c)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: api Add util function for returning the error response
Michael Wood [Wed, 6 Jul 2016 17:22:37 +0000 (18:22 +0100)] 
bitbake: toaster: api Add util function for returning the error response

Also clean up flake8 warnings in XhrBuildRequest

(Bitbake rev: aa0845242eda8650a97180bf6675551c26554cde)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: layerdetails api Fix saving of git revision of a layer
Michael Wood [Wed, 6 Jul 2016 17:22:36 +0000 (18:22 +0100)] 
bitbake: toaster: layerdetails api Fix saving of git revision of a layer

Update, clean up and move the api for updating a layerversion from the
views to api. Also update the layerdetails page to include the
layerversion id in the url getter.

[YOCTO #8952]

(Bitbake rev: 20f4e23bc86290f0a42881a7cac44c41eafa86fc)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: buildinfohelper: ensure task datetimes are timezone-aware
Elliot Smith [Wed, 6 Jul 2016 11:00:35 +0000 (12:00 +0100)] 
bitbake: buildinfohelper: ensure task datetimes are timezone-aware

When using toaster-eventreplay to run a bitbake event file
through toasterui/buildinfohelper, errors occur when the
tasks are updated with buildstats info:

  RuntimeWarning: DateTimeField Task.started received a naive
  datetime (2016-07-06 09:15:22.070000) while time zone support
  is active.

This is because a method in buildinfohelper returns a naive
datetime, but Django is expecting timezone-aware datetimes.

Ensure that datetimes used to set the started/ended times on
tasks are converted to timezone-aware datetimes.

(Bitbake rev: df9f4337bec87024ea6a43138c6080a755eb7fab)

Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: eventreplay: rewrite the script
Ed Bartosh [Wed, 6 Jul 2016 11:00:34 +0000 (12:00 +0100)] 
bitbake: eventreplay: rewrite the script

Rewritten toaster-eventreplay to make code working as expected,
more compact and readable.

[YOCTO #9585]

(Bitbake rev: 45370a860b24a761d1b6e08ba752079cc45f54da)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: eventreplay: reorganize imports
Ed Bartosh [Wed, 6 Jul 2016 11:00:33 +0000 (12:00 +0100)] 
bitbake: eventreplay: reorganize imports

Cleaned up module imports:
- Removed unused imports
- Removed import of print_function
- Removed duplicated imports
- Splitted importing bb.lib to 2 lines

(Bitbake rev: 332f5c9b20149e9f5757433df9458ce582ff32dd)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: eventreplay: replace MockConfigParameters with namedtuple
Ed Bartosh [Wed, 6 Jul 2016 11:00:32 +0000 (12:00 +0100)] 
bitbake: eventreplay: replace MockConfigParameters with namedtuple

class MockConfigParameters has only one attribute and only __init__
method. Replacing it with namedtuple makes code less nested and more
readable.

[YOCTO #9585]

(Bitbake rev: 5d4df14b0d38f6c89ca16de6dada58b4bb015d71)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: eventreplay: fix event loading code
Ed Bartosh [Wed, 6 Jul 2016 11:00:31 +0000 (12:00 +0100)] 
bitbake: eventreplay: fix event loading code

Event objects are represented by base64-encoded strings in
the event file and can't be loaded by existing eventreplay code.

Fixed the code of loading events from file by decoding base64 strings
into the binary form and loading them with pickle.load.

[YOCTO #9585]

(Bitbake rev: a55c280c167f84caed6518119246e5a55f56cfd4)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: eventprelay: implement setEventMask command
Ed Bartosh [Wed, 6 Jul 2016 11:00:30 +0000 (12:00 +0100)] 
bitbake: eventprelay: implement setEventMask command

Stored event mask list as self.eventmask for future use.
Fixed Exception: Command setEventMask not implemented.

[YOCTO #9585]

(Bitbake rev: 2e09074c70e89402de8f883dd402cd729118fc7e)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: eventreplay: add MockConnection.getEventHandle method
Ed Bartosh [Wed, 6 Jul 2016 11:00:29 +0000 (12:00 +0100)] 
bitbake: eventreplay: add MockConnection.getEventHandle method

Fixed AttributeError: 'MockConnection' object has no attribute
'getEventHandle'

[YOCTO #9585]

(Bitbake rev: 6deae30480a4288da0c8b3529e61f3495f260f24)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: fix layout for command-line builds in recent builds area
Elliot Smith [Mon, 4 Jul 2016 11:52:53 +0000 (12:52 +0100)] 
bitbake: toaster: fix layout for command-line builds in recent builds area

Command-line builds were displayed incorrectly, so that the
HTML elements for other builds were being "consumed" by the
command-line build elements due to incorrect positioning of
element end tags.

Fix by ensuring end tags close elements in the right places.

As the indentation was all over the place in the most recent
builds section template, it was almost impossible to see what the
problem was. So that was fixed, too.

[YOCTO #9842]

(Bitbake rev: 01659389813ad61d4f75b9f8d71528581322f0b0)

Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: bitbake-worker: don't reassign sys.stdout
Ed Bartosh [Mon, 4 Jul 2016 21:53:59 +0000 (00:53 +0300)] 
bitbake: bitbake-worker: don't reassign sys.stdout

Worker needs input stream in binary mode as it reads binary content
from it. Current code does it by detaching a buffer from sys.stdin
and assigning it back to sys.stdin.

Detached buffer is io.BufferedReader in binary mode. This operation
is implicit as its purpose is not easily understandable from the code.
Replacing it with fdopen(sys.stdin.fileno(), 'rb') should make the
code more understandable.

Assigning the buffer to sys.stdin is not needed as worker doesn't
use sys.stdin. Moreover, it leads to difficult to debug issues down
the stack. For example, devpyshell doesn't work without reopening
sys.stdin in text mode. This is not needed anymore after this fix as
sys.stdin is not changed in worker code and remains in text mode.

(Bitbake rev: b26bcff4c4d72775f1def7e769015464953b955c)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: views Fix most frequently built target in project reporting
Michael Wood [Mon, 4 Jul 2016 15:34:46 +0000 (16:34 +0100)] 
bitbake: toaster: views Fix most frequently built target in project reporting

Clean up and fix the most frequently built targets for the "Most built
recipes" section for the project configuration page.

[YOCTO #9846]

(Bitbake rev: 860475cfdd35301fb609ab3c89347566b0ca0adc)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: layerBtn avoid connecting handler to other build buttons
Michael Wood [Mon, 4 Jul 2016 15:34:45 +0000 (16:34 +0100)] 
bitbake: toaster: layerBtn avoid connecting handler to other build buttons

Some pages contain other build buttons which may have the same class
attached. Make sure that we only select the buttons in the tables where
layerBtn is used.

[YOCTO #9841]

(Bitbake rev: ec083fd943c6996307beb3be3421403870d2f2b7)

Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: bitbake: toaster-tests: tests for project config
Sujith H [Wed, 22 Jun 2016 09:10:42 +0000 (10:10 +0100)] 
bitbake: bitbake: toaster-tests: tests for project config

Add basic tests to validate the value, user types
in the text box for DL_DIR and SSTATE_DIR. Added
test case to validate the first char and inclusion
of space between the characters.

[YOCTO #9646]

(Bitbake rev: 1531e98c5ae1693d11d692c3589df29dff9364df)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: fix validation checks for DL_DIR and SSTATE_DIR
Sujith H [Wed, 22 Jun 2016 09:10:41 +0000 (10:10 +0100)] 
bitbake: toaster: fix validation checks for DL_DIR and SSTATE_DIR

Validation logic on the project configuration page
prevented a user from adding ${variable} to these paths.

Update validation so a user can see a better message
when they type characters into the text inputs.
Two types of validation are implemented.

Either:

* The value should start with a "/", to allow absolute paths.

or

* The value should start with a "$", to allow bitbake
   variables like ${TOPDIR}.

[YOCTO #9646]

(Bitbake rev: fca50153caef62a473d1812fd59ec7effe09f8c5)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Elliot Smith <elliot.smith@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: remove SSTATE_MIRRORS from projectconf
Sujith H [Fri, 24 Jun 2016 15:25:54 +0000 (16:25 +0100)] 
bitbake: toaster: remove SSTATE_MIRRORS from projectconf

Remove SSTATE_MIRRORS from getting blacklisted. Hence the SSTATE_MIRRORS
should be removed from projectconf.html file so that users can know that
this variable is no more blacklisted.

[YOCTO #9598]

(Bitbake rev: b060eecae417521d8340748e7ace7a77488bd596)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: toaster: remove SSTATE_MIRRORS from blacklists in views
Sujith H [Fri, 24 Jun 2016 15:25:53 +0000 (16:25 +0100)] 
bitbake: toaster: remove SSTATE_MIRRORS from blacklists in views

Remove SSTATE_MIRRORS variable from blacklists in views.py
This helps user to point mirrors using SSTATE_MIRRORS with
toaster.

[#YOCTO 9598]

(Bitbake rev: c3dd4fb193c80ed9a6dbddf7f6a1eadd0964ac8c)

Signed-off-by: Sujith H <sujith.h@gmail.com>
Signed-off-by: Michael Wood <michael.g.wood@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: progress: Ensure missing start event is fired
Richard Purdie [Thu, 7 Jul 2016 13:27:43 +0000 (14:27 +0100)] 
bitbake: progress: Ensure missing start event is fired

The init function of the parent class fires a progress event for 0
progress rather than a start event. UI code was assuming that progress
events should always have a start event first. This change ensures that
the start event is correctly generated.

This fixes crashes that were seen in knotty in some configurations.

(Bitbake rev: 9841651e050a3e9f395ab3c62545c51197734584)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: knotty: Handle process indicators more gracefully
Richard Purdie [Thu, 7 Jul 2016 13:26:34 +0000 (14:26 +0100)] 
bitbake: knotty: Handle process indicators more gracefully

Mistakes can happen with the generation of the progress events, change
knotty to be more tolerant of this rather than crashing, reporting to the
user when something unexpected happens. I haven't debugged why multiple
finish events appear to be triggered.

(Bitbake rev: 7dd06b1016b36420a9c55a45ff29dd64ae1dbcda)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: runqueue: report progress for "Preparing RunQueue" step
Paul Eggleton [Thu, 23 Jun 2016 10:59:12 +0000 (22:59 +1200)] 
bitbake: runqueue: report progress for "Preparing RunQueue" step

When "Preparing RunQueue" shows up you can expect to wait up to 30
seconds while it works - which is a bit long to leave the user waiting
without any kind of output. Since the work being carried out during this
time is divided into stages such that it's practical to determine
internally how it's progressing, replace the message with a progress
bar.

Actually what happens during this time is two major steps rather than
just one - the runqueue preparation itself, followed by the
initialisation prior to running setscene tasks. I elected to have the
progress bar cover both as one (there doesn't appear to be much point in
doing otherwise from a user perspective). I did however describe it as
"initialising tasks".

(Bitbake rev: 591e9741e108487ff437e77cb439ef2dbca42e03)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: runqueue: add ability to enforce that tasks are setscened
Paul Eggleton [Thu, 23 Jun 2016 10:59:11 +0000 (22:59 +1200)] 
bitbake: runqueue: add ability to enforce that tasks are setscened

Add the ability to enter a mode where only a specified whitelist of
tasks can be executed outright; everything else must be successfully
provided in the form of a setscene task (or covered by a setscene task).
Any setscene failure outside of the whitelist will cause the build to
fail immediately instead of running the real task, and any real tasks
that would execute outside of the whitelist cause an immediate build
failure when it comes to executing the runqueue as well.

The mode is enabled by setting BB_SETSCENE_ENFORCE="1", and the
whitelist is specified through BB_SETSCENE_ENFORCE_WHITELIST, consisting
of pn:taskname pairs. A single % character can be substituted for the pn
value to match any target explicitly specified on the bitbake command
line. Wildcards * and ? can also be used as per standard unix file name
matching for both pn and taskname.

Part of the implementation of [YOCTO #9367].

(Bitbake rev: 624722c067a7fdd0c0f5d8be611e1f6666ecc4a2)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: knotty: add quiet output mode
Paul Eggleton [Thu, 23 Jun 2016 10:59:10 +0000 (22:59 +1200)] 
bitbake: knotty: add quiet output mode

Quiet output mode disables printing most messages (below warnings) to
the console; however these messages still go to the console log file.
This is primarily for cases where bitbake is being launched
interactively from some other process, but where full console output is
not needed.

Because of the need to keep logging all normal events to the console
log, this functionality was implemented within the knotty UI rather
than in bb.msg (where verbose mode is implemented). We don't currently
have a means of registering command line options from the UI end, thus
the option actually has to be registered in main.py regardless of the
UI, however I didn't feel like it was worth setting up such a mechanism
just for this option.

(Bitbake rev: db95cdef08e339dec7462bfde3ad7d75c1c60dd8)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: knotty: show task progress bar
Paul Eggleton [Thu, 23 Jun 2016 10:59:09 +0000 (22:59 +1200)] 
bitbake: knotty: show task progress bar

In addition to the "currently running n tasks (x of y)" message, show a
progress bar for another view on how much of the build is left. We have
to take care to reset it when moving from the scenequeue to the
runqueue, and explicitly don't include an ETA since not all tasks take
equal time and thus it isn't possible to estimate the time remaining
with the information available.

(Bitbake rev: de682015a3fefeff36ddc4197641a700f3fb558d)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: knotty: add code to support showing progress for sstate object querying
Paul Eggleton [Thu, 23 Jun 2016 10:59:08 +0000 (22:59 +1200)] 
bitbake: knotty: add code to support showing progress for sstate object querying

Add support code on the BitBake side to allow sstate.bbclass in
OpenEmbedded to report progress when it is checking for availability of
artifacts from shared state mirrors.

Part of the implementation for [YOCTO #5853].

(Bitbake rev: 070ae856da0715dbaf4c560c837ea796ffc29f00)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: lib/bb/progress: add MultiStageProgressReporter
Paul Eggleton [Thu, 23 Jun 2016 10:59:06 +0000 (22:59 +1200)] 
bitbake: lib/bb/progress: add MultiStageProgressReporter

Add a class to help report progress in a task that consists of multiple
stages, some of which may have internal progress (do_rootfs within
OpenEmbedded is one example). Each stage is weighted to try to give
a reasonable representation of progress over time.

Part of the implementation for [YOCTO #5383].

(Bitbake rev: 751b75602872a89e8b1a7c03269bc0fdaa149c6f)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: lib: implement basic task progress support
Paul Eggleton [Thu, 23 Jun 2016 10:59:05 +0000 (22:59 +1200)] 
bitbake: lib: implement basic task progress support

For long-running tasks where we have some output from the task that
gives us some idea of the progress of the task (such as a percentage
complete), provide the means to scrape the output for that progress
information and show it to the user in the default knotty terminal
output in the form of a progress bar. This is implemented using a new
TaskProgress event as well as some code we can insert to do output
scanning/filtering.

Any task can fire TaskProgress events; however, if you have a shell task
whose output you wish to scan for progress information, you just need to
set the "progress" varflag on the task. This can be set to:
 * "percent" to just look for a number followed by a % sign
 * "percent:<regex>" to specify your own regex matching a percentage
   value (must have a single group which matches the percentage number)
 * "outof:<regex>" to look for the specified regex matching x out of y
   items completed (must have two groups - first group needs to be x,
   second y).
We can potentially extend this in future but this should be a good
start.

Part of the implementation for [YOCTO #5383].

(Bitbake rev: 0d275fc5b6531957a6189069b04074065bb718a0)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: knotty: import latest python-progressbar
Paul Eggleton [Thu, 23 Jun 2016 10:59:04 +0000 (22:59 +1200)] 
bitbake: knotty: import latest python-progressbar

Since we're going to make some minor extensions to it, it makes sense to
bring in the latest version of python-progressbar. Its structure has
changed a little but the API hasn't; however we do need to ensure our
overridden _needs_update() function's signature in BBProgress() matches
properly.

(Bitbake rev: c3e51d71b36cbc9e9ed1b35fb93d0978e24bc98a)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: knotty: provide a symlink to the latest console log
Paul Eggleton [Thu, 23 Jun 2016 10:59:03 +0000 (22:59 +1200)] 
bitbake: knotty: provide a symlink to the latest console log

If you're looking to find the latest console log repeatedly it can be a bit
tedious - let's just create a symlink just as we do with other logs to
make it easy to find.

(Bitbake rev: e9f41c0507a6527bf2ed86506813d4d4a89f8ebf)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake: fetch2/wget: attempt checkstatus again if it fails
Ross Burton [Thu, 30 Jun 2016 21:32:24 +0000 (22:32 +0100)] 
bitbake: fetch2/wget: attempt checkstatus again if it fails

Some services such as SourceForge seem to struggle to keep up under load, with
the result that over half of the autobuilder checkuri runs fail with
sourceforge.net "connection timed out".

Attempt to mitigate this by re-attempting once the network operation on failure.

(Bitbake rev: 54b1961551511948e0cbd2ac39f19b39b9cee568)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa/selftest/bbtests: Fix failing test after progress changes
Richard Purdie [Fri, 8 Jul 2016 08:49:01 +0000 (09:49 +0100)] 
oeqa/selftest/bbtests: Fix failing test after progress changes

The progress patches change the output slightly, update the test to
deal with this.

(From OE-Core rev: 90dbd838fa97c89ace5cb147aa5cff39b94178b1)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa/runtime/systemd: fix typo in skipUnlessPassed decorator
Ross Burton [Wed, 6 Jul 2016 15:29:15 +0000 (16:29 +0100)] 
oeqa/runtime/systemd: fix typo in skipUnlessPassed decorator

(From OE-Core rev: f0420d8c934154a94957cabcfdc993f0eae92cd7)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoservice: obey CFLAGS, LDFLAGS
Christopher Larson [Fri, 1 Jul 2016 20:49:09 +0000 (13:49 -0700)] 
service: obey CFLAGS, LDFLAGS

(From OE-Core rev: 8a227125991951c1ddd44bec0b6243474ebc363a)

Signed-off-by: Christopher Larson <chris_larson@mentor.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoinitramfs-framework: Add support for PartUUIDs
Igor Stoppa [Fri, 1 Jul 2016 13:53:52 +0000 (15:53 +0200)] 
initramfs-framework: Add support for PartUUIDs

The rootfs can be addressed also by referring to the PartUUID
value from the GPT.
This patch enables such type of reference.

(From OE-Core rev: 1ab2ca141d3defe4b80212e28ac7c3f2271e2515)

Signed-off-by: Igor Stoppa <igor.stoppa@intel.com>
Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoinitramfs-framework: add retry loop for slow boot devices (like USB)
Patrick Ohly [Fri, 1 Jul 2016 13:53:51 +0000 (15:53 +0200)] 
initramfs-framework: add retry loop for slow boot devices (like USB)

On some hardware platforms (Gigabyte, qemu), detection of USB devices
by the kernel is slow enough such that it happens only after the first
attempt to mount the rootfs. We need to keep trying for a while
(default: 5s seconds, controlled by roottimeout=<seconds>) and sleep
between each attempt (default: one second, rootdelay=<seconds>).

This change intentionally splits finding the rootfs (in the new
"rootfs") and switching to it ("finish"). That is needed to keep udev
running while waiting for the rootfs, because it shuts down before
"finish" starts. It is also the direction that was discussed on the OE
mailing list for future changes to initramfs-framework (like
supporting a "live CD" module, which would replace or further augment
mounting of the rootfs).

(From OE-Core rev: 2a50bb9ee8838e3d026c82dc09aaccb880a264f4)

Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolib/oe/path: remove oe.path.check_output
Ross Burton [Fri, 1 Jul 2016 15:58:39 +0000 (16:58 +0100)] 
lib/oe/path: remove oe.path.check_output

This was a copy-and-paste of subprocess.check_output() from when we supported
Python <2.7, so simply delete it and use subprocess.check_output() instead.

(From OE-Core rev: b1f2d9ed8d4dc89c9e669f43f546463ccc2a76b9)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoscripts: Fixed typo in parameter that was causing exception
Humberto Ibarra [Fri, 1 Jul 2016 15:37:24 +0000 (10:37 -0500)] 
scripts: Fixed typo in parameter that was causing exception

There is a typo in the logging parameters, "filname" is being used instead of "filename" for yocto-kernel, yocto-layer and wic scripts. This didn't cause issues before since python 2 didn't validate unused parameters but with python >= 3.4.3 an exception is thrown. This patch fixes this parameter name.

[YOCTO #9834]

(From OE-Core rev: 5d123a6ec0e97652b2ec4295428797a336ef357a)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agort-tests: move ptest to python3
Maxin B. John [Fri, 1 Jul 2016 08:39:02 +0000 (11:39 +0300)] 
rt-tests: move ptest to python3

convert python2 based ptest of rt-tests package to python3

(From OE-Core rev: 2767cbe014f84c9ad42ed8ef1eca7caa862e5196)

Signed-off-by: Maxin B. John <maxin.john@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agogcc: remove GCC 4.9
Ross Burton [Fri, 1 Jul 2016 12:28:26 +0000 (13:28 +0100)] 
gcc: remove GCC 4.9

(From OE-Core rev: 615b784bd3d53a77b7e34e3879a72e7e51477db6)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agogcc: remove unused patch
Ross Burton [Fri, 1 Jul 2016 12:27:34 +0000 (13:27 +0100)] 
gcc: remove unused patch

(From OE-Core rev: 8833e419e898d741900be3f03f8d8d4ef123aa1a)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agogcc-5.4: Fix hang with mmusl option on cmdline
Khem Raj [Thu, 30 Jun 2016 02:57:56 +0000 (19:57 -0700)] 
gcc-5.4: Fix hang with mmusl option on cmdline

When using -m32 -mmusl options in this order, gcc hangs
in parsing the options decode_cmdline_options_to_array()
the reason is that we have broken the link when adding
mmusl options, the order of specifying libc was not kept
in order as a result it was unable to contruct the array
correctly and ended in parse hang.

We fix the options to specify the order properly.

(From OE-Core rev: b362cf6ef6d7fa22a525cf3e1d17943e897bd8aa)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopulseaudio: Disable unit tests
Davis, Michael [Thu, 30 Jun 2016 14:18:21 +0000 (14:18 +0000)] 
pulseaudio: Disable unit tests

(From OE-Core rev: 92cfdb2ba7e04e2b70986c6569f500dd2a48b5d1)

Signed-off-by: Michael Davis <michael.davis@essvote.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agosocat: remove the hardcoded shifting offset
Zhenhua Luo [Thu, 30 Jun 2016 10:22:29 +0000 (18:22 +0800)] 
socat: remove the hardcoded shifting offset

The hardcoded shifting offset causes the following runtime error:
| socat: xioinitialize.c:41: xioinitialize: Assertion `3 <<
| opt_crdly.arg3 == 00030000' failed.

(From OE-Core rev: 9dab6d1113e9aec9cbfce4c57ae5a85b1a032cbb)

Signed-off-by: Zhenhua Luo <zhenhua.luo@nxp.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agorunqemu: Avoid duplicating custom QEMU options for AArch64
Otavio Salvador [Wed, 29 Jun 2016 20:08:11 +0000 (17:08 -0300)] 
runqemu: Avoid duplicating custom QEMU options for AArch64

When detecting the second serial options we shouldn't append the
custom QEMU options otherwise we will end duplicating those.

(From OE-Core rev: 79798f20b2c0b98d84c3c4b14600635ff8ddfdad)

Signed-off-by: Otavio Salvador <otavio@ossystems.com.br>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolibpfm4: fix compile error
Kai Kang [Wed, 29 Jun 2016 08:08:45 +0000 (16:08 +0800)] 
libpfm4: fix compile error

It fails to compile libpfm4 with misleading-indentation error:

| syst_count.c:346:3: error: this 'for' clause does not guard...  [-Werror=misleading-indentation]
|   for(c=cmin ; c < cmax; c++)
|      ^~~

Add clauses to fix it.

(From OE-Core rev: 2857658ff5e477cb436cf2778a78fa9f192caab8)

Signed-off-by: Kai Kang <kai.kang@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoclasses/populate_sdk_ext: exclude initramfs images from locked signatures
Paul Eggleton [Wed, 29 Jun 2016 03:13:52 +0000 (15:13 +1200)] 
classes/populate_sdk_ext: exclude initramfs images from locked signatures

Tasks for image recipes cannot be locked - there's nothing to restore
from shared state to cover them and as a result, if you had "live" in
IMAGE_FSTYPES the build would fail with "taskhash mismatch" errors for
do_rootfs and do_image_complete for the initramfs image recipe, since it
had to try to run those. We should probably catch that issue earlier in
the build and produce a proper error, but for now at least exclude these
signatures from the locked-sigs.inc file so that extensible SDK
installers built when IMAGE_FSTYPES includes "live". (It turned out we
already had code to find other image tasks in the task list in order to
generate the list of install targets.)

Follow-up fix for [YOCTO #9826].

(From OE-Core rev: a7133bf6bb650b944d29d01129f36a56282acd2b)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoclasses/populate_sdk_ext: ensure tasks to build the image are included
Paul Eggleton [Wed, 29 Jun 2016 03:13:51 +0000 (15:13 +1200)] 
classes/populate_sdk_ext: ensure tasks to build the image are included

If you build an extensible SDK for an image and IMAGE_FSTYPES includes
"live" then the extensible SDK will fail to install with a bunch of
unexpected task execution errors, matching the missing items required to
build the live image. The issue was we were still depending on do_rootfs
rather than do_image_complete. The fix was slightly more complicated
than just changing the task name as do_image_complete's dependencies are
in the form of dependencies on tasks within the same recipe (represented
in the "deps" varflag rather than the "depends" varflag).

Fixes [YOCTO #9826].

(From OE-Core rev: 2b9c092e89b421bf7fd6a7c9604a83ae420d85ba)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agorecipetool: create: drop unused convert_pkginfo() function
Paul Eggleton [Wed, 29 Jun 2016 03:12:04 +0000 (15:12 +1200)] 
recipetool: create: drop unused convert_pkginfo() function

Code cleanup, no functional changes - this code was never used.

(From OE-Core rev: 397b76c7f26e38e761b94b1f7987aafd55048e10)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agorecipetool: create: avoid decoding errors with Python 3
Paul Eggleton [Wed, 29 Jun 2016 03:12:03 +0000 (15:12 +1200)] 
recipetool: create: avoid decoding errors with Python 3

We're opening source files with the default encoding (utf-8) but we
can't necessarily be sure that they are UTF-8 clean - for example,
recipetool create ftp://mama.indstate.edu/linux/tree/tree-1.7.0.tgz
prior to this patch resulted in a UnicodeDecodeError. Use the
"surrogateescape" mode to avoid this.

Fixes [YOCTO #9822].

(From OE-Core rev: 50fcd9d1b9a20d49bc873467a82a071f2f2f8b5a)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoautogen-native: fix script error when processing libguile
Zhenbo Gao [Tue, 5 Jul 2016 08:25:15 +0000 (16:25 +0800)] 
autogen-native: fix script error when processing libguile

do_configure for autogen-native would fail if build directory path
contains '-I' characters, which is caused by the unsuitable sed script
when processing libguile.

Error log:
[snip]
checking for GUILE... yes
awk: fatal: cannot open file `/buildarea1/poky/build /libguile/version.h' for reading (No such file or directory)
configure: error: in `/buildarea1/poky/build-Ice/tmp/work/x86_64-linux/autogen-native/5.18.10-r0/build':
configure: error: cannot determine Guile version
[snip]

(From OE-Core rev: 2004307044e958cdf508b72f180e238a3e297179)

Signed-off-by: Zhenbo Gao <zhenbo.gao@windriver.com>
Signed-off-by: Yi Zhao <yi.zhao@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agol3afpad: add check for GTK3DISTROFEATURES
Joe Slater [Tue, 28 Jun 2016 20:53:21 +0000 (13:53 -0700)] 
l3afpad: add check for GTK3DISTROFEATURES

We want world builds without GTK3DISTROFEATURES to work.

(From OE-Core rev: 0b2945588f7b539836369895dc7d3d2629abb431)

Signed-off-by: Joe Slater <jslater@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agogettext: fix for low-version recipe
Chen Qi [Mon, 4 Jul 2016 06:41:15 +0000 (14:41 +0800)] 
gettext: fix for low-version recipe

Make gettext-native in 0.16.1 recipe provides virtual/gettext-native like
what gettext-native in 0.19.6 recipe does. Otherwise we would fail to start
to do a world build if gettext and gettext-native are set to the low version.
Error message is like below.

  ERROR: Multiple versions of gettext-native are due to be built

(From OE-Core rev: a0bdbd8f38d8d2ca0687f4353b715087f946247a)

Signed-off-by: Chen Qi <Qi.Chen@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolibidn: add patch to build w/ -Wformat-security
André Draszik [Tue, 28 Jun 2016 11:53:15 +0000 (12:53 +0100)] 
libidn: add patch to build w/ -Wformat-security

While the file in question is a command line utility
only, let's be clean and still fix it.

(From OE-Core rev: 40636c1ef853be01541b89d9b6f1321bbeefe8f3)

Signed-off-by: André Draszik <adraszik@tycoint.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agometa: update patch metadata
Ross Burton [Mon, 27 Jun 2016 19:59:19 +0000 (20:59 +0100)] 
meta: update patch metadata

Enforce the correct tag names across all of oe-core for consistency.

(From OE-Core rev: 606a43dc38a00cc243f933722db657aea4129f8e)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agorun-postinsts: Correct comment misspelling, "rpm-posinsts".
Robert P. J. Day [Tue, 5 Jul 2016 12:34:43 +0000 (08:34 -0400)] 
run-postinsts: Correct comment misspelling, "rpm-posinsts".

(From OE-Core rev: 45048442913687f2817ef9a52352fe3214f5f023)

Signed-off-by: Robert P. J. Day <rpjday@crashcourse.ca>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooepydevshell-internal: python3: encode/decode pty content
Ed Bartosh [Mon, 4 Jul 2016 22:08:15 +0000 (01:08 +0300)] 
oepydevshell-internal: python3: encode/decode pty content

As /dev/pty opened in binary mode its content has to
be decoded when reading from it and encoded when writing to it.

(From OE-Core rev: 211870ddbce5c966b2882e97cb2efe29b72a62a4)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodevpyshell: python3: flush stdout explicitly
Ed Bartosh [Mon, 4 Jul 2016 22:08:14 +0000 (01:08 +0300)] 
devpyshell: python3: flush stdout explicitly

Opening text stream in unbuffered mode raises the following
exception In Python 3:
    ValueError: can't have unbuffered text I/O

Fixed by leaving std* streams in text mode and flushing
stdout explicitly.

(From OE-Core rev: 732001cb268683f5b56e251e2964ec5b694a2147)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agodevshell.bbclass: fix double unbuffering
Ed Bartosh [Mon, 4 Jul 2016 22:08:13 +0000 (01:08 +0300)] 
devshell.bbclass: fix double unbuffering

stdout is already unbuffered in bitbake code. Attempt to
do it again in devshell.bbclass causes this crash when
running devpyshell:
  File "scripts/oepydevshell-internal.py", line 29, in <module>
      pty = open(sys.argv[1], "w+b", 0)
  IOError: [Errno 13] Permission denied: '/dev/pts/6'

(From OE-Core rev: 875910451e1ce97d0c42b41b1140c8160ed1f40a)

Signed-off-by: Ed Bartosh <ed.bartosh@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopseudo: drop recipe for old 1.6.7 version
Joshua Lock [Tue, 5 Jul 2016 12:18:30 +0000 (13:18 +0100)] 
pseudo: drop recipe for old 1.6.7 version

(From OE-Core rev: 66cda3c6a281fd06e787ddbeb03f4796aae0feb8)

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoclasses/cmake: enable progress for do_compile
Paul Eggleton [Thu, 23 Jun 2016 12:06:58 +0000 (00:06 +1200)] 
classes/cmake: enable progress for do_compile

cmake outputs percentage complete as part of its compilation process, so
we can enable BitBake's new progress scanning for do_compile here.

(From OE-Core rev: f77ea95ba5cd337f01f2a1b4fe9466feb6af9440)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoclasses/populate_sdk_ext: eliminate double execution on install
Paul Eggleton [Thu, 23 Jun 2016 12:07:03 +0000 (00:07 +1200)] 
classes/populate_sdk_ext: eliminate double execution on install

Use the new BB_SETSCENE_ENFORCE functionality to avoid having to run
bitbake twice on installing the extensible SDK - we can now do it all in
one invocation which not only takes less time, but we should also get
more meaningful errors for some types of failure, in particular where
downloading from an sstate mirror fails.

One result of this change is that you get the errors printed on the
console during normal output rather than this going to the
preparing_build_system.log file first. In OE-Core revision
227d2cbf9e0b8c35fa6644e3d72e0699db9607fa, we changed to always print the
contents of preparing_build_system.log on failure, but now at least the
error contents of that log is duplicated. Besides, I intentionally
didn't print out the contents of that log during normal usage because
it's quite verbose - the bug that we were attempting to fix was about
not getting this information when seeing failures in the automated
tests, thus I've moved printing the log to the test handling code
instead.

Part of the implementation of [YOCTO #9367].

(From OE-Core rev: e1390c1ef85862b91b067ab24f3c06ca506155ad)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agotoolchain-shar-extract.sh: allow TERM through into SDK installer env
Paul Eggleton [Thu, 23 Jun 2016 12:07:06 +0000 (00:07 +1200)] 
toolchain-shar-extract.sh: allow TERM through into SDK installer env

In order to show the task progress during the extensible SDK
installation, knotty needs to know it is using a terminal it can
support the "interactive" mode on (i.e. ncurses can be used), which
means it needs access to the TERM variable value, so allow that
through into the cleaned environment within the SDK installation
script.

Part of the implementation for [YOCTO #9613].

(From OE-Core rev: a8f11bc5ce07114b9ec7da7ad48da62e2026cd74)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolib/oe/sstatesig: print locked sigs file message only when explicitly called
Paul Eggleton [Thu, 23 Jun 2016 12:07:04 +0000 (00:07 +1200)] 
lib/oe/sstatesig: print locked sigs file message only when explicitly called

If we're building the extensible SDK we don't need to see the "Writing
locked sigs" message; it's only necessary when the user explicitly runs
bitbake -S none <target>.

(From OE-Core rev: 440a351ee13920045c9d3e51882908f7b3f01d35)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoclasses/testsdk: print output correctly on failure
Paul Eggleton [Thu, 23 Jun 2016 12:07:02 +0000 (00:07 +1200)] 
classes/testsdk: print output correctly on failure

With Python 3 we get a bytes object from the command output and not a
string, which gives some ugly formatting for error messages unless you
decode it first.

(From OE-Core rev: 798bec6fe43116b51247284eb4e415337b2e8e04)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoclasses/sstate: add a mode to error if sstate package unavailable
Paul Eggleton [Thu, 23 Jun 2016 12:07:01 +0000 (00:07 +1200)] 
classes/sstate: add a mode to error if sstate package unavailable

If BB_SETSCENE_ENFORCE is set to "1" and an sstate package fails to
download outside of the whitelist specified by
BB_SETSCENE_ENFORCE_WHITELIST, then fail immediately so you can tell
that the problem was caused by failing to restore the task from sstate.

Part of the implementation of [YOCTO #9367].

(From OE-Core rev: 9e711b54487c3141d7264b8cf0d74f9465020190)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoclasses/sstate: show progress during sstate object availability check
Paul Eggleton [Thu, 23 Jun 2016 12:07:00 +0000 (00:07 +1200)] 
classes/sstate: show progress during sstate object availability check

Show progress through bitbake's standard terminal UI when checking for
shared state object availability, since this can take some time if there
are a large number of tasks to be executed and/or the network connection
is slow.

Part of the implementation for [YOCTO #5853].

(From OE-Core rev: 1a064385d6921ec90b33c9064dafaab11a36267c)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoclasses/image: implement progress support for do_rootfs
Paul Eggleton [Thu, 23 Jun 2016 12:06:59 +0000 (00:06 +1200)] 
classes/image: implement progress support for do_rootfs

Use the new task progress functionality to report progress during
do_rootfs. This is a little coarse and ideally we would have some
progress within the installation section, but it's better than
nothing.

(From OE-Core rev: 370f08d434480c1790950e40db8f7687da78cb14)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agobitbake.conf: whitelist progress varflag
Paul Eggleton [Thu, 23 Jun 2016 12:06:57 +0000 (00:06 +1200)] 
bitbake.conf: whitelist progress varflag

We don't want the value of this varflag in any signatures since it's
only there for the purpose of aiding display of task execution.

(From OE-Core rev: 1f33659a92b2d4b1514984183384fbdcf72ddb99)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoscripts/lib/bsp/help.py: Changed help of yocto-bsp to match latest syntax
Humberto Ibarra [Mon, 4 Jul 2016 20:33:34 +0000 (15:33 -0500)] 
scripts/lib/bsp/help.py: Changed help of yocto-bsp to match latest syntax

With the changes to migrate from optparse to argparse there was a syntax change that needs an update in the help. This is basically just the change of 'properties' and 'property' from positional arguments to options. This patch makes the required changes.

[YOCTO #8321]

(From meta-yocto rev: b171379b5ca54d55ea763421794a651e71bbda91)

Signed-off-by: Humberto Ibarra <humberto.ibarra.lopez@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoyocto-bsp: Refactor script to use argparse instead of optparse
Humberto Ibarra [Mon, 4 Jul 2016 20:33:33 +0000 (15:33 -0500)] 
yocto-bsp: Refactor script to use argparse instead of optparse

Optparse is deprecated and should be avoided. The arparse library is better suited and has more tools to handling the parsing of arguments. This patch makes necessary changes to migrate to the better library and uses arparse subcommand feature to improve organization of this script.

[YOCTO #8321]

(From meta-yocto rev: 3f45993b96d4d960da0efe8672dc323c9db091a2)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoscripts/yocto-bsp: Removing version from yocto-bsp
Humberto Ibarra [Mon, 4 Jul 2016 20:33:32 +0000 (15:33 -0500)] 
scripts/yocto-bsp: Removing version from yocto-bsp

The version option is not maintained and is useless inside this script.
There is no reason for this script to have an independent version value.

[YOCTO #8321]

(From meta-yocto rev: 8f8790e56d00f2eaaf6508fb1909335f1fbef5ff)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoscripts/lib/bsp/engine.py: Add error message for wrong input file
Humberto Ibarra [Mon, 4 Jul 2016 19:54:53 +0000 (14:54 -0500)] 
scripts/lib/bsp/engine.py: Add error message for wrong input file

Format of properties file is expected to be a simple json detailing properties, if this format fails an exception is thrown. This patch adds a graceful error message to the case when the properties file has a wrong format.

[YOCTO #9750]

(From meta-yocto rev: 7e543aa19d0d4b2112e6316783fb31b76df3493e)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoscripts/lib/bsp/help.py: Fixed pager for yocto-bsp help
Humberto Ibarra [Sat, 2 Jul 2016 18:17:56 +0000 (13:17 -0500)] 
scripts/lib/bsp/help.py: Fixed pager for yocto-bsp help

Python3 requires strings to be encoded as bytes before sending them through a subprocess pipe. The help.py file is not considering this and fails when issuing paged help commands. This patch adds this encoding to solve the problem.

[YOCTO #9868]

(From meta-yocto rev: 35b487a47f0cbb99fdee2ec9cc8b56b814c8860e)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoscripts: Fixed typo in parameter that was causing exception
Humberto Ibarra [Fri, 1 Jul 2016 15:37:24 +0000 (10:37 -0500)] 
scripts: Fixed typo in parameter that was causing exception

There is a typo in the logging parameters, "filname" is being used instead of "filename" for yocto-kernel, yocto-layer and wic scripts. This didn't cause issues before since python 2 didn't validate unused parameters but with python >= 3.4.3 an exception is thrown. This patch fixes this parameter name.

[YOCTO #9834]

(From meta-yocto rev: 844fbba63b146a2ded3fced0d62bf047bf844af3)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agometa-yocto: Delete PREFERRED_VERSION for obsolete version of U-Boot.
Robert P. J. Day [Mon, 4 Jul 2016 10:47:43 +0000 (06:47 -0400)] 
meta-yocto: Delete PREFERRED_VERSION for obsolete version of U-Boot.

The OE recipe for U-Boot v2013.07 was deleted in 2014, so remove this
reference to it.

(From meta-yocto rev: a864e357f8d02ba52a38a96fd8b03f01c60888e8)

Signed-off-by: Robert P. J. Day <rpjday@crashcourse.ca>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolocal.conf.sample.extended: drop RPM4 example
Paul Eggleton [Wed, 29 Jun 2016 03:09:16 +0000 (15:09 +1200)] 
local.conf.sample.extended: drop RPM4 example

We don't have RPM4 support anymore, so there's no point including this.

(From meta-yocto rev: 81fc11e65c4fb189cc91422018aec5041f44ae02)

Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agopoky: drop unsupported distros
Joshua Lock [Fri, 1 Jul 2016 19:28:47 +0000 (20:28 +0100)] 
poky: drop unsupported distros

We're no longer building CentOS 6, Debian 7 or Fedora 21 on the
Autobuilder cluster.

(From meta-yocto rev: e4d81d1bcd8aa3ecdd247b8c05a015a87f10cb5e)

Signed-off-by: Joshua Lock <joshua.g.lock@intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolib/oeqa: add Galculator to SDK and runtime tests
Ross Burton [Tue, 21 Jun 2016 14:33:11 +0000 (15:33 +0100)] 
lib/oeqa: add Galculator to SDK and runtime tests

This is a GTK+3 application, so we don't need to ship GTK+ 2 in Sato just for
the SDK test suite.

[ YOCTO #9780 ]

(From OE-Core rev: 53fcfe4348a2ca727844f2b0bd3fca2902cbdda0)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa/runtime/syslog: remove redundant skipUnlessPassed
Ross Burton [Wed, 22 Jun 2016 12:02:53 +0000 (13:02 +0100)] 
oeqa/runtime/syslog: remove redundant skipUnlessPassed

The test test_syslog_help doesn't exist, so skipping unless it passed just
produced a warning.

(From OE-Core rev: 9856fe02bf30cd9e834a7d324e357070f4d7735f)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agotoolchain-scripts: add sysroot/usr/share/pkgconfig to PKG_CONFIG_PATH
Ross Burton [Thu, 30 Jun 2016 12:08:43 +0000 (13:08 +0100)] 
toolchain-scripts: add sysroot/usr/share/pkgconfig to PKG_CONFIG_PATH

Otherwise architecture-independent pkg-config files such as wayland-protocols
won't be found in the SDK.

(From OE-Core rev: 1bea760f3f462fdcc3eefc0d8597688d61447ddd)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa/utils/commands: fix single-character variable matching in get_bb_vars()
Ross Burton [Wed, 29 Jun 2016 10:58:18 +0000 (11:58 +0100)] 
oeqa/utils/commands: fix single-character variable matching in get_bb_vars()

(From OE-Core rev: 2f7e4d0636ce1647edf2d82c65b82be0eb2c1db1)

Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolinux-yocto: bxt and input configuration changes
Bruce Ashfield [Tue, 28 Jun 2016 02:36:43 +0000 (22:36 -0400)] 
linux-yocto: bxt and input configuration changes

Merging the following two configuration changes:

  Author: Rebecca Chang Swee Fun <rebecca.swee.fun.chang@intel.com>
  Date:   Mon Jun 27 15:11:04 2016 +0800

    broxton: set CONFIG_GPIO_GENERIC_PLATFORM instead of CONFIG_GPIO_GENERIC

    CONFIG_GPIO_GENERIC option is tristate, this will ensure we
    enable by selecting CONFIG_GPIO_GENERIC_PLATFORM.

    This addresses the following message:

    Value requested for CONFIG_GPIO_GENERIC not in final ".config"
    Requested value: "CONFIG_GPIO_GENERIC=y"
    Actual value set: ""

Signed-off-by: Rebecca Chang Swee Fun <rebecca.swee.fun.chang@intel.com>
  Author: California Sullivan <california.l.sullivan@intel.com>
  Date:   Mon Jun 27 17:15:53 2016 -0700

    features/input: Add keyboard-gpio feature

    This feature adds keyboard-gpio support to the kernel. We also add a
    specific implementation by default. More can be added as necessary.

Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>
(From OE-Core rev: 358fa56efa2db2a5276a910676e2e6093fe2da0f)

Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolinux-yocto/4.x: vfat feature cleanup
Bruce Ashfield [Fri, 24 Jun 2016 21:00:56 +0000 (17:00 -0400)] 
linux-yocto/4.x: vfat feature cleanup

From Tom:

  This is a small patchset for yocto-4.4 that removes open-coded VFAT_FS
  and enables defaults that should be enabled along with it.

(From OE-Core rev: 0eb474575a96a525755c1d679015af49d7667283)

Signed-off-by: Tom Zanussi <tom.zanussi@linux.intel.com>
Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agolinux-yocto/4.1/4.4: tpm, telemetry, acpi and cpuid changes
Bruce Ashfield [Fri, 24 Jun 2016 20:56:30 +0000 (16:56 -0400)] 
linux-yocto/4.1/4.4: tpm, telemetry, acpi and cpuid changes

Backporting mainline and development commits to for various subystems.

linux-yocto: 4.4:
  ae6a527d93f i2c: add support for ACPI reconfigure notifications
  f2422e12af53 acpi: add support for ACPI reconfiguration notifiers
  bc87718fdb56 acpi: fix enumeration (visited) flags for bus rescans

linux-yocto: 4.1:
  9f166e918f63 platform:x86 decouple telemetry driver from the optional IPC resources
  adfc21c1f156 tpm: update PPI documentation to address the location change.
  661b0190e412 x86 tsc: enumerate BXT tsc_khz via CPUID
  78be69fa9d15 x86 tsc: enumerate SKL cpu_khz and tsc_khz via CPUID

(From OE-Core rev: fdde7061108f04b04a82ba76205ce85afc543a6f)

Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Signed-off-by: Yu, Ong Hock <ong.hock.yu@intel.com>
Signed-off-by: Yong, Jonathan <jonathan.yong@intel.com>
Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agoscripts/contrib: introduce build-perf-test-wrapper.sh
Markus Lehtonen [Tue, 26 Apr 2016 12:51:20 +0000 (15:51 +0300)] 
scripts/contrib: introduce build-perf-test-wrapper.sh

A shell script wrapper around oe-build-perf-test script. The purpose of
this wrapper is to act as a executor script, making it possible to run
the tests with a single command. The wrapper script initializes the
build environment, runs oe-build-perf-test and archives the results.

(From OE-Core rev: 946a076c2ce20dd8f7cfa1acbdab1268d406d3e1)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooe-build-perf-test: add --out-dir command line argument
Markus Lehtonen [Mon, 9 May 2016 14:27:35 +0000 (17:27 +0300)] 
oe-build-perf-test: add --out-dir command line argument

The new option defines the output directory for the test result data.

(From OE-Core rev: bc865b5cb5a9a76048ee9c55a29f5e1a926bb543)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooe-build-perf-test: enable locking
Markus Lehtonen [Thu, 23 Jun 2016 15:48:11 +0000 (18:48 +0300)] 
oe-build-perf-test: enable locking

Makes it possible to guard that multiple tests are not run in parallel.

(From OE-Core rev: 181e92e7a1bccf678b3eb1bf547608a142784f97)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooe-build-perf-test: implement --globalres-file option
Markus Lehtonen [Thu, 23 Jun 2016 15:43:33 +0000 (18:43 +0300)] 
oe-build-perf-test: implement --globalres-file option

Using this option the script appends test results into a 'global results
file'. A CSV-formatted output of the results. This option is to provide
compatibility with the old build-perf-test.sh.

(From OE-Core rev: e9f18e63220e452f2b0c878998e57d944ae83980)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa.buildperf: add git revision and branch to result data
Markus Lehtonen [Thu, 23 Jun 2016 15:38:35 +0000 (18:38 +0300)] 
oeqa.buildperf: add git revision and branch to result data

BuildPerfTestRunner determines these from the Git repository under which
it is being run (i.e. where the build directory exists). The branch and
revision may be defined/overridden with OE_BUILDPERFTEST_GIT_BRANCH
and OE_BUILDPERFTEST_GIT_BRANCH environment variables, if needed. This
makes it possible to run the build performance test script even if the
top directory is not a git repository clone, for example.

(From OE-Core rev: e6004582454d8c6a18f617c12e6e408ded5be8df)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa.utils: add git module
Markus Lehtonen [Wed, 11 May 2016 13:19:06 +0000 (16:19 +0300)] 
oeqa.utils: add git module

A new helper module for easier interaction with Git repositories.
Provides GitRepo class that represents one local Git repository clone.
The GitRepo class currently only has one method, run_cmd(), for running
arbitrary git commands in the repository. More specialized methods for
commonly used git operations can be added later.

(From OE-Core rev: 4eaf434f885afbda03fe67ab6e9ff291c7a9c77e)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooe-build-perf-test: enable logging into file
Markus Lehtonen [Wed, 11 May 2016 13:16:37 +0000 (16:16 +0300)] 
oe-build-perf-test: enable logging into file

(From OE-Core rev: d5bbcdaf332b2a15382672d6a40b2d2b807b9dde)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa.buildperf: archive build/conf into test results
Markus Lehtonen [Thu, 23 Jun 2016 15:34:14 +0000 (18:34 +0300)] 
oeqa.buildperf: archive build/conf into test results

Have the build/conf directory as part of test results.

(From OE-Core rev: ea32a8a65f668450e0ec0e80483bd5e8c91b8a18)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa.buildperf: add test Test4
Markus Lehtonen [Thu, 23 Jun 2016 15:30:45 +0000 (18:30 +0300)] 
oeqa.buildperf: add test Test4

Re-implement "test4" from build-perf-test.sh which measures eSDK metrics.

(From OE-Core rev: c449ca1b062426380a0572aed2da4ee4a83281f5)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
9 years agooeqa.buildperf: add test Test3
Markus Lehtonen [Thu, 23 Jun 2016 15:25:53 +0000 (18:25 +0300)] 
oeqa.buildperf: add test Test3

Re-implement "test3" from build-perf-test.sh which measures
bitbake parsing time.

(From OE-Core rev: 388c7160b90247df9c78d8803083821402c13af5)

Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
Signed-off-by: Ross Burton <ross.burton@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>