Richard Purdie [Sun, 12 May 2019 18:49:25 +0000 (19:49 +0100)]
oeqa/target/ssh: Replace suggogatepass with ignoring errors
We continued to see encoding problems with ssh commands run in oeqa. After much
research the conclusion was we should use ignore the errors since some occasional bad
locale encoding is better than the unicode decoding issues we were seeing which crashed
large parts of tests.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Richard Purdie [Thu, 9 May 2019 13:35:03 +0000 (14:35 +0100)]
oeqa/concurrenttest: Patch subunit module to handle classSetup failures
Currently setupClass errors were not being mapped back to the failing tests
and they were hence being marked as UNKNOWN and the test statistics were
inaccurate.
This is because whilst the errors were being encoded into the test results
stream, the decoder doesn't cope with an error outside a testStart event.
We patch in an addError handler to the outsideTest parser so that this
does get handled in a way similar to the non-concurrent case.
It would be nice if we didn't have to do this but there doesn't seem
to be any other way to fix this other than forking subunit.
We also make a minor change so another of our changes can cope with
tests without a start time.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
map unexpectedSuccesses to PASSED and improve the way they're displayed. We
expect/allow ptest runner to fail but if it passes we should handle it correctly.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Richard Purdie [Wed, 1 May 2019 07:00:00 +0000 (08:00 +0100)]
oeqa/ssh: Avoid unicode decode exceptions
This code really needs to be rewritten to not split potential
multibyte characters, for now work around it to avoid exceptions like:
File "/home/pokybuild/yocto-worker/qa-extras2/build/meta/lib/oeqa/core/target/ssh.py", line 211, in run
data = reader.read(1024, 4096)
File "/usr/lib64/python3.6/codecs.py", line 503, in read
newchars, decodedbytes = self.decode(data, self.errors)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x92 in position 0: invalid start byte
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
oeqa/core/runner: dump stdout and stderr of each test case
Some CI pipelines might perform further processing of the test output
(for instance, to plot some metrics into a chart). However, Since `thud`
we switched away from the XML-based jUnit reporting, and at the same
time we lost the ability of collecting the stdout and stderr of the
various tests.
We now restore this functionality by adding `stdout` and `stderr` keys
to the JSON reports. This behavior is off by default; in order to enable
it, one must set the `TESTREPORT_FULLLOGS` variable in the bitbake
configuration.
Signed-off-by: Alberto Mardegan <amardegan@luxoft.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Ming Liu [Fri, 5 Apr 2019 14:22:15 +0000 (16:22 +0200)]
opkg-utils: backport a patch to fix a sstate timestamp issue
When using sstate, two parallel builds can produce two packages
with the same mtime but different checksums. When later one of
those two builds fetches the others ipk, the package index does
not get udpated properly (since mtime matches). This ends up with
messages such as:
Downloading file:/../tmp/work/../image/...ipk.
Removing corrupt package file /../sysroot/../var/cache/opkg/volatile/...ipk
However, in that case, ctime is different. Use ctime instead of
mtime to prevent failures like this.
Signed-off-by: Ming Liu <liu.ming50@gmail.com> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Andreas Müller [Wed, 17 Apr 2019 13:39:41 +0000 (15:39 +0200)]
adwaita-icon-theme: do not delete symbolic svg but pack them in ${PN}-symbolic
This fixes:
* gtk-icon-browser: for symbolic view almost all icons were missing
* xfce's thunar: 'home' and 'up' icons were missing. Had a long discussion with
XFCE-people [1] and asked here [2].
The subprocess.run was replaced by subprocess.check_call because
of compatibility support down to python 3.4. But we really don't
care about whether that command succeeds. Some user reports that
in some tmux environment, this command fails and gives some
unpleasant traceback output. So we use 'call' instead of 'check_call'
to avoid such problem.
image_types.bbclass: fix a race between the ubi and ubifs FSTYPES
The ubi, ubifs and multiubi FSTYPES calls `mkfs.ubifs' to create UBIFS
images.
In do_image_ubi, $vname is empty, the name of UBIFS image conflicts with
the one in do_image_ubifs, and it's a race risk.
[do_image_ubi]
mkfs.ubifs -r ${IMAGE_ROOTFS} -o ${IMGDEPLOYDIR}/${IMAGE_NAME}${vname}${IMAGE_NAME_SUFFIX}.ubifs ${mkubifs_args}
[do_image_ubi]
Richard Purdie [Thu, 11 Apr 2019 21:34:57 +0000 (22:34 +0100)]
e2fsprogs: Skip slow ptest tests
The slow tests run unreliably with our current setup/infrsstructure/timeouts.
There are only five slow ones and having the other ~250 run reliably without timeouts
is the priority right now. We can revisit the slow tests at some later date if wanted.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Changqing Li [Thu, 11 Apr 2019 07:02:32 +0000 (15:02 +0800)]
ruby: make ext module fiddle can compile success
ext module fiddle depend on libffi, in ruby source tree,
there is in internal libffi in case target platfrom don't
install libffi, but autotools.bbclass delete configure
under libffi and not run autoreconf to regenerate one.so
we met this error:
ruby-2.5.3/ext/fiddle/libffi-3.2.1/configure: No such file or directory
the fix is add depend and extra_oeconf to use libffi in the system
Signed-off-by: Changqing Li <changqing.li@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
ruby: remove CVE-2018-1000073.patch as already fixed
rubygems 2.7.6 which is in ruby 2.5.3 has this fix and as currently
applied all gem extraction fails as the realpath check is done against
the full path including the file to be extracted which will always fail
as the file hasnt been extracted yet
Manjukumar Matha [Thu, 31 Jan 2019 22:21:26 +0000 (14:21 -0800)]
ruby.inc: Add dependency on readline-native
Add dependency on readline-native to fix the following issue
uninitialized constant Logfile
| Check ext/fiddle/mkmf.log for more details.
| readline:
| Could not be configured. It will not be installed.
|
build/tmp/work/x86_64-linux/ruby-native/2.5.1-r0/ruby-2.5.1/ext/readline/extconf.rb:62:
Neither readline nor libedit was found
| Check ext/readline/mkmf.log for more details.
| *** Fix the problems, then remove these directories and try again if
you want.
Lei Yang [Wed, 10 Apr 2019 06:04:09 +0000 (14:04 +0800)]
recipetool: add missed module
When I use recipetool to add a new recipe, it says:
[snip]
sys.exit(14)
NameError: name 'sys' is not defined
[snip]
Signed-off-by: Lei Yang <Lei.Yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Richard Purdie [Wed, 10 Apr 2019 23:07:02 +0000 (00:07 +0100)]
pseudo: Update to gain key bugfixes
Newer distros are using new versions of glibc and coreutils which use the new glibc
renameat2 function. We need to intercept this for correct functioning of pseudo. This
is essential to ensure new distros continue to work with the project.
Also, this version has a fix for path/inode cross corruption problems which
may explain our mysterious locale permissions issues.
Many thanks to Otavio and Peter Seebach for the help in figuring this out and
fixing it.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Current manualexecution required user to input configuration manually
where there were inconsistent inputs and human typo issues.
Enable manualexecution to have the optional feature where it
will use pre-compiled configuration options file where user will
be able to select configuration from the pre-compiled list instead
of manual key-in the configuration. This will eliminate human error.
Expect the pre-compiled configuration options file in json format below
Bruce Ashfield [Tue, 9 Apr 2019 15:37:54 +0000 (11:37 -0400)]
linux-yocto/4.18: update to v4.18.33
Integrating Paul Gortmaker's -stable ports to 4.18 which comprise the
following commits:
56f9fe35a4c5 Linux 4.18.33 bf44ff79b855 net: hns: Fixes the missing put_device in positive leg for roce reset 81614c514f4e mm: Use fixed constant in page_frag_alloc instead of size + 1 035b5a7a3e3f ipvs: fix warning on unused variable 58ab04e46d92 intel_th: gth: Fix an off-by-one in output unassigning 8cb600d53c6c ARM: dts: exynos: Fix max voltage for buck8 regulator on Odroid XU3/XU4 f11b815f39bf s390/setup: fix boot crash for machine without EDAT-1 4059d23a36a6 KVM: nVMX: Ignore limit checks on VMX instructions using flat segments d94637dc73e5 KVM: nVMX: Apply addr size mask to effective address for VMX instructions ee356457f2a3 KVM: nVMX: Sign extend displacements of VMX instr's mem operands b4485d9eb039 KVM: x86/mmu: Do not cache MMIO accesses while memslots are in flux fe7d69927661 KVM: x86/mmu: Detect MMIO generation wrap in any address space c34cae89374b KVM: Call kvm_arch_memslots_updated() before updating memslots 9fb8b858d552 drm/amd/display: don't call dm_pp_ function from an fpu block d4302b79ffbd drm/amd/powerplay: correct power reading on fiji 5f8c51055244 drm/radeon/evergreen_cs: fix missing break in switch statement 3fc39cdce701 media: imx: csi: Stop upstream before disabling IDMA channel 5c008f7971b8 media: imx: csi: Disable CSI immediately after last EOF 74a5ff7db3b2 media: uvcvideo: Avoid NULL pointer dereference at the end of streaming 142a9bd66395 media: lgdt330x: fix lock status reporting 465204a0c772 media: imx: prpencvf: Stop upstream before disabling IDMA channel 42a2c1a40db0 rcu: Do RCU GP kthread self-wakeup from softirq and interrupt f9480ca4fb29 tpm: Unify the send callback behaviour 5f28509f81ad tpm/tpm_crb: Avoid unaligned reads in crb_recv() ea37270d4c87 md: Fix failed allocation of md_register_thread bd77b69a20ba perf intel-pt: Fix divide by zero when TSC is not available c9a63c17458f perf/x86/intel/uncore: Fix client IMC events return huge result 63a25bdd4227 perf intel-pt: Fix overlap calculation for padding 66a57e3b95b5 perf auxtrace: Define auxtrace record alignment 76650254e18e perf intel-pt: Fix CYC timestamp calculation after OVF 274ef4840d79 x86/unwind/orc: Fix ORC unwind table alignment 3928a903e185 vt: perform safe console erase in the right order 645a7ca69855 stable-kernel-rules.rst: add link to networking patch queue 1c14622adb15 bcache: never writeback a discard operation 261aad0b3ea7 PM / wakeup: Rework wakeup source timer cancellation ee610ce938cd svcrpc: fix UDP on servers with lots of threads 0530b66bfd53 NFSv4.1: Reinitialise sequence results before retransmitting a request 9a1d7090b36e nfsd: fix wrong check in write_v4_end_grace() e7edb30fd6b7 nfsd: fix memory corruption caused by readdir 672f2e600d21 nfsd: fix performance-limiting session calculation 624865483faa NFS: Don't recoalesce on error in nfs_pageio_complete_mirror() 2b5fef7c9927 NFS: Fix an I/O request leakage in nfs_do_recoalesce 63adecfe53e9 NFS: Fix I/O request leakages 0b0545dd7e6e cpcap-charger: generate events for userspace 8f27f8570fa7 mfd: sm501: Fix potential NULL pointer dereference f964d308797d dm integrity: limit the rate of error messages 1ed46c0c4f65 dm: fix to_sector() for 32bit ea77e999f649 ipmi_si: fix use-after-free of resource->name 5a0bc68e9a0d arm64: KVM: Fix architecturally invalid reset value for FPEXC32_EL2 9dc4a1a6447e arm64: debug: Ensure debug handlers check triggering exception level c33e96f8ddb2 arm64: Fix HCR.TGE status for NMI contexts bb7edb8a409a ARM: s3c24xx: Fix boolean expressions in osiris_dvs_notify e8d7edd36a92 powerpc/traps: Fix the message printed when stack overflows fbea0579063f powerpc/hugetlb: Don't do runtime allocation of 16G pages in LPAR configuration 88d0042148f0 powerpc/ptrace: Simplify vr_get/set() to avoid GCC warning b0fc119506bf powerpc: Fix 32-bit KVM-PR lockup and host crash with MacOS guest 6e975dad4a8e powerpc/powernv: Don't reprogram SLW image on every KVM guest entry/exit fcf2d15a0a32 powerpc/83xx: Also save/restore SPRG4-7 during suspend 87481c65c805 powerpc/powernv: Make opal log only readable by root 12319dcc9a80 powerpc/wii: properly disable use of BATs when requested. be851891b1c9 powerpc/32: Clear on-stack exception marker upon exception return 24d0b4b51dd1 security/selinux: fix SECURITY_LSM_NATIVE_LABELS on reused superblock 3ea70bdc892f selinux: add the missing walk_size + len check in selinux_sctp_bind_connect 00d550a195f2 jbd2: fix compile warning when using JBUFFER_TRACE b18848cc624a jbd2: clear dirty flag when revoking a buffer from an older transaction 108ba9f62780 serial: 8250_pci: Have ACCES cards that use the four port Pericom PI7C9X7954 chip use the pci_pericom_setup() a79bc3e5fb7c serial: 8250_pci: Fix number of ports for ACCES serial cards 78e39f8bb56e serial: 8250_of: assume reg-shift of 2 for mrvl,mmp-uart 04eb2755b4e9 serial: uartps: Fix stuck ISR if RX disabled with non-empty FIFO 9007ccc01a91 bpf: only test gso type on gso packets ef5b4e1f5735 drm/i915: Relax mmap VMA check 23ca68189393 can: flexcan: FLEXCAN_IFLAG_MB: add () around macro argument 8529fecb481e gpio: pca953x: Fix dereference of irq data in shutdown 31e04ac8a8ba media: i2c: ov5640: Fix post-reset delay 1855d8c9e6c4 i2c: tegra: fix maximum transfer size 8bc3433b216d parport_pc: fix find_superio io compare code, should use equal test. 2c0542dbb267 intel_th: Don't reference unassigned outputs c64422307c34 device property: Fix the length used in PROPERTY_ENTRY_STRING() c88db9c0d127 kernel/sysctl.c: add missing range check in do_proc_dointvec_minmax_conv 5374924c9332 mm/memory.c: do_fault: avoid usage of stale vm_area_struct db693b432779 mm/vmalloc: fix size check for remap_vmalloc_range_partial() 1811478753e3 mm: hwpoison: fix thp split handing in soft_offline_in_use_page() 492ea426ddce dmaengine: usb-dmac: Make DMAC system sleep callbacks explicit f1bb88d5cee1 usb: chipidea: tegra: Fix missed ci_hdrc_remove_device() 9377917b523a clk: ingenic: Fix doc of ingenic_cgu_div_info f0412cfc06af clk: ingenic: Fix round_rate misbehaving with non-integer dividers b6b4011ce7d1 clk: samsung: exynos5: Fix kfree() of const memory on setting driver_override 715fe29adfd1 clk: samsung: exynos5: Fix possible NULL pointer exception on platform_device_alloc() failure eb9aa4ebf835 clk: clk-twl6040: Fix imprecise external abort for pdmclk 917fa829bbf5 clk: uniphier: Fix update register for CPU-gear 80d526380136 ext2: Fix underflow in ext2_max_size() bbf30be02326 cxl: Wrap iterations over afu slices inside 'afu_list_lock' 94f31d712f26 IB/hfi1: Close race condition on user context disable and close a80eceacf85c PCI: dwc: skip MSI init if MSIs have been explicitly disabled 084005af4966 PCI/ASPM: Use LTR if already enabled by platform 821934eb7e75 ext4: fix crash during online resizing 01767d409537 ext4: add mask of ext4 flags to swap f21830e67d5d ext4: update quota information while swapping boot loader inode 4de71f7481a7 ext4: cleanup pagecache before swap i_data 4821bf3c61bb ext4: fix check of inode in swap_inode_boot_loader 3cd2f1153739 cpufreq: pxa2xx: remove incorrect __init annotation dc4443928ee2 cpufreq: tegra124: add missing of_node_put() a0e15a764318 cpufreq: kryo: Release OPP tables on module removal d28564a8e60e x86/kprobes: Prohibit probing on optprobe template code 56955276ba2e irqchip/brcmstb-l2: Use _irqsave locking variants in non-interrupt code 14dda7949f82 irqchip/gic-v3-its: Avoid parsing _indirect_ twice for Device table 3a8560230470 libertas_tf: don't set URB_ZERO_PACKET on IN USB transfer 7e7e5728d161 Btrfs: fix corruption reading shared and compressed extents after hole punching be1ee0e2fd42 btrfs: ensure that a DUP or RAID1 block group has exactly two stripes cb292a678ee2 Btrfs: setup a nofs context for memory allocation at __btrfs_set_acl f1f0ee2859e6 Btrfs: setup a nofs context for memory allocation at btrfs_create_tree() 0e6de290666f m68k: Add -ffreestanding to CFLAGS f78f0d35d43a splice: don't merge into linked buffers 433cbc2d30f3 fs/devpts: always delete dcache dentry-s in dput() dbb3e594eecd scsi: target/iscsi: Avoid iscsit_release_commands_from_conn() deadlock 528af139ff6b scsi: sd: Optimal I/O size should be a multiple of physical block size ee579fc4e875 scsi: aacraid: Fix performance issue on logical drives 818838eea45d scsi: virtio_scsi: don't send sc payload with tmfs 478bd6b7f170 s390/virtio: handle find on invalid queue gracefully 47c6ea331f58 s390/setup: fix early warning messages 69304bcf9021 clocksource/drivers/arch_timer: Workaround for Allwinner A64 timer instability 947a053a6d47 clocksource/drivers/exynos_mct: Clear timer interrupt when shutdown 084c1f5522f1 clocksource/drivers/exynos_mct: Move one-shot check from tick clear to ISR 95d7c41e448f regulator: s2mpa01: Fix step values for some LDOs 69913dbd2d55 regulator: max77620: Initialize values for DT properties 060c4f4e5d0c regulator: s2mps11: Fix steps for buck7, buck8 and LDO35 9a215e43276c spi: pxa2xx: Setup maximum supported DMA transfer length 913cb6579c9a spi: ti-qspi: Fix mmap read when more than one CS in use bb427df35f34 netfilter: ipt_CLUSTERIP: fix warning unused variable cn 8fb8fb9b67bb mmc:fix a bug when max_discard is 0 85d7e5a8000a mmc: sdhci-esdhc-imx: fix HS400 timing issue 882b6b31ea55 ACPI / device_sysfs: Avoid OF modalias creation for removed device b3a0dfcfdd64 tracing/perf: Use strndup_user() instead of buggy open-coded version 054dec51d4e6 tracing: Do not free iter->trace in fail path of tracing_open_pipe() 9031822970ed tracing: Use strncpy instead of memcpy for string keys in hist triggers 9367b21da22c CIFS: Fix read after write for files with read caching db6a6106224d CIFS: Do not reset lease state to NONE on lease break aef1cf600f41 crypto: arm64/aes-ccm - fix bugs in non-NEON fallback routine 134135d884be crypto: arm64/aes-ccm - fix logical bug in AAD MAC handling 6779d6bdf611 crypto: x86/morus - fix handling chunked inputs and MAY_SLEEP 2dc6214860a1 crypto: x86/aesni-gcm - fix crash on empty plaintext a6e83e8b0777 crypto: x86/aegis - fix handling chunked inputs and MAY_SLEEP f62b08c81429 crypto: testmgr - skip crc32c context test for ahash algorithms 817cbacff744 crypto: skcipher - set CRYPTO_TFM_NEED_KEY if ->setkey() fails bc647ef1085e crypto: pcbc - remove bogus memcpy()s with src == dest 9fb0d7b8f9c2 crypto: morus - fix handling chunked inputs 76bc71692818 crypto: hash - set CRYPTO_TFM_NEED_KEY if ->setkey() fails 67a69738546d crypto: arm64/crct10dif - revert to C code for short inputs e1369ad2e0fc crypto: arm64/aes-neonbs - fix returning final keystream block 7807003aab85 crypto: arm/crct10dif - revert to C code for short inputs f54fbb0e595b crypto: aegis - fix handling chunked inputs 1e1f858caf7d crypto: aead - set CRYPTO_TFM_NEED_KEY if ->setkey() fails c81bf050b880 fix cgroup_do_mount() handling of failure exits 638f4fb4ec67 libnvdimm: Fix altmap reservation size calculation 5ebf4aa4cf6b libnvdimm/pmem: Honor force_raw for legacy pmem regions 8f42d7ac37af libnvdimm, pfn: Fix over-trim in trim_pfn_device() 68ab49b299fb libnvdimm/label: Clear 'updating' flag after label-set update 063d65ab9fdd nfit/ars: Attempt short-ARS even in the no_init_ars case 387b9f01ac16 nfit/ars: Attempt a short-ARS whenever the ARS state is idle at boot b4a1581c801d acpi/nfit: Fix bus command validation 0c27d62e5752 nfit: acpi_nfit_ctl(): Check out_obj->type in the right place fd8e9cd85f26 stm class: Prevent division by zero dd1250b50c61 tmpfs: fix uninitialized return value in shmem_link f4cadb1ec900 selftests: fib_tests: sleep after changing carrier. again. 7d856eb21fd5 net: set static variable an initial value in atl2_probe() 193e19cdf7a0 bnxt_en: Wait longer for the firmware message response to complete. 36ca3daa9b6a bnxt_en: Fix typo in firmware message timeout logic. aae48df6d81b nfp: bpf: fix ALU32 high bits clearance bug 9fbe31fda762 nfp: bpf: fix code-gen bug on BPF_ALU | BPF_XOR | BPF_K a58be12de08d net: thunderx: add nicvf_send_msg_to_pf result check for set_rx_mode_task 76320607b755 net: thunderx: make CFG_DONE message to run through generic send-ack sequence 6d0ebfc3fd3c bpf, lpm: fix lookup bug in map_delete_elem 4e9c4ca54607 mac80211_hwsim: propagate genlmsg_reply return code ce8e30135705 phonet: fix building with clang 92f628f3c945 ARCv2: don't assume core 0x54 has dual issue 1faac2e0838b ARCv2: support manual regfile save on interrupts 53fc181c111c ARC: uacces: remove lp_start, lp_end from clobber list 515122c2d88a ARCv2: lib: memcpy: fix doing prefetchw outside of buffer b1ba6184493e ixgbe: fix older devices that do not support IXGBE_MRQC_L3L4TXSWEN a7bc4915f286 tmpfs: fix link accounting when a tmpfile is linked in 5beffa8382a9 mm: handle lru_add_drain_all for UP properly 7bd326b49004 net: marvell: mvneta: fix DMA debug warning 70e79b53dd95 arm64: Relax GIC version check during early boot e3ca5da971e0 ARM: dts: armada-xp: fix Armada XP boards NAND description 2ac1b780dae0 qed: Fix iWARP syn packet mac address validation. 9e1395d75177 qed: Fix iWARP buffer size provided for syn packet processing. 5db253fa68bf ASoC: topology: free created components in tplg load error 31983c568574 mailbox: bcm-flexrm-mailbox: Fix FlexRM ring flush timeout issue 98b9e4e542eb net: mv643xx_eth: disable clk on error path in mv643xx_eth_shared_probe() d19e6c11ca1f qmi_wwan: apply SET_DTR quirk to Sierra WP7607 59e3fdbb9d45 pinctrl: meson: meson8b: fix the sdxc_a data 1..3 pins 63c87ecf5134 net: dsa: bcm_sf2: Do not assume DSA master supports WoL a2e5d18914c1 net: systemport: Fix reception of BPDUs 8d33e97da9c5 scsi: libiscsi: Fix race between iscsi_xmit_task and iscsi_complete_task 1c976b2c9f19 keys: Fix dependency loop between construction record and auth key 590d6228f163 assoc_array: Fix shortcut creation 5aa6e4f891a2 af_key: unconditionally clone on broadcast 8cae27e41068 bpf: fix lockdep false positive in stackmap c16b543d92ee bpf: only adjust gso_size on bytestream protocols 908e6fda5d7d ARM: 8824/1: fix a migrating irq bug when hotplug cpu d6fb8e0d9e7d esp: Skip TX bytes accounting when sending from a request socket 2dd0beec5a84 clk: sunxi: A31: Fix wrong AHB gate number 48db12b60b5b kallsyms: Handle too long symbols in kallsyms.c 882dbe3d5c03 clk: sunxi-ng: v3s: Fix TCON reset de-assert bit 1ab0225d6786 Input: st-keyscan - fix potential zalloc NULL dereference 8a6ef92721b7 auxdisplay: ht16k33: fix potential user-after-free on module unload 53f4d6948b35 i2c: bcm2835: Clear current buffer pointers and counts after a transfer 60bc9292260f i2c: cadence: Fix the hold bit setting e6e2c6c26a58 net: hns: Fix object reference leaks in hns_dsaf_roce_reset() bf6be978fece mm: page_alloc: fix ref bias in page_frag_alloc() for 1-byte allocs 7f72a70062d7 x86/CPU: Add Icelake model number 4342d099969c net: dsa: bcm_sf2: potential array overflow in bcm_sf2_sw_suspend() 6093401c933b scsi: qla2xxx: Fix panic from use after free in qla2x00_async_tm_cmd 09f4a1b6edf1 Revert "mm: use early_pfn_to_nid in page_ext_init" 7b9dd6a4976b mm/gup: fix gup_pmd_range() for dax 3cd584b00e50 NFS: Don't use page_file_mapping after removing the page 7d8cf3eb1dc7 xprtrdma: Make sure Send CQ is allocated on an existing compvec 5c64b19db5ce floppy: check_events callback should not return a negative number 1cae395dd7c0 ipvs: fix dependency on nf_defrag_ipv6 d05d4feda816 blk-mq: insert rq with DONTPREP to hctx dispatch list when requeue 0af0889613a8 netfilter: compat: initialize all fields in xt_init f2883b8eb0a9 mac80211: Fix Tx aggregation session tear down with ITXQs 665cb8ebf0f3 mac80211: call drv_ibss_join() on restart 0a1d76449997 Input: matrix_keypad - use flush_delayed_work() 375152e09de2 Input: ps2-gpio - flush TX work when closing port b15599627bd0 Input: cap11xx - switch to using set_brightness_blocking() a1e0fb446a4b ARM: OMAP2+: fix lack of timer interrupts on CPU1 after hotplug 7a587d77b211 ASoC: samsung: Prevent clk_get_rate() calls in atomic context bf74076b7dd3 KVM: arm64: Forbid kprobing of the VHE world-switch code d74df61de605 arm/arm64: KVM: Don't panic on failure to properly reset system registers 58d6ec80a286 arm/arm64: KVM: Allow a VCPU to fully reset itself c05c5a6e1f0e KVM: arm/arm64: Reset the VCPU without preemption and vcpu state loaded ba274486de32 ASoC: dapm: fix out-of-bounds accesses to DAPM lookup tables a3d8ea1f2555 ARM: OMAP2+: Variable "reg" in function omap4_dsi_mux_pads() could be uninitialized 237e6c308062 Input: pwm-vibra - stop regulator after disabling pwm, not before 6a48d09a77a1 Input: pwm-vibra - prevent unbalanced regulator fcae9decbc8f s390/dasd: fix using offset into zero size array error f98a25dc02b7 KVM: arm/arm64: vgic: Make vgic_dist->lpi_list_lock a raw_spinlock 74b6b1e49d06 gpu: ipu-v3: Fix CSI offsets for imx53 1c0723cba9a9 drm/imx: imx-ldb: add missing of_node_puts 321e0fbdae09 gpu: ipu-v3: Fix i.MX51 CSI control registers offset f0e52962b9f2 drm/imx: ignore plane updates on disabled crtcs 38fc637ca52e crypto: rockchip - update new iv to device in multiple operations 5d89757429b3 crypto: rockchip - fix scatterlist nents error 2365ae3a03c9 crypto: ahash - fix another early termination in hash walk 512b0d76c2c9 crypto: cfb - remove bogus memcpy() with src == dest 66b1348939de crypto: cfb - add missing 'chunksize' property 40c76d76e11f crypto: ccree - don't copy zero size ciphertext 2ff9501c582f crypto: ccree - fix free of unallocated mlli buffer ba3c72efd404 crypto: caam - fixed handling of sg list 5d9cee322faf crypto: ccree - fix missing break in switch statement e0ea8deb72db stm class: Fix an endless loop in channel allocation 95b10e2f6a61 mei: bus: move hw module get/put to probe/release 1af8d0304685 iio: adc: exynos-adc: Fix NULL pointer exception on unbind 513052a27dab ASoC: codecs: pcm186x: Fix energysense SLEEP bit d5f37b5d7009 ASoC: codecs: pcm186x: fix wrong usage of DECLARE_TLV_DB_SCALE() da21c5d9bacf ASoC: fsl_esai: fix register setting issue in RIGHT_J mode b3e4f70db4f3 9p/net: fix memory leak in p9_client_create 4b84eeface08 9p: use inode->i_lock to protect i_size_write() under 32-bit 4441736404a3 media: videobuf2-v4l2: drop WARN_ON in vb2_warn_zero_bytesused() 3f7de80a22c6 perf/core: Fix impossible ring-buffer sizes warning
Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Bruce Ashfield [Tue, 9 Apr 2019 15:37:53 +0000 (11:37 -0400)]
linux-yocto-tiny/4.18: point KBRANCH to 4.18
The other kernel versions had the -tiny KBRANCH typo of 4.15
fixed, but 4.18 was missed. So we update the kbranch to the right
version for 4.18 as well.
[YOCTO #13247]
Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Richard Purdie [Wed, 3 Apr 2019 17:02:41 +0000 (18:02 +0100)]
core-image-sato-sdk-ptest: Fix free space issues causing test failures
Some tests such as strace-ptest require more than the current 500MB of free
space. Increase the amount available, staying under the 4GB limit. We have more
flexibility now since we shrank kernel-devsrc and the comments are out of date
due to that.
This should improve the strace-ptest results and the util-linux ones since
those sort after strace and also hit the space issues as strace-ptest didn't
clean up after itself when failing.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Current validation check function inside resulttool disallow the
report for single result file although the underlying library
was able to handle both directory and file as source input to report.
Removed the validation check as it was no longer needed and to
enable report for single result file.
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Kai Kang [Tue, 2 Apr 2019 07:44:26 +0000 (03:44 -0400)]
avahi: fix CVE-2017-6519
Backport patch to fix CVE-2017-6519.
CVE: CVE-2017-6519
Signed-off-by: Kai Kang <kai.kang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
David Frey [Thu, 10 Jan 2019 19:23:52 +0000 (11:23 -0800)]
bluez5: Fix status subcommand of init script
Update the bluez5 init script to resolve an issue where the status
subcommand would exit without printing any message if bluez was not
running. The early exit was caused by the fact that the init script has
"set -e". When "pidof ${DAEMON} >/dev/null" is executed, the script
terminates immediately if bluez isn't running because pidof returns a
non-zero result. The fixed version does not suffer from this issue and
makes use of the "status" function from the functions library.
Signed-off-by: David Frey <dpfrey@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Peter A. Bigot [Tue, 13 Nov 2018 18:06:20 +0000 (12:06 -0600)]
bluez5: add mesh dependency on ell
Introduced at or before 5.50.
Signed-off-by: Peter A. Bigot <pab@pabigot.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Taras Kondratiuk [Fri, 22 Mar 2019 00:56:59 +0000 (17:56 -0700)]
devtool: prevent starting git gc in background
Devtool creates a git repository for extracted sources in a temporary
directory and then moves it to a final destination after patching is
done. Unfortunately devtool is not aware that some of its git operations
may have caused git garbage collector to start in background. If timing
is just right a repository move fails because GC is removing git objects
while they are being moved.
The issue was hit on Krogoth release, but the code that moves created
git repository is still the same.
Disable gc.autodetach to make GC run synchronously and block git until
it is done.
Traceback (most recent call last):
File "<snip>/openembedded-core/scripts/devtool", line 342, in <module>
ret = main()
File "<snip>/openembedded-core/scripts/devtool", line 329, in main
ret = args.func(args, config, basepath, workspace)
File "<snip>/openembedded-core/scripts/lib/devtool/standard.py", line 352, in extract
initial_rev = _extract_source(srctree, args.keep_temp, args.branch, False, rd)
File "<snip>/openembedded-core/scripts/lib/devtool/standard.py", line 644, in _extract_source
shutil.move(srcsubdir, srctree)
File "/usr/lib/python2.7/shutil.py", line 299, in move
copytree(src, real_dst, symlinks=True)
File "/usr/lib/python2.7/shutil.py", line 208, in copytree
raise Error, errors
Error: [('/tmp/devtool5RXkuX/workdir/grpc-1.2.5/.git/objects/5e', '<snip>/build/grpc/grpc_src/.git/objects/5e', "[Errno 2] No such file or directory: '/tmp/devtool5RXkuX/workdir/grpc-1.2.5/.git/objects/5e'"), ('/tmp/devtool5RXkuX/workdir/grpc-1.2.5/.git/objects/57', '<snip>/build/grpc/grpc_src/.git/objects/57', "[Errno 2] No such file or directory: '/tmp/devtool5RXkuX/workdir/grpc-1.2.5/.git/objects/57'"), many git objects ... ]
Changqing Li [Thu, 25 Oct 2018 08:59:28 +0000 (16:59 +0800)]
python-native: fix one do_populate_sysroot warning
Fix below warning:
WARNING: Skipping RPATH /usr/lib64 as is a standard search path for
work/x86_64-linux/python-native/2.7.15-r1.1/recipe-sysroot-native/
usr/lib/python2.7/lib-dynload/_bsddb.so
setup.py will check db.h under include_dirs, for native build,
/usr/lib64 will be insert to postion 0 of include_dirs, so
it's priority is higher then our sysroot, cause db.h sysroot
is ignored, and rpath set to /usr/lib64. and this cause warning
when do_populate_sysroot. use append to fix it.
Signed-off-by: Changqing Li <changqing.li@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Aditya Tayade [Mon, 25 Mar 2019 15:27:11 +0000 (15:27 +0000)]
run-ptest: use error handling for useradd and userdel
Error handling in shell scripts is too easy to forget and
get wrong. It is possible to check every external command
for return values but it is better to use a generic setting
which halts execution of the script on any failures.
Ross Burton [Tue, 26 Mar 2019 12:02:27 +0000 (12:02 +0000)]
zlib: clean up ptest
Instead of patching and sedding the makefile, just install test/example and
execute it in run-ptest. example is the bulk of the test suite, as minimal as
it is.
Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Robert Yang [Mon, 11 Mar 2019 10:16:55 +0000 (18:16 +0800)]
oe-init-build-env: Error out when failed to locate cwd
Ubuntu's /bin/sh symlinks to /bin/dash by default, so
subprocess.check_call(oe-init-build-env, cwd=builddir) would be failed since
pwd is builddir, and there is no $builddir/oe-init-build-env, this would
lead to other confusing errors, check and error it out earlier to make it
easier to locate the problem.
We don't meet the problem when manually run ". oe-init-build-env" is because
Ubuntu's default login shell is bash, but subprocess.check_call() doesn't
respect to login shell, so the error only happens in situations like
subprocess.check_call().
And also print errors to stderr as oe-buildenv-internal does.
Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Armin Kuster [Tue, 26 Mar 2019 16:13:11 +0000 (09:13 -0700)]
timezone: update to 2019a
The 2019a release of the tz code and data is available. It reflects the following changes, which were either circulated on the tz mailing list or are relatively minor technical or administrative changes:
Briefly:
Palestine "springs forward" on 2019-03-30 instead of 2019-03-23.
Metlakatla "fell back" to rejoin Alaska Time on 2019-01-20 at 02:00.
Changes to past and future timestamps
Palestine will not start DST until 2019-03-30, instead of 2019-03-23 as
previously predicted. Adjust our prediction by guessing that spring
transitions will be between 24 and 30 March, which matches recent practice
since 2016. (Thanks to Even Scharning and Tim Parenti.)
Metlakatla ended its observance of Pacific standard time,
rejoining Alaska Time, on 2019-01-20 at 02:00. (Thanks to Ryan
Stanley and Tim Parenti.)
Changes to past timestamps
Israel observed DST in 1980 (08-02/09-13) and 1984 (05-05/08-25).
(Thanks to Alois Treindl and Isaac Starkman.)
Changes to time zone abbreviations
Etc/UCT is now a backward-compatibility link to Etc/UTC, instead
of being a separate zone that generates the abbreviation "UCT",
which nowadays is typically a typo. (Problem reported by Isiah
Meadows.)
Changes to code
zic now has an -r option to limit the time range of output data.
For example, 'zic -r @1000000000' limits the output data to
timestamps starting 1000000000 seconds after the Epoch.
This helps shrink output size and can be useful for applications
not needing the full timestamp history, such as TZDIST truncation;
see Internet RFC 8536 section 5.1. (Inspired by a feature request
from Christopher Wong, helped along by bug reports from Wong and
from Tim Parenti.)
Changes to documentation
Mention Internet RFC 8536 (February 2019), which documents TZif.
tz-link.html now cites tzdata-meta
<https://tzdata-meta.timtimeonline.com/>.
Ross Burton [Thu, 22 Nov 2018 14:05:16 +0000 (14:05 +0000)]
openssl: don't disable the AFALG engine based on host kernel
Whether the AFALG engine (use of hardware crypto via AF_ALG) is enable or
disable depends on whether the host kernel is 4.1 or above, which has no bearing
on whether the target system supports it.
Remove the complicated logic and simply enable/disable as requested.
Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Ovidiu Panait [Mon, 4 Mar 2019 11:38:45 +0000 (13:38 +0200)]
openssl: Add cryptodev-linux PACKAGECONFIG
The old bsd cryptodev engine was removed in
https://github.com/openssl/openssl/pull/3699
and the new one added in:
https://github.com/openssl/openssl/pull/3744
It can be enabled by configuring with "enable-devcryptoeng".
Khem Raj [Wed, 13 Mar 2019 15:25:58 +0000 (15:25 +0000)]
glibc: Drop upstream rejected patches
These patches were applied, hoping that they will eventually be accepted
upstream but they have been rejected, I think its best that they are
dropped so we can avoid novel unintended behaviours that no other
distros will be seeing
Chen Qi [Wed, 30 Jan 2019 02:56:24 +0000 (10:56 +0800)]
pkgdata.py: avoid target-sdk-dummy-provides to mess things up
Sometimes we meet the following failure for the test_lookup_recipe
test case.
AssertionError: 'zlib\nbusybox is in the RPROVIDES of target-sdk-provid[32 chars]ummy' != 'zlib\nbusybox'
zlib
+ busybox- busybox is in the RPROVIDES of target-sdk-provides-dummy:
- target-sdk-provides-dummy
This is because target-sdk-provides-dummy rprovides busybox.
resulttool/manualexecution: Fixed step sorted by integer
Currently the manual execution display step by sorting
the step as string, where steps were not being sorted
correctly when there are more than 9 steps.
Fixed the step sorting by sorting step as integer.
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
resulttool/manualexecution: Enable display full steps without press enter
Current manualexecution required pressing enter button to show each step
information, where this was wasting execution time. Enable display
full steps without needing to any press enter button.
Signed-off-by: Mazliana <mazliana.mohamad@intel.com> Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Current input checking does not match the standard input practiced
by QA team. Change the input checking to match the standard
input practiced by the QA team.
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Richard Purdie [Sat, 2 Mar 2019 16:34:16 +0000 (16:34 +0000)]
resulttool: Allow extraction of ptest data
Rather than simply discarding the ptest data, change the code to discard
it when writing out the new testresult files, or optionally either preserve
it, or write it as seperate discrete logs.
This means the autobuilder should start writing out individual ptest log
files as well as allowing ueers to extract these manually.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Richard Purdie [Tue, 2 Apr 2019 22:51:02 +0000 (23:51 +0100)]
resulttool: Allow store to work on single files
Store operations using a single file as a source weren't working as the os.walk
command didn't like being given a single file. Fix the store operation to
work for single files.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Yeoh Ee Peng [Tue, 19 Mar 2019 01:53:53 +0000 (09:53 +0800)]
oeqa/manual/toaster: updated test id naming
All test id (eg. @alias) inside manual testcase file shall follow the same
test id naming convention from oeqa automated tests (eg. selftest,
runtime, sdk, etc), where the test id consists of
<test_module>.<test_suite>.<test_function>. Furthermore, there shall be
only 1 unique test_module per each manual testcases file, where
test_module match the file name itself.
This file was using test_module name that does not match the file name
itself. Fixed test_module name as well as the test_suite name.
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Yeoh Ee Peng [Fri, 28 Dec 2018 06:54:44 +0000 (14:54 +0800)]
oeqa/manual/toaster: transfer manual toaster test cases to oeqa
As part of the solution to replace Testopia, manual test cases
need to be migrated to OEQA. These manual test case json files
will serve two use cases.
Use case#1: as input to the future commandline-based manual test
runner script, where this script will display actions and expected
result information in user friendly text, then it will capture
user input for test result and log, finally it will write test
result and log into existing standardize test result json format
from OEQA framework for automated tests.
Use case#2: QA will open and read these json file manually for
planning manual test execution. Any reader interested in
understanding manual test cases will open and read these files.
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
sangeeta jain [Thu, 14 Mar 2019 05:14:18 +0000 (13:14 +0800)]
oeqa/manual/kernel-dev.json: test id updated
All test id (eg. @alias) inside manual testcase file shall follow the same test id
naming convention from oeqa automated tests (eg. selftest, runtime, sdk, etc), where
the test id consists of <test_module>.<test_suite>.<test_function>. Furthermore,
there shall be only 1 unique test_module per each manual testcases file.
This file was using more than 1 unique test_module for testcases. Furthermore,
some of the testcases were defined using different test_suite where it was not needed.
This patch fix the manual testcases file to have only 1 unique test_module
as well as test_suite to simplify test id naming.
sangeeta jain [Thu, 14 Mar 2019 04:31:17 +0000 (12:31 +0800)]
oeqa/manual/compliance-test.json: test id updated and missing test cases added
Two changes made in oeqa/manual/compliance-test.json:
1. All test id (eg. @alias) inside manual testcase file shall follow the same test id
naming convention from oeqa automated tests (eg. selftest, runtime, sdk, etc), where
the test id consists of <test_module>.<test_suite>.<test_function>. Furthermore,
there shall be only 1 unique test_module per each manual testcases file.
This file was using more than 1 unique test_module for testcases. Furthermore, some of
the testcases were defined using different test_suite where it was not needed. This patch
fix the manual testcases file to have only 1 unique test_module as well as test_suite to
simplify test id naming.
2. Added 2 missing test cases for Beaglebone Stress Test.
sangeeta jain [Thu, 14 Mar 2019 02:55:23 +0000 (10:55 +0800)]
oeqa/manual/bsp-hw.json: test id updated and obsolete test cases removed
Two changes made in oeqa/manual/bsp-hw.json:
1. All test id (eg. @alias) inside manual testcase file shall follow the same test id naming
convention from oeqa automated tests (eg. selftest, runtime, sdk, etc), where the
test id consists of <test_module>.<test_suite>.<test_function>. Furthermore,
there shall be only 1 unique test_module per each manual testcases file.
This file was using more than 1 unique test_module for testcases.
Furthermore, some of the testcases were defined using different test_suite where it was not
needed. This patch fix the manual testcases file to have only 1 unique
test_module as well as test_suite to simplify test id naming.
2. As per review by Intel and Windriver team, 7 testcases were found obsolete. Removed 7 testcases.
sangeeta jain [Mon, 28 Jan 2019 08:11:15 +0000 (16:11 +0800)]
oeqa/manual/sdk.json: Updated toolchain tarball to core-image-sato
Manual test step for SDK is updated. Previously toolchain was "poky-glibc-x86_64-core-image-sato-sdk<type-arch>-toolchain-<release-version>.sh"
But toochain for core-image-sato-sdk is not available in releases after 2.1, hence changed it to "poky-glibc-x86_64-core-image-sato-<type-arch>-toolchain-<release-version>.sh
Other less significant update is to add exepcted result in intermediate test steps.
Richard Purdie [Thu, 28 Feb 2019 12:24:49 +0000 (12:24 +0000)]
scripts/wic: Be consistent about how we call bitbake
Whilst its tempting to call bitbake_main(), the script also directly executes
bitbake. By doing both this creates all kinds of races. Therefore
change to use subprocess execution in all cases.
Mazliana [Mon, 11 Mar 2019 08:30:33 +0000 (16:30 +0800)]
resulttool/manualexecution: To output right test case id
We found that manualexecution does not capture test suite values
correctly if there are more than one test suite in test cases.
After verification has made we found out we should retrieved
full test cases value <test_module.test_suite.test_case> from
oeqa/manual/ json file rather than split it them into new
variables test_suite and test_cases.
Signed-off-by: Mazliana <mazliana.mohamad@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Yeoh Ee Peng [Thu, 7 Mar 2019 04:49:08 +0000 (12:49 +0800)]
scripts/resulttool: Enable manual result store and regression
To enable store for testresults.json file from manualexecution,
add layers metadata to configuration and add "manual" map to
resultutils.store_map.
To enable regression for manual, add "manual" map to
resultutils.regression_map. Also added compulsory configurations
('MACHINE', 'IMAGE_BASENAME') to manualexecution.
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Wed, 27 Feb 2019 17:05:29 +0000 (17:05 +0000)]
resulttool/report: Ensure test suites with no results show up on the report
ptest suites with no results don't show up on the reports even though we have
a duration for them. Fix this so the fact they report no tests is visible.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Richard Purdie [Sat, 16 Feb 2019 18:13:00 +0000 (18:13 +0000)]
resulttool: Improvements to allow integration to the autobuilder
This is a combined patch of the various tweaks and improvements I
made to resulttool:
* Avoid subprocess.run() as its a python 3.6 feature and we
have autobuilder workers with 3.5.
* Avoid python keywords as variable names
* Simplify dict accesses using .get()
* Rename resultsutils -> resultutils to match the resultstool ->
resulttool rename
* Formalised the handling of "file_name" to "TESTSERIES" which the code
will now add into the json configuration data if its not present, based
on the directory name.
* When we don't have failed test cases, print something saying so
instead of an empty table
* Tweak the table headers in the report to be more readable (reference
"Test Series" instead if file_id and ID instead of results_id)
* Improve/simplify the max string length handling
* Merge the counts and percentage data into one table in the report
since printing two reports of the same data confuses the user
* Removed the confusing header in the regression report
* Show matches, then regressions, then unmatched runs in the regression
report, also remove chatting unneeded output
* Try harder to "pair" up matching configurations to reduce noise in
the regressions report
* Abstracted the "mapping" table concept used to pairing in the
regression code to general code in resultutils
* Created multiple mappings for results analysis, results storage and
'flattening' results data in a merge
* Simplify the merge command to take a source and a destination,
letting the destination be a directory or a file, removing the need for
an output directory parameter
* Add the 'IMAGE_PKGTYPE' and 'DISTRO' config options to the regression
mappings
* Have the store command place the testresults files in a layout from
the mapping, making commits into the git repo for results storage more
useful for simple comparison purposes
* Set the oe-git-archive tag format appropriately for oeqa results
storage (and simplify the commit messages closer to their defaults)
* Fix oe-git-archive to use the commit/branch data from the results file
* Cleaned up the command option help to match other changes
* Follow the model of git branch/tag processing used by oe-build-perf-report
and use that to read the data using git show to avoid branch change
* Add ptest summary to the report command
* Update the tests to match the above changes
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Mazliana [Thu, 14 Feb 2019 05:50:38 +0000 (13:50 +0800)]
scripts/resulttool: enable manual execution and result creation
Integrated “manualexecution” operation to resulttool scripts.
Manual execution script is a helper script to execute all manual
test cases in baseline command, which consists of user guideline
steps and the expected results. The last step will ask user to
provide their input to execute result. The input options are
passed/failed/blocked/skipped status. The result given will be
written in testresults.json including log error from the user
input and configuration if there is any.The output test result
for json file is created by using OEQA library.
The configuration part is manually key-in by the user. The system
allow user to specify how many configuration they want to add and
they need to define the required configuration name and value pair.
In QA perspective, "configuration" means the test environments and
parameters used during QA setup before testing can be carry out.
Example of configurations: image used for boot up, host machine
distro used, poky configurations, etc.
The purpose of adding the configuration is to standardize the
output test result format between automation and manual execution.
To use these scripts, first source oe environment, then run the
entry point script to look for help.
$ resulttool
To execute manual test cases, execute the below
$ resulttool manualexecution <manualjsonfile>
By default testresults.json store in <build_dir>/tmp/log/manual/
[YOCTO #12651]
Signed-off-by: Mazliana <mazliana.mohamad@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Yeoh Ee Peng [Thu, 14 Feb 2019 05:50:37 +0000 (13:50 +0800)]
resulttool: enable merge, store, report and regression analysis
OEQA outputs test results into json files and these files were
archived by Autobuilder during QA releases. Example: each oe-selftest
run by Autobuilder for different host distro generate a
testresults.json file.
These scripts were developed as a test result tools to manage
these testresults.json file.
Using the "store" operation, user can store multiple testresults.json
files as well as the pre-configured directories used to hold those files.
Using the "merge" operation, user can merge multiple testresults.json
files to a target file.
Using the "report" operation, user can view the test result summary
for all available testresults.json files inside a ordinary directory
or a git repository.
Using the "regression-file" operation, user can perform regression
analysis on testresults.json files specified. Using the "regression-dir"
and "regression-git" operations, user can perform regression analysis
on directory and git accordingly.
These resulttool operations expect the testresults.json file to use
the json format below.
{
"<testresult_1>": {
"configuration": {
"<config_name_1>": "<config_value_1>",
"<config_name_2>": "<config_value_2>",
...
"<config_name_n>": "<config_value_n>",
},
"result": {
"<testcase_namespace_1>": {
"status": "<PASSED or FAILED or ERROR or SKIPPED>",
"log": "<failure or error logging>"
},
"<testcase_namespace_2>": {
"status": "<PASSED or FAILED or ERROR or SKIPPED>",
"log": "<failure or error logging>"
},
...
"<testcase_namespace_n>": {
"status": "<PASSED or FAILED or ERROR or SKIPPED>",
"log": "<failure or error logging>"
},
}
},
...
"<testresult_n>": {
"configuration": {
"<config_name_1>": "<config_value_1>",
"<config_name_2>": "<config_value_2>",
...
"<config_name_n>": "<config_value_n>",
},
"result": {
"<testcase_namespace_1>": {
"status": "<PASSED or FAILED or ERROR or SKIPPED>",
"log": "<failure or error logging>"
},
"<testcase_namespace_2>": {
"status": "<PASSED or FAILED or ERROR or SKIPPED>",
"log": "<failure or error logging>"
},
...
"<testcase_namespace_n>": {
"status": "<PASSED or FAILED or ERROR or SKIPPED>",
"log": "<failure or error logging>"
},
}
},
}
To use these scripts, first source oe environment, then run the
entry point script to look for help.
$ resulttool
To store test result from oeqa automated tests, execute the below
$ resulttool store <source_dir> <git_branch>
To merge multiple testresults.json files, execute the below
$ resulttool merge <base_result_file> <target_result_file>
To report test report, execute the below
$ resulttool report <source_dir>
To perform regression file analysis, execute the below
$ resulttool regression-file <base_result_file> <target_result_file>
To perform regression dir analysis, execute the below
$ resulttool regression-dir <base_result_dir> <target_result_dir>
To perform regression git analysis, execute the below
$ resulttool regression-git <source_dir> <base_branch> <target_branch>
[YOCTO# 13012]
[YOCTO# 12654]
Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Chen Qi [Thu, 10 Jan 2019 02:37:32 +0000 (10:37 +0800)]
target-sdk-provides-dummy: add more perl modules to avoid populate_sdk failure
When 'adduser' package, which is from meta-perl layer, is added to rootfs,
we will get do_populate_sdk failure like below.
Error:
Problem: package perl-module-cwd-5.24.4-r0.core2_64 requires perl-module-dynaloader, but none of the providers can be installed
- package perl-module-file-temp-5.24.4-r0.core2_64 requires perl-module-cwd, but none of the providers can be installed
- package perl-module-dynaloader-5.24.4-r0.core2_64 requires perl-module-config, but none of the providers can be installed
- package adduser-3.118-r0.core2_64 requires perl-module-file-temp, but none of the providers can be installed
- package target-sdk-provides-dummy-1.0-r0.sdk_provides_dummy_target conflicts with perl provided by perl-5.24.4-r0.core2_64
This is because adduser depends on some perl modules which are not
listed in target-sdk-provides-dummy.
Signed-off-by: Ming Liu <liu.ming50@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Robert Yang [Tue, 5 Mar 2019 03:30:35 +0000 (11:30 +0800)]
send-error-report: Add --no-ssl to use http protocol
The script use https protocol by default, but the error-report-web server's
https connection may not work (e.g., doesn't work with python 2.7.6), so add an
option --no-ssl to make it use http.
Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Armin Kuster <akuster808@gmail.com>
Richard Purdie [Thu, 21 Feb 2019 16:00:02 +0000 (16:00 +0000)]
kernel: Ensure an initramfs is added if configured
If ${DEPLOY_DIR_IMAGE}/${INITRAMFS_IMAGE_NAME}.cpio does not exist,
nor any of the compressed variants, nothing is copied to kernel build's
./usr directory.
The code does not fail, but silently proceeds without a bundled initramfs.
Change to fail and tell the user something is wrong.
Also, if an initramfs is found, contrary to the comments, it does not stop
at the first uncompressed/compressed cpio image found. Instead it keeps
processing all so the last is used. Fix this to behave as per the comments.
Apply patches from systemd_239-7ubuntu10.8 to fix CVE-2019-6454.
CVE-2019-6454 is an issue in which systemd (PID1) can be crashed with a
specially formed D-Bus message.
projects / thirdparty / openembedded / openembedded-core.git / log
