Linux Kernel Testing by Linaro Jan 30th 2019 Edition

This week the Linux based testing the uses Openembedded upgraded to a newer version of LTP. The Android based testing will make a similar upgrade in another week or two.

Two sets of LTS releases were made during the course of the week this report covers. No regressions were observed on Linux nor with Android.

OpenEmbedded

• LTP “mm” tests added to LKFT (75 tests/board)
• Upgraded kselftest that is run against all stable kernels to 4.20.

Bug Status — 65 open bugs

• New bugs due to new kselftest and ltp failures, caused by upgrades
• 2019–01–29: Rafael Tinoco sent an 8 patch series for new clock_settime tests to LTP — Merged today
• 2019–01–29: Anders Roxell sent build warning/error patches 1
• 2019–01–29: Naresh Kamboju sent a patch to fix kselftest config for netfilter
• 2019–01–28: Anders Roxell sent an initial kselftest result report on -next to kselftest list
• 2019–01–24: Rafael Tinoco reported ltp/vma05.sh test issue to LTP re: issue 477/bug 4256
• 2019–01–24: Rafael Tinoco reported ltp/clock_settime_8–1 hardly passes to LTP re: bug 3965
• 2019–01–24: Naresh Kamboju reported an arm32 build failure on -next

RC Log

2019–01–30

• 4.9.154, 4.14.97, 4.19.19, 4.20.6
• LTP upgraded to 20190115 for all branches
• Reported no regressions in <48h

2019–01–24

• 4.4.172, 4.9.153, 4.14.96, 4.19.18, 4.20.5
• kselftest upgraded to 4.20 for all LTS branches
• Reported no regressions in <24h

Android

Discussion

• 4.19 has a fairly high number of failures as part of it’s baseline. Started to look into improving baseline
• 40 VTS failures due to QTAGUID on 4.19, moving to known failures.
• New LTP testcases, consistent failures

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.io.aio01_64bit fail

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.io.aio02_64bit fail

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.syscalls.io_setup01_64bit fail

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.syscalls.io_submit01_64bit fail

vts-test/arm64-v8a.VtsKernelLtp/VtsKernelLtp.syscalls.select04_64bit fail

vts-test/armeabi-v7a.VtsKernelLtp/VtsKernelLtp.io.aio01_32bit fail

vts-test/armeabi-v7a.VtsKernelLtp/VtsKernelLtp.io.aio02_32bit fail

vts-test/armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.io_setup01_32bit fail

vts-test/armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.io_submit01_32bit fail

Android 9 / P LTS-premerge — 4.4, 4.9, 4.14, 4.19

• 4.19.18 — no regressions
• 4.19.17 — no regressions
• 4.14.96 — no regressions
• 4.14.95 — no regressions
• 4.9.153 — no regressions
• 4.9.152 — no regressions
• 4.4.172 — no regressions
• 4.4.171 — no regressions

Android 9 / P — 4.4, 4.9, 4.14, 4.19 + HiKey

• 4.19.16 — current, rerun completed for missing CTS from last week otherwise no new data
• 4.14.94 — current, no new data
• 4.9.150 — current, no new data
• 4.4.170 — current, no new data

AOSP-master-tracking — 4.9, 4.14 4.19 / HiKey & 4.14 / X15

• Regression reporting for this combination is very difficult until https://projects.linaro.org/browse/LSS-451 is addressed
• 4.14.91 / X15
• 4.9.150 / HiKey
• 4.14.94 / HiKey
• 4.19.16 / HiKey

Android 8.1–4.4 + HiKey, 4.14 and X15

• 4.14.94 / X15 — seems PVR driver is not loading (outdated). Need to test locally, build and upload the driver.
• 4.4.170 / HiKey — current, no new data

Bugs

• 22 WtW + 4
• New : 4267, 4268, 4269, 4270

Linux Kernel Testing Results by Linaro — Jan 23rd 2019 Edition

One of the things that we do at Linaro is testing Linux Kernels to look for kernel regressions. Ideally we want a world where those that make use of Long Term Support Kernels (LTS) can depend on the stream of fixes that are being provided.

Mobile phone companies, Linux Distros, embedded Linux deployments, etc all generally like the idea of installing one major version of Linux (e.g. 4.9) and sticking with it for the lifetime of their product.

This, and following stories tell how week to week testing of Linux kernels is going, what we’ve found, or better, not found as the kernel versions tick by.

We test using two host user spaces, open embedded and Android.

Open Embedded

2019–01–21

4.9.152, 4.14.95, 4.20.4

• Reported crashes in v4.20.3–15-g5592f5bf010b which were intentional ‘canaries’ (the canary successfully died)
• Reported no regressions in <24h

4.19.17

• Reported no regressions in <48h

Bug Status — 57 open bugs

• 2019–01–22: Anders Roxell sent allmodconfig patches 1 2
• 2019–01–18: Naresh Kamboju reported kselftest bpf test_netcnt failure re: bug 4245
• 2019–01–16: Daniel Díaz sent 4 kselftest patches upstream that are being carried in OE

Android

Android 9 / P — 4.4, 4.9, 4.14, 4.19 on HiKey

• 4.14.94 — no regressions
• 4.19.16 — Note USB OTG regression and potential eMMC issue documented in the bugs section
• 4.4.170 — no regressions
• 4.9.150 — no regressions

Android 8.1–4.4 on HiKey, Android 8.1, 4.14 on X15

• 4.14.94 / X15 no regressions
• 4.4.170 / HiKey no regressions

Android 9/P + automerged latest version of LTS 4.4, 4.9, 4.14, 4.19 + HiKey + Latest LTP

• This new combination is a work in progress to pull in latest LTP from AOSP-master, as well as using the combination of Android Common + HiKey Linaro (auto merged). It triggers automatically when Android Common is updated right after a new LTS release is merged. This combo thus gives everyone great visibility to test results nearly immediately after an new LTS is available.
• We have initial data but are not sharing them as part of this report yet.

AOSP-master tracking with 4.4, 4.9, 4.14, 4.19 on HiKey

• These builds are being reworked / repackaged so we’ll have data to report next week.

Bugs

• 18 — +2 WtW
• New: 4258 OTG with 4.19.17 (and prior) not flipping modes to allow USB keyboards etc
• New: 4259 4.19.17 eMMC issue?