We have an scaleable existing continuous integration system to test firmware for our nrf based designs on a Ubuntu 16.04 based development platform. We struggle with intermittency for any tests that require use of the Linux Hosts' BLE stack - which currently consists of:
* bluez (5.43)
* dbus
* Broadcom BCM20702A0 USB adapter
The intermittencies are about ~1/20 runs but generate enough noise that we would like to address. Failure types are primarily failed connections, dropped connections and stale advertising data. We are certain that the RF environment is "clean" (in RF isolation box) for the tests that utilize BLE.
We are not certain whether intermittencies are due to the BLE adapter or host side BLE stack.
Are there any success stories in creating a reliable Continuous Integration system that tests BLE interactions using a linux-side host? What was the setup?