nrf9160 ztest framework : unable to get a unit test to work

RE: nrf9160 ztest framework : unable to get a unit test to work

Ian — Tue, 02 Mar 2021 01:22:43 GMT

Were you able to get either unit test script working in the end? I'm currently attempting to set up unit tests and am coming across the same problems.

RE: nrf9160 ztest framework : unable to get a unit test to work

Simon — Tue, 21 Apr 2020 11:16:45 GMT

I guess you're right, was too quick to answer. I'll look into it.

Have you made any progress?

RE: nrf9160 ztest framework : unable to get a unit test to work

emeralddragon — Thu, 16 Apr 2020 10:33:53 GMT

Hi Simon, Not a problem. As the heading says: unable to get a unit test to work. I don't see the test in the main.c being run, and my questions previously still hold.Here is a clear list of questions:

The sanitycheck script did run without errors on windows but the output of that script needs some explanations. What are the 742 tests found? Why are 0 tests run etc. Please help me understand these.
Why can I not see the tests from main.c ? What am I missing?

RE: nrf9160 ztest framework : unable to get a unit test to work

Simon — Wed, 15 Apr 2020 09:30:36 GMT

Sorry for the delay, I've been gone due to easter holidays.

Could you open a new ticket and ask your question there, since the questions are somewhat unrelated(The first question was about getting tests to work on windows and this question is asking specifically about the tests)? This way we can keep everything more organized.

Best regards,

Simon

RE: nrf9160 ztest framework : unable to get a unit test to work

Vojislav — Thu, 09 Apr 2020 11:25:03 GMT

Hi,

I am also trying to get unit testing working on nrf91, and also got to this part. I am developing on Ubuntu. What are the next steps to get tests from main.c running?

Best regards,
Vojislav

RE: nrf9160 ztest framework : unable to get a unit test to work

emeralddragon — Wed, 08 Apr 2020 06:58:27 GMT

Hi Simon. Thanks for the update. After copying the folder to zephyr/tests it seems to be working. Here is my output:

INFO - JOBS: 8
INFO - Selecting default platforms per test case
INFO - Building initial testcase list...
INFO - 0 test configurations selected, 163755 configurations discarded due to filters.
INFO - Adding tasks to the queue...
INFO - 0 of 0 tests passed (0.00%), 0 failed, 0 skipped with 0 warnings in 5.14 seconds
INFO - In total 742 test cases were executed on 0 out of total 225 platforms (0.00%)
scripts/dts/ path xxx/zephyr\scripts\dts
Renaming output directory to xxx\zephyr\sanity-out.1

But I am surprised that the script found 742 tests and it was not run on any platform. It says "0 test configurations selected" and "0 of 0 tests passed (0.00%), 0 failed" How do I run the testcase from main.c and see the output?

RE: nrf9160 ztest framework : unable to get a unit test to work

Simon — Thu, 02 Apr 2020 14:13:00 GMT

I managed to make this work, I did the following:

Installed ncs v1.2.0. Check out our newly released app Toolchain Manager, which simplifies the process of installing ncs

Opened Git Bash
Typed in:

cd <location_of_ncs>/ncs/zephyr
export ZEPHYR_BASE=c:/Nordic_SDK/ncs/zephyr

Copied the sample ..\ncs\zephyr\samples\testing\integration into ..\ncs\zephyr\tests
Ran the following command:

python scripts/sanitycheck -s tests/integration

Got the following output:

INFO    - JOBS: 8
INFO    - Selecting default platforms per test case
INFO    - Building initial testcase list...
INFO    - 0 test configurations selected, 163755 configurations discarded due to filters.
INFO    - Adding tasks to the queue...
INFO    - 0 of 0 tests passed (0.00%), 0 failed, 0 skipped with 0 warnings in 4.73 seconds
INFO    - In total 742 test cases were executed on 0 out of total 225 platforms (0.00%)
Renaming output directory to C:\Nordic_SDK\ncs\zephyr\sanity-out.4

Best regards,

Simon

RE: nrf9160 ztest framework : unable to get a unit test to work

emeralddragon — Wed, 01 Apr 2020 13:47:06 GMT

Hi SImon,

I see what I got previously after adding "dts." to the import paths.

$ zephyr/scripts/sanitycheck -s ../samples/testing/integration

scripts/dts/ path C:\ConnectivityNodes_Cellular\zephyr\scripts\dts
Traceback (most recent call last):
File "zephyr/scripts/sanitycheck", line 1403, in <module>
class Platform:
File "zephyr/scripts/sanitycheck", line 1408, in Platform
platform_schema = scl.yaml_load(os.path.join(ZEPHYR_BASE,
File "C:\ConnectivityNode_Cellular\zephyr\scripts\sanity_chk\scl.py", line 29, in yaml_load
with open(filename, 'r') as f:
FileNotFoundError: [Errno 2] No such file or directory: 'C:\\ConnectivityNodes_Cellular\\zephyr\\scripts\\sanity_chk\\platform-schema.yaml'

RE: nrf9160 ztest framework : unable to get a unit test to work

Simon — Wed, 01 Apr 2020 12:44:56 GMT

It seems like this line is the one that includes the path where zephyr/scripts/dts/edtlib.py is located.

Have you set the ZEPHYR_BASE?

Could you try to add the following below this line (above import edtlib), to see what the path is equal to:

print("scripts/dts/ path",os.path.join(ZEPHYR_BASE, "scripts", "dts"))

Best regards,

Simon

RE: nrf9160 ztest framework : unable to get a unit test to work

emeralddragon — Wed, 01 Apr 2020 12:16:47 GMT

Okay. Just to mention: VB Ubuntu is not a preferred option...as of now.

RE: nrf9160 ztest framework : unable to get a unit test to work

Simon — Wed, 01 Apr 2020 11:38:19 GMT

I got the same error message when trying to build it in windows cmd. However, I was able to make it work using VirtualBox Ubuntu, but I'll set up Cygwin and see if I am able to make it work there as well. I'll keep you updated.

Best regards,

Simon

RE: nrf9160 ztest framework : unable to get a unit test to work

emeralddragon — Wed, 01 Apr 2020 06:46:26 GMT

So paths are an issue. It is unable to find the zephyr/scripts/dts path to find the edts/dts files. Any recommendations on how to fix this? I do not want to edit the zephyr source files.

RE: nrf9160 ztest framework : unable to get a unit test to work

emeralddragon — Wed, 01 Apr 2020 05:51:31 GMT

Thanks Simon. I did as you said, anytree, tabulate were not yet installed. But the issue remains:

zephyr/scripts/sanitycheck -s ../samples/testing/integration
Traceback (most recent call last):
File "zephyr/scripts/sanitycheck", line 213, in <module>
import edtlib
ModuleNotFoundError: No module named 'edtlib'

RE: nrf9160 ztest framework : unable to get a unit test to work

Simon — Mon, 30 Mar 2020 14:16:32 GMT

Could you test it again in Cygwin and run the following commands first:

cd <sourcecode_root>\ncs
pip3 install -r zephyr\scripts\requirements.txt
pip3 install -r nrf\scripts\requirements.txt
pip3 install -r bootloader\mcuboot\scripts\requirements.txt

Best regards,

Simon

RE: nrf9160 ztest framework : unable to get a unit test to work

emeralddragon — Fri, 27 Mar 2020 13:58:44 GMT

I have checked out master branch.