Unable to Run ZTest Unit Tests on nRF Sample – native_sim Not Detected by Twister

RE: Unable to Run ZTest Unit Tests on nRF Sample – native_sim Not Detected by Twister

dejans — Wed, 04 Jun 2025 09:44:46 GMT

Hi,

You can start by looking at Unit Testing Quick Start. "type:unit" in test yaml means it is supposed to only run on "unit_testing" platform. This is a setup to load only minimal functionality from zephyr to allow building apps and executing them with mocks on your host. Please note that native_posix is depricated (native_sim replaces it). Native_sim is a "full" platform, and that is why a lot of stuff will be missing when one starts with "unit_testing". Unit tests (using the board unit_testing) are intended to run on your host system and thus are a bit different than running on embedded target. There are some tests in Zephyr that can be built both using unit_testing as the target board or targeting an embedded target. Here is one example of such tests.

Best regards,
Dejan

RE: Unable to Run ZTest Unit Tests on nRF Sample – native_sim Not Detected by Twister

SemihAydin — Mon, 02 Jun 2025 08:17:24 GMT

Hİ Dejan,

I uninstalled all folders belongs to zephyr and nRF like ncs, nrf connect from vs code and zephyr folders from computer, then I installed them again I also removed the zephyr's path from the /.bashrc. After this process, result wasn't different. However, I decided to open some space in my computer because it was around 100-200MB space left. I opened more than 5GB space and this time result was different, I didn't get any error with native_sim.

This is good part, but now I have a different question.

I copied the intmath test from https://github.com/nrfconnect/sdk-zephyr/tree/v4.0.99-ncs1/tests/unit to see if my tests are wrong.

Here are the results,

native_sim and native_posix: I just added the necessary platform_allow and harness informations to the testcase.yaml file and tried to run with it. There are no error but tests are not executed. If I add build_only: false or build_only: true option, results are the same with native platforms.
    platform_allow:
      - native_sim
      - native_posix
    harness: ztest

My run commands are:
python3 /home/sirdarwin/ncs/v3.0.0/zephyr/scripts/twister -p native_posix -T /home/sirdarwin/multi_service/tests/unit/intmath -v

python3 /home/sirdarwin/ncs/v3.0.0/zephyr/scripts/twister -p native_sim -T /home/sirdarwin/multi_service/tests/unit/intmath -v

unit_testing: This platform is working as expected, I run the command "python3 /home/sirdarwin/ncs/v3.0.0/zephyr/scripts/twister -p unit_testing -T /home/sirdarwin/multi_service/tests/unit/intmath -v" and its working properly, even if I add build_only: false to the testcase.yaml file here is the result,

Can I assume that this unit test worked properly? because I didn't added the unit_testing platform.
What is the difference between unit_testing platform and native platforms?
Can I use that unit_testing platform for my all types of unit testing, I'm also open for another recommendations?
Why its not execute in native platforms?

RE: Unable to Run ZTest Unit Tests on nRF Sample – native_sim Not Detected by Twister

dejans — Wed, 21 May 2025 07:41:29 GMT

Hi Semih,

[quote user="SemihAydin"]I will try to uninstall other toolchain then I will keep you updated.[/quote]

Thank you. I am waiting for your update.

As it seems that twister cannot find boards from Zephyr root, you could try to add "--board-root" to your twister command. You can use "west twister --help" to get more information.

Best regards,
Dejan

RE: Unable to Run ZTest Unit Tests on nRF Sample – native_sim Not Detected by Twister

SemihAydin — Tue, 20 May 2025 19:57:24 GMT

Hi Dejans,

Thank you so much for your reply.

I'm sure that I'm using same toolchain(v3.0.0) but there are two toolchain installed other one is v2.9.0

As I mentioned that I'm checking my ZEPHYR_BASE by running: echo $ZEPHYR_BASE on terminal and I'm getting
"/home/sirdarwin/ncs/v3.0.0/zephyr" at the terminal output.

I will try to uninstall other toolchain then I will keep you updated.

Best regards,
Semih

RE: Unable to Run ZTest Unit Tests on nRF Sample – native_sim Not Detected by Twister

dejans — Tue, 20 May 2025 14:30:20 GMT

Hi Semih,

Are you sure that you have and use correct Toolchain?

It could also be worth double-checking that you have set correct ZEPHYR_BASE because in you case it seems that twister does not see boards from the Zephyr's root.

Best regards,
Dejan