Tensorflow example not working on nRF Connect SDK

[kclauah]

I have tried tensorflow example on nRF Connect SDK v1.6.1, v1.7.0 and v1.7.1 but all of them are not working.

To reproduce the behavior, build any example under zephyr\sample\modules\tensorflow

Here is the error from output console:

1> Compiling ‘model.cc’
2> Compiling ‘output_handler.cc’
4> ../src/main_functions.cc:19:10: fatal error: tensorflow/lite/micro/all_ops_resolver.h: No such file or directory
4> compilation terminated.
2> In file included from ../src/output_handler.cc:17:
2> ../src/output_handler.h:20:10: fatal error: tensorflow/lite/c/common.h: No such file or directory
2> compilation terminated.
Build failed

[Simon]

I can see that CONFIG_TENSORFLOW_LITE_MICRO will get the value 'n', even if it's set to 'y'. I'm not sure why this is. Maybe that's what's leading to the issues you see.

However, since this is a Zephyr sample, I think you'll get better help if you create a Zephyr issue or ask in any of these resources: https://developer.nordicsemi.com/nRF_Connect_SDK/doc/latest/zephyr/introduction/index.html#resources.

Check out this ticket as well: https://devzone.nordicsemi.com/f/nordic-q-a/79892/tensorflow-lite-micro-support-for-machine-learning/330840#330840 

Best regards,

Simon

[Ivan Angelov]

I do not think Nordic have fixed this issue.
I asked for help at tflite-micro repo, see https://github.com/zephyrproject-rtos/zephyr/discussions/52302

I have my own Zephyr project with my own board based on nRF5340. I am using Zephyr v3.2.99-ncs2, nrf-sdk is v2.3.0.
I modified NRF west.yml as suggested in tflite-micro repo:

diff --git a/west.yml b/west.yml
index a93676a6..5b16929e 100644
--- a/west.yml
+++ b/west.yml
@@ -66,6 +66,7 @@ manifest:
         #
         # Please keep this list sorted alphabetically.
         name-allowlist:
+          - tflite-micro
           - TraceRecorderSource
           - canopennode
           - chre

I ran west update but I get no luck with adding CONFIG_TENSORFLOW_LITE_MICRO=y to my project.
When I ran west -v update I noticed following line:

west.manifest: project tflite-micro in file None ignored: an importing manifest blocked or did not allow it

In my project west.yml I have added tflite-micro project:

    - name: tflite-micro

      path: zephyr/modules/tflite-micro

      url: github.com/.../tflite-micro.git

      revision: 8913f033772ac7009b6d8a1c8817e2399d22d803

After west update I can see the sources of tflite-micro located in zephyr repo:

<>/zephyr/modules/tflite-micro
./
../
.bazelrc*
.clang-format*
.editorconfig*
.git/
.github/
.gitignore*
AUTHORS*
BUILD*
CMakeLists.txt*
CODEOWNERS*
CONTRIBUTING.md*
Kconfig*
LICENSE*
README.md*
SECURITY.md*
WORKSPACE*
ci/
data/
docs/
python/
tensorflow/
third_party/

However, I still could not set

CONFIG_TENSORFLOW_LITE_MICRO=y

Are you able to give some tips?

[Sigurd Hellesvik]

Since the nRF Connect SDK does not have official support available for running tensorflow directly, the help I can give will be limited.
But I will help you look into the issue still, so:

First, can you specify why you

Ivan Angelov said:

could not set

CONFIG_TENSORFLOW_LITE_MICRO=y

?

Try to use our menuconfig tool to search for CONFIG_TENSORFLOW_LITE_MICRO. This will show you which dependencies prevent you to set this config.

Regards,
Sigurd Hellesvik

[Ivan Angelov]

Please find attached a screen shot from VSCode studio with nRF Connect plugin:

The option for TensorFlow Lite Micro Support seems to be grayed out.

When I manually set in prj.conf I get following:
warning: TENSORFLOW_LITE_MICRO (defined at modules\tflite-micro\Kconfig:8) was assigned the value
'y' but got the value 'n'. Check these unsatisfied dependencies: 0 (=n). See
docs.zephyrproject.org/.../kconfig.html and/or look up
TENSORFLOW_LITE_MICRO in the menuconfig/guiconfig interface. The Application Development Primer,
Setting Configuration Values, and Kconfig - Tips and Best Practices sections of the manual might be
helpful too.

[Sigurd Hellesvik]

Huh, odd that it is dependent on 0.

You can always try to force set TENSORFLOW_LITE_MICRO in your projects "Kconfig" file:

config TENSORFLOW_LITE_MICRO
    bool "Tensorflow Lite Micro custom override"
    default 1

Regards,
Sigurd Hellesvik

[Ivan Angelov]

That did the trick!
<my_project>/build/zephyr$ less .config

CONFIG_TENSORFLOW_LITE_MICRO=y

Thank you Sigurd Hellesvik