MPSL thread being blocked due to application threads

RE: MPSL thread being blocked due to application threads

Sigurd — Tue, 13 Sep 2022 09:08:23 GMT

Do you see the same if you use the RTT logger backend?

Try setting

CONFIG_LOG_BACKEND_RTT=y

https://developer.nordicsemi.com/nRF_Connect_SDK/doc/2.0.2/nrf/ug_logging.html#ug-logging-backends

RE: MPSL thread being blocked due to application threads

Ubaid_M — Tue, 13 Sep 2022 08:59:57 GMT

Hi,

Still I am getting those junk values.

[quote userid="15146" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/385861"]

CONFIG_THREAD_ANALYZER_USE_LOG=y

CONFIG_THREAD_ANALYZER_USE_PRINTK=n

[/quote]

RE: MPSL thread being blocked due to application threads

Sigurd — Tue, 13 Sep 2022 08:20:07 GMT

Hi,

[quote user="Ubaid_M"]I was able to work put some issues and now all threads are being scheduled.[/quote]

Great!

[quote user="Ubaid_M"]However, some thread are getting junk prints for CPU utilization as in below:[/quote]

That is strange. Are you using CONFIG_THREAD_ANALYZER_USE_LOG or CONFIG_THREAD_ANALYZER_USE_PRINTK ?

Try setting

CONFIG_THREAD_ANALYZER_USE_LOG=y

CONFIG_THREAD_ANALYZER_USE_PRINTK=n

RE: MPSL thread being blocked due to application threads

Ubaid_M — Tue, 13 Sep 2022 05:52:47 GMT

Hi Sigurd,

I was able to work put some issues and now all threads are being scheduled.

However, some thread are getting junk prints for CPU utilization as in below:

How can I solve this..?

Thanks

RE: MPSL thread being blocked due to application threads

Sigurd — Fri, 09 Sep 2022 11:12:40 GMT

Hi,

[quote userid="15146" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/384262"]could you post how these threads looks like ?[/quote][quote userid="108934" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/384346"]Will get back on this.[/quote]

Could you post the code that shows these threads? (I can make this case private if you want to.)

RE: MPSL thread being blocked due to application threads

Ubaid_M — Fri, 09 Sep 2022 09:40:20 GMT

Hi,

I was able to run the same, Thread analyzer is working perfectly fine and printing stats when I disable my application thread, please find the stats as in below and suggest if anything wrong here:

Now if I enable my application thread, thread analyzer is unable to run (I think since it is lower priority task, app thread being higher priority thread is not letting thread analyzer thread to execute), below are the stats:

Do let me know your thoughts on these stats as well.

I need to know how I can optimize my thread based on the above stats:
1. In first, system reset thread is occupying 93% CPU
2. In second after enabling app thread, thread analyzer is not at all getting the CPU and main is occupying 84% CPU.

Thanks,

RE: MPSL thread being blocked due to application threads

Ubaid_M — Thu, 08 Sep 2022 13:16:04 GMT

Running only once

RE: MPSL thread being blocked due to application threads

Ubaid_M — Thu, 08 Sep 2022 13:15:08 GMT

Hi,

I did that and it is running and printing stats only once,
Please look at my prj.conf if everything is in order:

#Analyse threads
CONFIG_THREAD_ANALYZER=y
CONFIG_THREAD_ANALYZER_AUTO=y
CONFIG_THREAD_ANALYZER_AUTO_INTERVAL=5
CONFIG_THREAD_NAME=y
CONFIG_THREAD_MONITOR=y
CONFIG_THREAD_RUNTIME_STATS=y
CONFIG_THREAD_RUNTIME_STATS_USE_TIMING_FUNCTIONS=y
CONFIG_THREAD_ANALYZER_USE_LOG=y
CONFIG_THREAD_ANALYZER_USE_PRINTK=y

Or printing junk with this config:

I just need stack and CPU consumption thread wise

RE: MPSL thread being blocked due to application threads

Sigurd — Thu, 08 Sep 2022 13:11:03 GMT

Hi,

[quote user="Ubaid_M"]I just called "thread_analyzer_print( );" in my main application thread. Inside the while loop.[/quote]

You don't need to do that. You can just set CONFIG_THREAD_ANALYZER_AUTO=y

https://developer.nordicsemi.com/nRF_Connect_SDK/doc/2.0.2/kconfig/index.html#CONFIG_THREAD_ANALYZER_AUTO

RE: MPSL thread being blocked due to application threads

Ubaid_M — Thu, 08 Sep 2022 12:50:55 GMT

Hi,

As soon as I am running the analyzer I am getting these logs:

I just called "thread_analyzer_print( );" in my main application thread. Inside the while loop.

Thanks

RE: MPSL thread being blocked due to application threads

Ubaid_M — Thu, 08 Sep 2022 10:20:28 GMT

Hi,

[quote userid="15146" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/384563"]Also Thread analyzer might be useful.[/quote]

I am trying to use thread analyzer, can you please help me with a sample program demonstrating the use of Thread analyzer..?

RE: MPSL thread being blocked due to application threads

Sigurd — Mon, 05 Sep 2022 11:52:13 GMT

[quote user="sigurdon"]You can try to use the CPU load measurement module: https://developer.nordicsemi.com/nRF_Connect_SDK/doc/2.0.2/nrf/libraries/debug/cpu_load.html[/quote]

Also Thread analyzer might be useful.

https://developer.nordicsemi.com/nRF_Connect_SDK/doc/latest/zephyr/services/debugging/thread-analyzer.html#thread-analyzer

RE: MPSL thread being blocked due to application threads

Ubaid_M — Sun, 04 Sep 2022 15:23:04 GMT

Hi,

Meanwhile please support me on this..

[quote userid="108934" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/384346"]1. Can you please suggest any tool or add on that gives me thread wise details on CPU occupancy..?[/quote]

RE: MPSL thread being blocked due to application threads

Ubaid_M — Thu, 01 Sep 2022 12:49:07 GMT

Hello Sigurd,

[quote userid="15146" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/384262"]You can try to use the CPU load measurement[/quote]

1. Can you please suggest any tool or add on that gives me thread wise details on CPU occupancy..?
Any live monitoring would help.

[quote userid="15146" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/384262"] I don't really see how your application threads are causing issues[/quote]

This is what I felt as well, But as soon as I comment out the two UART threads & one application threads, my mesh models behave completely fine and response to OPCODES is instantaneous.

[quote userid="15146" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/384262"]Does your application work as expected when you don't have these UART threads?[/quote]

Yes, as soon as I comment out the two UART threads & one application threads, my mesh models behave completely fine.
2. I also observed that by reducing UART baud rate from 115200 to 9600, there was some improvement. Hence I suspect any interrupts are occupying the CPU or any dependent resource like semaphore is unavailable to MPSL thread...?

[quote userid="15146" url="~/f/nordic-q-a/91436/mpsl-thread-being-blocked-due-to-application-threads/384262"]could you post how these threads looks like ?[/quote]

Will get back on this.

Thanks,

RE: MPSL thread being blocked due to application threads

Sigurd — Thu, 01 Sep 2022 08:05:39 GMT

Hi,

Looking at the documentation here, I don't really see how your application threads are causing issues:

The scheduler distinguishes between two classes of threads, based on each thread’s priority.

A cooperative thread has a negative priority value. Once it becomes the current thread, a cooperative thread remains the current thread until it performs an action that makes it unready.
A preemptible thread has a non-negative priority value. Once it becomes the current thread, a preemptible thread may be supplanted at any time if a cooperative thread, or a preemptible thread of higher or equal priority, becomes ready.

[quote user=""]

2. How can I probe the CPU utilization further to find out what is happening or what is the issue leading to MPSL thread being blocked..?

[/quote]

You can try to use the CPU load measurement module: https://developer.nordicsemi.com/nRF_Connect_SDK/doc/2.0.2/nrf/libraries/debug/cpu_load.html

It's expected that these MPSL threads are 'blocked' most of the time, they are waiting for semaphore in the mpsl irq handler. https://github.com/nrfconnect/sdk-nrf/blob/v1.9.2/subsys/mpsl/init/mpsl_init.c#L53

Q: Does your application work as expected when you don't have these UART threads? If yes, could you post how these threads looks like ?