Modem does not connect after Modem delta upgrade

RE: Modem does not connect after Modem delta upgrade

Øyvind — Wed, 03 May 2023 09:10:49 GMT

Hi Hubert,

[quote user="hjetschko"]Can I mark this as the solution or do you think there is still something to be concerned about?[/quote]

If this fixes the issue on all your devices, then I thing we can say that this is the fix. The XFACTORYRESET might have removed some data that prevented the update to be fulfilled, but I don't know what.

If you are happy, then let's call this a success. And if you do see any issues afterwards, please let us know.

Kind regards,
Øyvind

RE: Modem does not connect after Modem delta upgrade

hjetschko — Wed, 03 May 2023 02:16:53 GMT

Hi Øyvind

Thank you for looking into this. We worked through all the commands from the AT Commands PDF to see if we can find a parameter that could affect this. When we tried AT%XFACTORYRESET=0 the device started working again. We also tried this on a bunch of other devices that stopped working and we were able to recover all of them. Can I mark this as the solution or do you think there is still something to be concerned about?

Regards

Hubert

RE: Modem does not connect after Modem delta upgrade

Øyvind — Tue, 02 May 2023 15:13:45 GMT

[quote user="hjetschko"]Can you please have another look if you can see any reason why these modems stopped connecting after doing a delta modem upgrade?[/quote]

I'm afraid these did not provide any information.

[quote user="hjetschko"] The only way I could get it working was over RTT. This log was captures by J-Link RTT logger.[/quote]

I think we need to retry with this method. Can you please revert back to how the project was configured to capture RTT modem trace? Following the steps provided under Modem Trace Module, please add CONFIG_NRF_MODEM_LIB_TRACE_LEVEL_LTE_AND_IP=y to prj.conf.

RE: Modem does not connect after Modem delta upgrade

Øyvind — Tue, 02 May 2023 15:13:43 GMT

[quote user="hjetschko"]Can you please have another look if you can see any reason why these modems stopped connecting after doing a delta modem upgrade?[/quote]

I'm afraid these did not provide any information.

[quote user="hjetschko"] The only way I could get it working was over RTT. This log was captures by J-Link RTT logger.[/quote]

RE: Modem does not connect after Modem delta upgrade

hjetschko — Tue, 02 May 2023 02:23:47 GMT

Hi Øyvind

Unfortunately I could not figure out how to fix the IRQ error. I saw there is another option which uses uart_sync.c if I set CONFIG_NRF_MODEM_LIB_TRACE_BACKEND_UART_SYNC. With this set I can capture data over the uart using the nRF Connect Trace Collector. I have done two captures similar to before for both 1.3.3 and 1.3.4 modem firmware version. Can you please have another look if you can see any reason why these modems stopped connecting after doing a delta modem upgrade?

Thanks and regards

Hubert

devzone.nordicsemi.com/.../trace_2D00_2023_2D00_05_2D00_02T01_2D00_50_2D00_21.991Z-mv1.3.3.bin

devzone.nordicsemi.com/.../trace_2D00_2023_2D00_05_2D00_02T00_2D00_32_2D00_55.201Z-mv1.3.4.bin

RE: Modem does not connect after Modem delta upgrade

hjetschko — Wed, 26 Apr 2023 22:55:15 GMT

Hi Øyvind

I moved our lpuart from uart1 to uart 0:

In device tree:

uart0: uart@8000 {
compatible = "nordic,nrf-uarte";
reg = < 0x8000 0x1000 >;
interrupts = < 0x8 0x1 >;
status = "okay";
current-speed = < 0x1c200 >;
pinctrl-0 = < &uart0_default >;
pinctrl-1 = < &uart0_sleep >;
pinctrl-names = "default", "sleep";
lpuart: nrf-sw-lpuart {
compatible = "nordic,nrf-sw-lpuart";
status = "okay";
label = "LPUART";
req-pin = < 0x1b >;
rdy-pin = < 0x1a >;
};
};

And for KConfig:

CONFIG_UART_0_ASYNC=y
CONFIG_UART_0_NRF_HW_ASYNC=y
CONFIG_UART_0_NRF_HW_ASYNC_TIMER=2

It works correctly on uart0. I also moved the zephyr stuff from uart 0 to uart 2:

zephyr,console = &uart2;
zephyr,shell-uart = &uart2;
zephyr,uart-mcumgr = &uart2;

To me it looks like it should free uart1. I have attached the zephyr.dts and .config files. Can you please let me know if you anything that will clash with uart 1devzone.nordicsemi.com/.../dot_5F00_config.txt devzone.nordicsemi.com/.../0028.zephyr.dts?

RE: Modem does not connect after Modem delta upgrade

Øyvind — Tue, 25 Apr 2023 11:00:08 GMT

[quote user="hjetschko"]We do not call IRQ_CONNECT or IRQ_DIRECT_CONNECT from our code. Can you please give me advice about this?[/quote]

No, this is handled by the Zephyr OS interrupts kernel service. IRQ_CONNECT is used to initialize an interrupt handler.

[quote user="hjetschko"]Has IRQ_CONNECT or IRQ_DIRECT_CONNECT accidentally been invoked on the same irq multiple times?[/quote]

This explains what is happening in your project. If this is new, then you need to check what is causing this error. How did you move the lpuart to another UART?

RE: Modem does not connect after Modem delta upgrade

hjetschko — Sun, 23 Apr 2023 22:25:46 GMT

Hi Øyvind

Thank you for your help. Our product used UART1 (lpuart) for communication to another micro. I moved it to another UART and made sure it works. UART1 should be free but I cannot get it to compile. This is the error I get when trying to use modem trace with UART1:

gen_isr_tables.py: error: multiple registrations at table_index 9 for irq 9 (0x9)
Existing handler 0x775a9, new handler 0x7d7c1
Has IRQ_CONNECT or IRQ_DIRECT_CONNECT accidentally been invoked on the same irq multiple times?

We do not call IRQ_CONNECT or IRQ_DIRECT_CONNECT from our code. Can you please give me advice about this?

RE: Modem does not connect after Modem delta upgrade

Øyvind — Fri, 21 Apr 2023 13:52:46 GMT

Unfortunately, the modem traces do not capture required information. Are you not able to collect modem traces via UART1? By default, nRF Connect SDK's modem library uses the UART1 peripheral for trace output

Still investigating.

RE: Modem does not connect after Modem delta upgrade

hjetschko — Wed, 19 Apr 2023 22:45:19 GMT

Hi Øyvind

Thank you for your help analyzing these files. I have done both 1.3.3 and 1.3.4 traces doing the following:

Started the RTT logging
Reset the nRF9160 firmware
Leave it running for 20 minutes

Please let me know if you need more information.devzone.nordicsemi.com/.../RTTLogger_5F00_Channel_5F00_modem_5F00_trace_5F00_modemfw_5F00_1.3.3.log devzone.nordicsemi.com/.../RTTLogger_5F00_Channel_5F00_modem_5F00_trace_5F00_modemfw_5F00_1.3.4.log

RE: Modem does not connect after Modem delta upgrade

Øyvind — Wed, 19 Apr 2023 10:40:40 GMT

Thanks for providing the modem fw. Could you please redo test with both mfw 1.3.3 and 1.3.4? Please start modem trace and then reset board in order to see what happens before main. Could you please leave the trace running for a minimum of 20 minutes for each? This way we can ensure that the network is found and the connection progress is done completely.

Thanks

RE: Modem does not connect after Modem delta upgrade

hjetschko — Wed, 19 Apr 2023 08:49:00 GMT

Hi, unfortunately I could not get the trace working over the UART. The only way I could get it working was over RTT. This log was captures by J-Link RTT logger. The modem firmware is:

mfw_nrf9160_1.3.3

I reset the nRF9160, it stopped at a breakpoint at the start of main, then I started logging, then I let the firmware run. I can program 1.3.4 and redo the test if needed.

RE: Modem does not connect after Modem delta upgrade

Øyvind — Wed, 19 Apr 2023 08:39:19 GMT

With what modem FW did you capture this trace? Are you using trace collector v2? How long did you let it run while collecting? I am able to open the trace, however, I'm not sure I have the correct mfw version.

RE: Modem does not connect after Modem delta upgrade

hjetschko — Wed, 19 Apr 2023 08:16:05 GMT

Hi Øyvind

Sorry for the delay, we struggled to get the modem trace working on our hardware. I have attached the modem trace file, can you please let me know if this file is correct?

Regards

Hubertdevzone.nordicsemi.com/.../0702.RTTLogger_5F00_Channel_5F00_modem_5F00_trace.log

RE: Modem does not connect after Modem delta upgrade

Øyvind — Tue, 11 Apr 2023 14:13:35 GMT

Hello,

could you please provide some logs of the issue? A modem trace would be great as well.

Thanks!

Kind regards,
Øyvind

RE: Modem does not connect after Modem delta upgrade

hjetschko — Fri, 07 Apr 2023 01:38:22 GMT

I made a mistake above, we are currently using NCS V2.1.0 for this project. Sorry about this.