nRF9160 MQTT connection failure

RE: nRF9160 MQTT connection failure

Simonr — Mon, 09 Sep 2019 06:28:20 GMT

That's great! Glad we were able to solve this problem!

Best regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Mon, 09 Sep 2019 03:18:35 GMT

Hi,

New modem firmware(v1.0.1) solved the issue.

Now it doesn't get stuck in MQTT connection.

Thanks !!!!!!

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

khodidas — Fri, 06 Sep 2019 11:52:38 GMT

Hi,

Thanks for informing.

I have kept my set up in test with v1.0.1 modem firmware.

I will tell you status tomorrow.

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

Simonr — Thu, 05 Sep 2019 06:33:08 GMT

Hi Smitesh

We've just released a new modem firmware update (v1.0.1) that solves a lot of bugs, including more robust TLS connections, which is what we think is the issue in your application. Please try downloading and upgrading to this new modem and see if you're still having this issue. The new modem firmware update can be downloaded here.

Best regards,

Simon

RE: nRF9160 MQTT connection failure

Simonr — Fri, 23 Aug 2019 12:53:04 GMT

Hi Smitesh

We've looked at your modem trace, and can't seem to find anything out of the ordinary. It seems the modem trace ends while the system is still connected, and it does not seem stuck in any way. However, our experts are looking into it, and hopefully, they'll be able to provide an answer over the weekend. I'll update you as soon as I know something!

Best regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Fri, 23 Aug 2019 07:27:11 GMT

Hi,

It is 40 minutes trace only. As i changed the frequency of connection with server to 1 minutes for test to generate

the issue faster. Issue was generated around 40 minutes as you mentioned.

You won't find disconnection event as the system got stuck in "mqtt_connect" function in attempt of making connection.

After that there won't be any further traces.

Do you find anything at the end of this traces which can help

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

Simonr — Fri, 23 Aug 2019 06:50:05 GMT

I got word from the developers, and when decrypted, the trace you uploaded only lasts for 40 minutes. It seems like the modem trace collector has been stopped somehow. So we haven't been able to see the disconnection event this time either. You have to make sure the full modem trace is being taken. We've been able to collect traces of this length on with our asset tracker example code, so there shouldn't be an issue with a timeout on the trace collector side. Are you using a development kit to do the tests?

Best regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Thu, 22 Aug 2019 11:05:36 GMT

Hi,

Please find the traces attached with connection issue generated.

Please check it and revert to me as soon as possible.

Thanks,

Smitesh Malidevzone.nordicsemi.com/.../trace_2D00_2019_2D00_08_2D00_22T10_2D00_14_2D00_27.570Z.bin

RE: nRF9160 MQTT connection failure

Simonr — Wed, 21 Aug 2019 13:02:47 GMT

Hi Smitesh

That file was valid, so you're good to start your test!

Best of luck and regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Wed, 21 Aug 2019 11:41:32 GMT

Hi,

Please check the attached traces

If it can be decoded then i will start my test.

Regards,

Smiteshdevzone.nordicsemi.com/.../trace_2D00_2019_2D00_08_2D00_21T11_2D00_38_2D00_30.273Z.bin

RE: nRF9160 MQTT connection failure

Simonr — Wed, 21 Aug 2019 11:19:27 GMT

The modem trace log has to be parsed and processed by us for it to be readable.

Best regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Wed, 21 Aug 2019 10:16:48 GMT

Hi,

Is it possible to see the traces on PC terminal ?

I didn't send "AT%XMODEMTRACE=1,2" command yesterday.

I have added it now but if i see the traces on PC terminal then it shows unreadable data.

I have kept 115200 buad rate.

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

Simonr — Wed, 21 Aug 2019 07:10:24 GMT

Sorry, but it seems your modem trace is invalid, as we're not able to read anything useful from it. I understand that this may be frustrating to hear, seeing as it takes you so long to reproduce the issue, but we'll need a readable one in order to help you find out what's going on. What you can do, is sending a test trace that doesn't require 8 hours of waiting first, so that we can check if the modem trace is correct before you send the 8-hour version

The most common mistakes are that CONFIG_BSD_LIBRARY_TRACE_ENABLED=y in prj.conf isn't set in step 1, and that AT%XMODEMTRACE=1,2 isn't sent in step 4.

Best regards and sorry for the inconvenience,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Wed, 21 Aug 2019 03:22:29 GMT

Hi,

I have captured the traces of Modem of the issue where nRF9160 gets stuck in

"connect" function after 8-9 hours of successful connection.

I have attached the traces here.

Log with problem should be at the end of this file as after the issue no connection happened.

Please check it and try to answer me as soon as possible.

Regards,

Smitesh Malidevzone.nordicsemi.com/.../trace_2D00_2019_2D00_08_2D00_20T10_2D00_13_2D00_59.137Z.bin

RE: nRF9160 MQTT connection failure

khodidas — Tue, 20 Aug 2019 03:44:22 GMT

Hi,

Thanks.

I followed the commands you have mentioned in your thread but there is no difference in ncs folder.

bsdlib is same after fetching the v1.0.0 with what i am using.

I will try to give you traces of modem.

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

Simonr — Mon, 19 Aug 2019 12:14:04 GMT

So you can confirm that bsdlib and ncs matches? These commands in the CLI should do the trick, sorry for not posting these earlier:

cd ncs/nrf
git checkout master
git pull
git checkout v1.0.0
west update

Please confirm you've done this, and that bsdlib matches ncs. If the problem persists, please get a modem trace with this behavior and upload it here, so our developers can have a look at what exactly is going on. You can follow this guide to get the modem trace using the Trace Collector app in nRFConnect for desktop.

Best regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Mon, 19 Aug 2019 04:07:43 GMT

Hi,

I checked after checkout and update west again and also reset modem firmware but we are getting same issue.

We did another test yesterday.

We are powering off and on the nRF9160 supply every 2 hours.

After doing this we are not getting issue of nRF9160 getting stuck in "connect" function and data is being sent

to server every 5 minutes.

So it definitely seems firmware related issue.

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

Simonr — Wed, 14 Aug 2019 11:43:32 GMT

Yeah, the timing seems to check out. Please confirm whether or not running a checkout, updating west, and reinstalling the modem firmware worked.

Best regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Wed, 14 Aug 2019 09:56:35 GMT

Hi,

I got "+CEREG: 5,1,"7A45","011DA405",7,,,"00000001","10111110"<CR>".

So settings received from network is

CONFIG_LTE_PSM_REQ_RPTAU="10111110" and CONFIG_LTE_PSM_REQ_RAT = 00000001

Our setting is below

CONFIG_LTE_PSM_REQ_RPTAU="00000011"

CONFIG_LTE_PSM_REQ_RAT="00000000"

So TAU value as per my calculation is 30 minutes in both "10111110" and "00000011" settings.

So I don't think it should make difference in terms of timing is concerned.

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

Simonr — Tue, 13 Aug 2019 13:27:00 GMT

I've asked my colleagues about your matter, and they suggest this might be a mismatch somewhere. Could you try running a checkout in the repo, and a west update, as well as reinstalling the newest modem firmware onto the nRF9160.

Also, it seems I misunderstood the AT+CPSMS? command, this will give you the requested values, and not the actual set values from the network. If you call AT+CEREG=5 followed by AT+CEREG? you should get the actual PSM-interval from the network.

Best regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Tue, 13 Aug 2019 10:33:22 GMT

Hi,

I got following reply from "AT+CPSMS?" at command.

CPSMS = +CPSMS: 1,,,"00000011","00000001"<CR>

So the values are same as we requested.

Some more information about our set up and observations

We have also made a PC client to behave in the same manor and this runs without any problems.

We have also moved from one production environment ( At Telenor ) to another and problem still exists.

As I have mentioned in my very first thread , there are two issues

1. MQTT connection Failure after many successful connections

2. nRF9160 takes longer time in first connection if PSM mode is enabled.

I work for norwegian company and access the nRF9160 hardware using remote pc set up from

India.

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

khodidas — Mon, 12 Aug 2019 08:11:44 GMT

[quote userid="75734" url="~/f/nordic-q-a/50735/nrf9160-mqtt-connection-failure/203493"]Can you confirm that you're situated in India while connected to a Norwegian (Telenor) network?[/quote]

Yes, you are right.

I will check PSM supported by network using "AT+CPSMS?"

RE: nRF9160 MQTT connection failure

Simonr — Mon, 12 Aug 2019 07:47:41 GMT

Can you confirm that you're situated in India while connected to a Norwegian (Telenor) network?

Keep in mind that the PSM mode intervals are requested by the nRF9160 to the network, it's not a certainty that the nRF9160 gets those intervals from the network. You can check if there is a difference in the PSM modes of your different providers by using the AT command AT+CPSMS?after activating PSM. (as stated in the AT Command documentation). It will return the parameters used.

Best regards,

Simon

RE: nRF9160 MQTT connection failure

khodidas — Sat, 10 Aug 2019 11:37:04 GMT

Hi,

[quote userid="75734" url="~/f/nordic-q-a/50735/nrf9160-mqtt-connection-failure/203290"]What network are you connected to?[/quote]

Telenor (Norway)

[quote userid="75734" url="~/f/nordic-q-a/50735/nrf9160-mqtt-connection-failure/203290"]How often do you set the device in PSM mode?[/quote]

Below are my PSM settings

# Requested Periodic TAU
CONFIG_LTE_PSM_REQ_RPTAU="00000011"
# Requested Active Time
#CONFIG_LTE_PSM_REQ_RAT="00001010"
CONFIG_LTE_PSM_REQ_RAT="00000001"

[quote userid="75734" url="~/f/nordic-q-a/50735/nrf9160-mqtt-connection-failure/203290"]Are you using the latest modem firmware as well (mfw version 1.0.0)?[/quote]

Yes

Regards,

Smitesh Mali

RE: nRF9160 MQTT connection failure

Simonr — Fri, 09 Aug 2019 11:49:19 GMT

Hi Smitesh

I have a few questions to your setup:

What network are you connected to?
How often do you set the device in PSM mode?
Are you using the latest modem firmware as well (mfw version 1.0.0)?

The behavior of your device indicates that the coverage might be bad in your location, and that's why it drops out. Error -111 usually indicates that something is wrong with the credentials/certification, and error -60 indicates a timeout.

Best regards,

Simon