nRF9160 behavior when changing mode and switching SIM

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Mon, 06 Sep 2021 08:29:14 GMT

Hi!

Not yet sorry... between vacation and managing chip shortage, I did not have much time to spare on that subject.

I'll try to tackle it by the end of next week.

Regards

RE: nRF9160 behavior when changing mode and switching SIM

Heidi — Thu, 26 Aug 2021 12:18:10 GMT

Hi! Were you able to try the firmware?

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Fri, 06 Aug 2021 13:33:07 GMT

Hi!

Sorry for being late, I didn't receive the email notification of your answer for some reason....

I'll try the firmware next week.

Regards

RE: nRF9160 behavior when changing mode and switching SIM

Heidi — Wed, 14 Jul 2021 14:09:34 GMT

Hi!

There have been some issues with the trace bitmasks in certain MFW versions. I have copied the workaround below, which I'm hoping will fix this issue for you.

1. Flash corrected MFW Production Test Image via the Programmer application: mfw-pti_nrf9160_1.1.2.zip

NOTE: The application may give an error message at the end. However, flashing should be just fine and can be confirmed by giving "AT+CGMR" which should reply "mfw-pti_nrf9160_1.1.2".

2. Execute AT command: AT%XFSSYNC

3. Observe OK response for AT command

4. Make sure that the device boots once (either reset by flashing tool (nrfjprog --reset) or manually). Wait a few seconds and reset

Now the trace masks in the modem filesystem should be OK, so that traces get enabled. Go ahead and flash the normal MFW and try to take a new modem trace.

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Tue, 13 Jul 2021 12:46:31 GMT

Hi Heidi,

Did you have some intel on why the modem is not sending all the traces in our use cases?

Regards

Giuliano

RE: nRF9160 behavior when changing mode and switching SIM

Heidi — Tue, 29 Jun 2021 12:52:40 GMT

The data is missing, but we're not sure why. It doesn't look like an issue on your side.

Reviews on PRs can take a while depending on how busy the developers are, and since we're currently in the middle of the summer holiday here in Norway all departments are short-staffed.

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Tue, 29 Jun 2021 10:23:47 GMT

Hi,

I have added pull request with my code to get traces over RTT: https://github.com/nrfconnect/sdk-nrf/pull/5025

Please, follow up with that ticket, as it has already been a week without response form Nordic.

Regards
Giuliano

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Thu, 24 Jun 2021 16:06:19 GMT

Yes, if we take the SIM card out of the test board and put it in a nrf9160dk, the dk is able to connect.

When you say traces are missing, is it a software configuration issue or my SWD porting not working?

Do you have truncated data or just missing data?

RE: nRF9160 behavior when changing mode and switching SIM

Heidi — Thu, 24 Jun 2021 12:22:29 GMT

Thanks. What they want to know is if you have confirmed that the second SIM is able to connect to a network in your area?

There isn't much information to get from the trace logs, unfortunately. There are a lot of traces missing.

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Thu, 24 Jun 2021 11:34:06 GMT

The tests are done on one of our own board with has multiple SIM slot (both MFF2 and 4FF) with SIM switches controlled by GPIO connected to the nrf9160.

The providers we are currently testing are Orange and Vodafone

Which info did you gather from the logs? Are they correctly formatted ?

Regards

RE: nRF9160 behavior when changing mode and switching SIM

Heidi — Thu, 24 Jun 2021 11:25:29 GMT

Have you tested both SIM cards separately, either on your custom board or preferably on an nRF9160 DK, to see if it's able to connect independently?

What are the network providers you're testing with?

RE: nRF9160 behavior when changing mode and switching SIM

Heidi — Wed, 23 Jun 2021 13:01:53 GMT

Hi!

Didrik is on vacation so I have taken over this case. I will take a look at the logs and have an update for you tomorrow.

Best regards,

Heidi

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Fri, 18 Jun 2021 09:19:35 GMT

Hi Didrik,

Did you had time to analyze the logs to find the cause of the nrf9160 lock?

Are they correctly formatted ?

Regards

Giuliano

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Thu, 17 Jun 2021 07:05:44 GMT

The program ran for something like 10 to 15 minutes. As said earlier, it really seems that the program freezes.

As for the modem version, our program crashes at startup with the latest version. Maybe it has some incompatibility between our NCS version and/or our nRF9160 chip version (which is quite old right now)

RE: nRF9160 behavior when changing mode and switching SIM

Didrik Rokhaug — Wed, 16 Jun 2021 15:56:01 GMT

I will look more at the trace tomorrow, but yes, it seems to be valid.

The error rate was a bit higher than normal, but I don't know how much of a problem that really is. From my quick look, it seemed like most of the information was there.

How long did you trace? Looking at the timestamps in the trace, there is ~2 minutes of traces in the file. Is that correct?

On a different note, that trace is from mfw 1.2.3, not mfw 1.3.0.

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Wed, 16 Jun 2021 14:12:48 GMT

Hi Didrik,

I've tried to add RTT as trace output. Here is the result of my test.

Please tell me if the traces are correctly formatted and understandable.

If so, I'll do a pull request on sdk-nrf to add that functionality to the tree

Regards

Giuliano

devzone.nordicsemi.com/.../nrf9160_5F00_modem.zip

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Mon, 14 Jun 2021 10:52:59 GMT

Here is the newest log.

Same thing, test stopped after 10 min without any more logs

devzone.nordicsemi.com/.../4456.sim_5F00_card_5F00_test.log

RE: nRF9160 behavior when changing mode and switching SIM

Didrik Rokhaug — Mon, 14 Jun 2021 09:50:26 GMT

I apologise for not remembering this earlier, but you have to send the list of AT commands for each test.

The modem removes any urc subscriptions when it receives +CFUN=0.

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Mon, 14 Jun 2021 07:24:51 GMT

Hi,

I've attached the log received during our test.

As you can see, the modem stops responding after the SIM card is switched (more than 15 minutes without any log at all)

==> What can you learn from these logs?

devzone.nordicsemi.com/.../sim_5F00_card_5F00_test.log

Here is a small extract of our testing code:

struct test_data {
	enum lte_lc_system_mode mode;
	bool use_edrx;
	const char *ltem_edrx_value;
	const char *nbiot_edrx_value;
};

static const struct test_data test[] = {
	{
		.mode = LTE_LC_SYSTEM_MODE_LTEM,
		.use_edrx = true,
		.ltem_edrx_value = "0001",
		.nbiot_edrx_value = "0001",
	},
	{
		.mode = LTE_LC_SYSTEM_MODE_NBIOT,
		.use_edrx = true,
		.ltem_edrx_value = "0001",
		.nbiot_edrx_value = "0001",
	},
};

int main(void)
{
	int err;

    ... uninteresting init ...
    
    gpio_pin_configure(gpio, 31, GPIO_OUTPUT);

	LOG_WRN("====Calling lte_lc_init()====");
	lte_lc_init();

	LOG_WRN("====Registering %%XSIM urc====");
	at_cmd_write("AT%XSIM=1", NULL, 0, NULL);

	LOG_WRN("====Registering %%CESQ urc====");
	at_cmd_write("AT%CESQ=1", NULL, 0, NULL);

	LOG_WRN("====Registering %%MDEV urc====");
	at_cmd_write("AT%MDEV=1", NULL, 0, NULL);

	LOG_WRN("====Registering +CMEE urc====");
	at_cmd_write("AT+CMEE=1", NULL, 0, NULL);

	LOG_WRN("====Registering +CNEC urc====");
	at_cmd_write("AT+CNEC=24", NULL, 0, NULL);

	for (int sim = 0; sim < 2; sim++) {
		LOG_WRN("====Using SIM %d====", sim);
		gpio_pin_set(gpio, 31, sim);

		for (int i = 0; i < ARRAY_SIZE(test); i++) {
			const struct test_data *data = &test[i];

			LOG_WRN("====Starting test %d in 3 seconds=====", i);
			LOG_WRN("Mode: %d, edrx: %d, ltem: %s, nbiot: %s",
				data->mode, data->use_edrx,
				str_or_null(data->ltem_edrx_value),
				str_or_null(data->nbiot_edrx_value));

			k_sleep(K_SECONDS(3));

			lte_lc_system_mode_set(data->mode, 0);
			lte_lc_psm_req(false);

			if (!data->use_edrx) {
				lte_lc_edrx_req(false);
			}
			else {
				lte_lc_edrx_param_set(LTE_LC_LTE_MODE_LTEM,
					data->ltem_edrx_value);
				lte_lc_edrx_param_set(LTE_LC_LTE_MODE_NBIOT,
					data->nbiot_edrx_value);
				lte_lc_edrx_req(true);
			}

			err = lte_lc_connect();
			if (err) {
				LOG_ERR("Test %d fails: no connection", i);
			}
			else {
				LOG_WRN("Connected ! Checking eDRX value");
				k_sleep(K_SECONDS(2));
				at_cmd_write("AT+CEDRXRDP", NULL, 0, NULL);
				k_sleep(K_SECONDS(2));
				at_cmd_write("AT+CEDRXRDP", NULL, 0, NULL);
				k_sleep(K_SECONDS(2));
				at_cmd_write("AT+CEDRXRDP", NULL, 0, NULL);
			}

			LOG_WRN("====Test %d done. "
				"Starting next one in 10 seconds====", i);
			lte_lc_power_off();
			k_sleep(K_SECONDS(10));
		}
	}

	return 0;
}

And our prj.conf:

# General config
CONFIG_NEWLIB_LIBC=y
CONFIG_ASSERT=y
CONFIG_REBOOT=y
CONFIG_SERIAL=n

# Network
CONFIG_NETWORKING=y
CONFIG_NET_NATIVE=n
CONFIG_NET_SOCKETS=y
CONFIG_NET_SOCKETS_OFFLOAD=y

# LTE link control
CONFIG_LTE_LINK_CONTROL=y
CONFIG_LTE_NETWORK_MODE_LTE_M=y
CONFIG_LTE_LINK_CONTROL_LOG_LEVEL_DBG=y
CONFIG_LTE_NETWORK_USE_FALLBACK=n
CONFIG_LTE_NETWORK_TIMEOUT=90
CONFIG_LTE_AUTO_INIT_AND_CONNECT=n

# Modem info
CONFIG_NRF_MODEM_LIB=y
CONFIG_NRF_MODEM_LIB_TRACE_ENABLED=y

# Heap and stacks
CONFIG_HEAP_MEM_POOL_SIZE=16384
CONFIG_MAIN_STACK_SIZE=8192
CONFIG_SYSTEM_WORKQUEUE_STACK_SIZE=2048
CONFIG_HW_STACK_PROTECTION=y

The modem firmware is the 1.3.0.

The nRF9160 chip we are using comes from a kinda old board, and as the following lines written on it:

nrf9160 SICA

191104

I'll try to see if I can redirect trace to SWD.

Giuliano

RE: nRF9160 behavior when changing mode and switching SIM

Didrik Rokhaug — Thu, 10 Jun 2021 08:43:23 GMT

[quote user="GiulianoFranchetto"]

However, I cannot get the trace, as I don't have any available UART.

Is there any possibility to get trace through SWD using SEGGER RTT?

[/quote]

There is no support for other transports than UART in the SDK.

However, as the modem trace handling is implemented in nrf/lib/nrf_modem_lib/nrf_modem_os.c, it is possible to change the transport.

You can read more about what is required to handle the modem traces here: https://developer.nordicsemi.com/nRF_Connect_SDK/doc/latest/nrfxlib/nrf_modem/doc/ug_nrf_modem_porting_os.html

I believe it is possible to send the modem trace over RTT, though I am not sure how easy it would be.

If you could send an application log with the previously mentioned AT commands enabled, that might be enough to get us started.

Finally, I noticed a typo in my previous reply. It should be +CEREG, not %CEREG. I've updated the reply, so it is correct now. I've also added +CMEE and +CNEC to the list, and what values each of the commands should be set to.

RE: nRF9160 behavior when changing mode and switching SIM

GiulianoFranchetto — Wed, 09 Jun 2021 07:18:01 GMT

Hi,

Forever is until next reboot of the board. The longest time I've had before running out of patience was something around 30 minutes.

I'll send you the result today.

However, I cannot get the trace, as I don't have any available UART.

Is there any possibility to get trace through SWD using SEGGER RTT?

Regards

Giuliano

RE: nRF9160 behavior when changing mode and switching SIM

Didrik Rokhaug — Mon, 07 Jun 2021 15:46:11 GMT

Hi,

How long is "forever"?

Could you take a modem trace, and share the application log?

What modem firmware version are you using?

It would also be interresting if you could enable unsolicited responses from the %XSIM (1), %CESQ (1), +CEREG (5), +CMEE (1), +CNEC(24) and, if you are using mfw v1.3.0 %MDEV (1).

Best regards,

Didrik