Thingy:91 will not connect to the LTE network: cloud_connect failed: 22, LTE link disconnect.

[Arjun Puri]

Hi There, 

ISSUE:

New Nordic Thingy:91 will not connect to the LTE network, it is giving:

2020-03-25T18:10:10.221Z DEBUG modem << cloud_connect failed: 22\x0D\x0A

2020-03-25T18:10:10.282Z DEBUG modem << LTE link disconnect\x0D\x0A

and then rebooting.

Things I have tried:

1. Rolling back the modem Firmware and updating again. Lots of different combinations of firmware. 

2. Trying to check the APN with AT+CDGCONT? to confirm it is trying to connect to the Vodafone network, to which it responded "OK" once but never actually gave the parameters. After the first time it would just respond "error". 

3. Updating the certificates which gave no errors.

4. Sending AT%XEPCO=0, as per this post: https://devzone.nordicsemi.com/f/nordic-q-a/47665/nrf_cloud_connect-failed-22. it responded "OK" but did not do anything. 

In the LTE Link monitor I have the following status' in the top right: UART: Flow-control Green; Modem: Green; UICC: Green; LTE: Not registered/searching.

DEVELOPMENT SETUP:

- System: HP HP EliteBook Folio 1040 G3
- BIOS: HP HPQOEM - 0
- CPU: 1 x Intel Core i5-6300U 2.40 GHz 4 cores (2 physical)
- Memory: 3.3 GB free of 7.8 GB total
- Filesystem: C: (NTFS) 116.7 GB 91.2% used

- OS: Microsoft Windows 10 Enterprise (10.0.17134) win32 ia32

- Versions
- kernel: 10.0.17134
- git: 2.25.0.windows.1
- node: 12.0.0
- python: 3.7.4
- python3:

Latest tools and packages from the Nordic website. I am based in the UK, working in London and Surrey. 

ATTACHMENTS:

2020-03-25T18:09:48.638Z DEBUG modem << ***** Booting Zephyr OS build v2.0.99-ncs1 *****\x0D
2020-03-25T18:09:48.640Z DEBUG modem << \x0A
2020-03-25T18:09:48.643Z DEBUG modem << Flash region\x09\x09Domain\x09\x09Permissions\x0D
2020-03-25T18:09:48.645Z DEBUG modem << \x0A
2020-03-25T18:09:48.647Z DEBUG modem << 00 0x00000 0x08000 \x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:48.708Z DEBUG modem << 01 0x08000 0x10000 \x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:48.711Z DEBUG modem << 02 0x10000 0x18000 \x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:48.712Z DEBUG modem << 03 0x18000 0x20000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.713Z DEBUG modem << 04 0x20000 0x28000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.714Z DEBUG modem << 05 0x28000 0x30000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.715Z DEBUG modem << 06 0x30000 0x38000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.716Z DEBUG modem << 07 0x38000 0x40000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.717Z DEBUG modem << 08 0x40000 0x48000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.718Z DEBUG modem << 09 0x48000 0x50000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.718Z DEBUG modem << 10 0x50000 0x58000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.719Z DEBUG modem << 11 0x58000 0x60000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.719Z DEBUG modem << 12 0x60000 0x68000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.719Z DEBUG modem << 13 0x68000 0x70000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.720Z DEBUG modem << 14 0x70000 0x78000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.720Z DEBUG modem << 15 0x78000 0x80000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.720Z DEBUG modem << 16 0x80000 0x88000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.721Z DEBUG modem << 17 0x88000 0x90000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.721Z DEBUG modem << 18 0x90000 0x98000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.721Z DEBUG modem << 19 0x98000 0xa0000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.722Z DEBUG modem << 20 0xa0000 0xa8000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.781Z DEBUG modem << 21 0xa8000 0xb0000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.783Z DEBUG modem << 22 0xb0000 0xb8000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.785Z DEBUG modem << 23 0xb8000 0xc0000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.786Z DEBUG modem << 24 0xc0000 0xc8000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.787Z DEBUG modem << 25 0xc8000 0xd0000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.788Z DEBUG modem << 26 0xd0000 0xd8000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.789Z DEBUG modem << 27 0xd8000 0xe0000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.789Z DEBUG modem << 28 0xe0000 0xe8000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.789Z DEBUG modem << 29 0xe8000 0xf0000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.790Z DEBUG modem << 30 0xf0000 0xf8000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.790Z DEBUG modem << 31 0xf8000 0x100000 \x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:48.793Z DEBUG modem << Non-secure callable region 0 placed in flash region 2 with size 32.\x0D\x0A\x0D\x0A
2020-03-25T18:09:48.920Z DEBUG modem << \x0D
2020-03-25T18:09:48.924Z DEBUG modem << \x0A
2020-03-25T18:09:48.926Z DEBUG modem << SRAM region\x09\x09Domain\x09\x09Permissions\x0D\x0A
2020-03-25T18:09:48.929Z DEBUG modem << 00 0x00000 0x02000\x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:48.931Z DEBUG modem << 01 0x02000 0x04000\x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:48.997Z DEBUG modem << 02 0x04000 0x06000\x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:49.058Z DEBUG modem << 03 0x06000 0x08000\x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:49.061Z DEBUG modem << 04 0x08000 0x0a000\x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:49.062Z DEBUG modem << 05 0x0a000 0x0c000\x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:49.063Z DEBUG modem << 06 0x0c000 0x0e000\x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:49.064Z DEBUG modem << 07 0x0e000 0x10000\x09Secure\x09\x09rwxl\x0D\x0A
2020-03-25T18:09:49.066Z DEBUG modem << 08 0x10000 0x12000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.067Z DEBUG modem << 09 0x12000 0x14000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.068Z DEBUG modem << 10 0x14000 0x16000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.069Z DEBUG modem << 11 0x16000 0x18000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.070Z DEBUG modem << 12 0x18000 0x1a000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.071Z DEBUG modem << 13 0x1a000 0x1c000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.072Z DEBUG modem << 14 0x1c000 0x1e000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.073Z DEBUG modem << 15 0x1e000 0x20000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.074Z DEBUG modem << 16 0x20000 0x22000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.075Z DEBUG modem << 17 0x22000 0x24000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.076Z DEBUG modem << 18 0x24000 0x26000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.077Z DEBUG modem << 19 0x26000 0x28000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.078Z DEBUG modem << 20 0x28000 0x2a000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.078Z DEBUG modem << 21 0x2a000 0x2c000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.078Z DEBUG modem << 22 0x2c000 0x2e000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.079Z DEBUG modem << 23 0x2e000 0x30000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.079Z DEBUG modem << 24 0x30000 0x32000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.140Z DEBUG modem << 25 0x32000 0x34000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.142Z DEBUG modem << 26 0x34000 0x36000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.143Z DEBUG modem << 27 0x36000 0x38000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.144Z DEBUG modem << 28 0x38000 0x3a000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.145Z DEBUG modem << 29 0x3a000 0x3c000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.146Z DEBUG modem << 30 0x3c000 0x3e000\x09Non-Secure\x09rwxl\x0D\x0A
2020-03-25T18:09:49.146Z DEBUG modem << 31 0x3e000 0x40000\x09Non-Secure\x09rwxl\x0D\x0A\x0D\x0A
2020-03-25T18:09:49.147Z DEBUG modem << Peripheral\x09\x09Domain\x09\x09Status\x0D\x0A
2020-03-25T18:09:49.147Z DEBUG modem << 00 NRF_P0               Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.148Z DEBUG modem << 01 NRF_CLOCK            Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.149Z DEBUG modem << 02 NRF_RTC1             Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.150Z DEBUG modem << 03 NRF_NVMC             Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.151Z DEBUG modem << 04 NRF_UARTE1           Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.152Z DEBUG modem << 05 NRF_UARTE2           Secure\x09\x09SKIP\x0D\x0A
2020-03-25T18:09:49.153Z DEBUG modem << 06 NRF_TWIM2            Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.153Z DEBUG modem << 07 NRF_SPIM3            Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.154Z DEBUG modem << 08 NRF_TIMER0           Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.155Z DEBUG modem << 09 NRF_TIMER1           Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.155Z DEBUG modem << 10 NRF_TIMER2           Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.156Z DEBUG modem << 11 NRF_SAADC            Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.156Z DEBUG modem << 12 NRF_PWM0             Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.157Z DEBUG modem << 13 NRF_PWM1             Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.157Z DEBUG modem << 14 NRF_PWM2             Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.157Z DEBUG modem << 15 NRF_PWM3             Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.218Z DEBUG modem << 16 NRF_WDT              Secure\x09\x09SKIP\x0D\x0A
2020-03-25T18:09:49.220Z DEBUG modem << 17 NRF_IPC              Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.221Z DEBUG modem << 18 NRF_VMC              Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.222Z DEBUG modem << 19 NRF_FPU              Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.223Z DEBUG modem << 20 NRF_EGU1             Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.224Z DEBUG modem << 21 NRF_EGU2             Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.225Z DEBUG modem << 22 NRF_DPPIC            Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.225Z DEBUG modem << 23 NRF_GPIOTE1          Non-Secure\x09OK\x0D\x0A
2020-03-25T18:09:49.225Z DEBUG modem << 24 NRF_REGULATORS       Secure\x09\x09SKIP\x0D\x0A\x0D\x0A
2020-03-25T18:09:49.226Z DEBUG modem << SPM: NS image at 0x18200\x0D\x0A
2020-03-25T18:09:49.226Z DEBUG modem << SPM: NS MSP at 0x2002ff40\x0D\x0A
2020-03-25T18:09:49.226Z DEBUG modem << SPM: NS reset vector at 0x2c8b5\x0D\x0A
2020-03-25T18:09:49.228Z DEBUG modem << SPM: prepare to jump to Non-Secure image.\x0D\x0A
2020-03-25T18:09:50.970Z DEBUG modem << ***** Booting Zephyr OS build v2.0[00:00:01.836,914] \x1B[0m<inf> BH1749: BH1749 initialized\x1B[0m\x0D\x0A
2020-03-25T18:09:50.974Z DEBUG modem << .99-ncs1 *****\x0D\x0A
2020-03-25T18:09:50.977Z DEBUG modem << Asset tracker started\x0D\x0A
2020-03-25T18:09:51.046Z DEBUG modem << [00:00:01.848,693] \x1B[0m<dbg> nrf_cloud_transport.nct_client_id_get: client_id = nrf-352656100985996\x1B[0m\x0D
2020-03-25T18:09:51.049Z DEBUG modem << \x0A
2020-03-25T18:09:51.051Z DEBUG modem << [00:00:01.857,910] \x1B[0m<dbg> nrf_cloud_transport.nct_topics_populate: shadow_base_topic: $aws/things/nrf-352656100985996/shadow\x1B[0m\x0D\x0A
2020-03-25T18:09:51.052Z DEBUG modem << [00:00:01.869,567] \x1B[0m<dbg> nrf_cloud_transport.nct_topics_populate: accepted_topic: nrf-352656100985996/shadow/get/accepted\x1B[0m\x0D\x0A
2020-03-25T18:09:51.052Z DEBUG modem << [00:00:01.881,042] \x1B[0m<dbg> nrf_cloud_transport.nct_topics_populate: rejected_topic: $aws/things/nrf-352656100985996/shadow/get/rejected\x1B[0m\x0D\x0A
2020-03-25T18:09:51.052Z DEBUG modem << [00:00:01.893,585] \x1B[0m<dbg> nrf_cloud_transport.nct_topics_populate: update_delta_topic: $aws/things/nrf-352656100985996/shadow/update/delta\x1B[0m\x0D\x0A
2020-03-25T18:09:51.053Z DEBUG modem << [00:00:01.906,463] \x1B[0m<dbg> nrf_cloud_transport.nct_topics_populate: update_topic: $aws/things/nrf-352656100985996/shadow/update\x1B[0m\x0D\x0A
2020-03-25T18:09:51.057Z DEBUG modem << [00:00:01.918,273] \x1B[0m<dbg> nrf_cloud_transport.nct_topics_populate: shadow_get_topic: $aws/things/nrf-352656100985996/shadow/get\x1B[0m\x0D\x0A
2020-03-25T18:09:51.062Z DEBUG modem << Connecting to LTE network. This may take several minutes.\x0D
2020-03-25T18:09:51.064Z DEBUG modem << \x0A
2020-03-25T18:09:51.126Z DEBUG modem << [00:00:01.937,713] \x1B[0m<dbg> lte_lc.w_lte_lc_connect: Network mode: AT%XSYSTEMMODE=0,1,1,0\x1B[0m\x0D\x0A
2020-03-25T18:09:54.967Z DEBUG modem << +CEREG: 2,"33F3","000D1415",9,0,0,"11100000","11100000"\x0D
2020-03-25T18:09:54.970Z DEBUG modem << \x0A
2020-03-25T18:09:54.973Z DEBUG modem << [00:00:05.837,615] \x1B[0m<dbg> lte_lc.parse_nw_reg_status: Network registration status: 2\x1B[0m\x0D
2020-03-25T18:09:54.975Z DEBUG modem << \x0A
2020-03-25T18:09:58.071Z DEBUG modem << +CEREG: 5,"33F3","000D1415",9,,,"11100000","00101000"\x0D
2020-03-25T18:09:58.074Z DEBUG modem << \x0A
2020-03-25T18:09:58.079Z DEBUG modem << [00:00:08.943,878] \x1B[0m<dbg> lte_lc.parse_nw_reg_status: Network registration status: 5\x1B[0m\x0D\x0A
2020-03-25T18:09:58.142Z DEBUG modem << Connected to LTE network\x0D\x0A
2020-03-25T18:09:58.314Z DEBUG modem << [00:00:09.179,565] \x1B[0m<dbg> nrf_cloud_transport.nct_connect: getaddrinfo failed 22\x1B[0m\x0D
2020-03-25T18:09:58.379Z DEBUG modem << \x0A
2020-03-25T18:09:58.382Z DEBUG modem << cloud_connect failed: 22\x0D\x0A
2020-03-25T18:09:58.384Z DEBUG modem << LTE link disconnect\x0D\x0A
2020-03-25T18:09:58.385Z DEBUG modem << +CEREG: 0,"33F3","000D1415",9,0,0,"11100000","11100000"\x0D\x0A
2020-03-25T18:09:58.500Z DEBUG modem << Shutdown modem\x0D
2020-03-25T18:09:58.502Z DEBUG modem << \x0A

Above is one cycle of the device log in constant reboot. nrf_cloud_connect failed:22 means invalid argument which I do not understand. I have tried following the advice in this thread: https://devzone.nordicsemi.com/f/nordic-q-a/47665/nrf_cloud_connect-failed-22 but it did not work. 

Any help, guidance or information would be appreciated in getting the asset tracker package up and running, I am officially out of ideas!!! HELP!

Thanks in advance.

Kindest Regards,

Arjun Puri

2020-03-25T18_03_46.344Z-log.txt

[Didrik Rokhaug]

Hi.

When did you send the %XEPCO command?

You should send it before the device connects to the network.

The easiest way to do it is to use the thingy91_nbiot_legacy_pco image that is in the "Precompiled application and modem firmware" folder: https://www.nordicsemi.com/Software-and-tools/Prototyping-platforms/Nordic-Thingy-91/Download#infotabs

That version sends the %XEPCO command automatically before it tries to attach to the network.

Best regards,

Didrik

[Arjun Puri]

Hi, 

We are now getting a response from the modem in the AT Client firmware after updating the modem to v1.2.0. However for both the nbiot and nbiot_legacy_pco firmwares we still get cloud connect failed: 22 error with looping reboot. 

Any further information or updates would be welcome!

Kindest regards,

Arjun

[Didrik Rokhaug]

Do other samples (that do DNS lookups work)?
If they do not, you could try to set the address of a DNS server. You can see how in this comment: https://devzone.nordicsemi.com/f/nordic-q-a/50029/nrf9160-modem-firmware-v1-0-0-setting-custom-dns-server/235419#235419