No connection to nRF cloud (Attempts to use AGPS)

[Stas Jis]

We are using nRF9160 (Development Kit), SDK 1.9.1 board with "serial lte modem" firmware.
We are trying to get AGPS coordinates (using an external antenna), but for some reason we stopped receiving confirmations about the connection to the nRF cloud.
In response to the command "AT#XNRFCLOUD=1" we always get only "OK" without (#XNRFCLOUD: 1,0).
Checking the connection to the cloud shows that there is no connection:

AT#XNRFCLOUD?

#XNRFCLOUD: 0,0,16842753,"nrf-352656108600480"

The last time during development we checked the command sequence for getting coordinates using AGPS about a month ago and everything worked fine (was tested on SDK 1.8). But now even on SDK 1.8 we cannot get coordinates using AGPS, only regular GPS works.
AT commands: 

2022-03-31T12:15:16.966Z DEBUG modem << Ready
2022-03-31T12:15:18.043Z DEBUG modem << [00:00:00.467,926] [0m<inf> slm: Serial LTE Modem[0m
2022-03-31T12:15:18.050Z DEBUG modem << [00:00:00.500,030] [0m<inf> slm_at_host: at_host init done[0m
2022-03-31T12:15:25.049Z DEBUG modem >> AT
2022-03-31T12:15:25.059Z DEBUG modem << OK
2022-03-31T12:15:25.873Z DEBUG modem >> AT+CFUN?
2022-03-31T12:15:25.886Z DEBUG modem << +CFUN: 0
2022-03-31T12:15:25.894Z DEBUG modem << OK
2022-03-31T12:15:45.149Z DEBUG modem << *** Booting Zephyr OS build v2.7.99-ncs1-1  ***
2022-03-31T12:15:46.145Z DEBUG modem << Ready
2022-03-31T12:15:47.126Z DEBUG modem << [00:00:01.176,116] [0m<inf> slm: Serial LTE Modem[0m
2022-03-31T12:15:47.135Z DEBUG modem << [00:00:01.208,160] [0m<inf> slm_at_host: at_host init done[0m
2022-03-31T12:16:27.274Z DEBUG modem >> AT
2022-03-31T12:16:27.285Z DEBUG modem << OK
2022-03-31T12:16:28.249Z DEBUG modem >> AT+CFUN?
2022-03-31T12:16:28.265Z DEBUG modem << +CFUN: 0
2022-03-31T12:16:28.272Z DEBUG modem << OK
2022-03-31T12:16:34.122Z DEBUG modem << *** Booting Zephyr OS build v2.7.99-ncs1-1  ***
2022-03-31T12:16:34.439Z DEBUG modem << Ready
2022-03-31T12:16:35.420Z DEBUG modem << [00:00:00.498,748] [0m<inf> slm: Serial LTE Modem[0m
2022-03-31T12:16:35.429Z DEBUG modem << [00:00:00.530,822] [0m<inf> slm_at_host: at_host init done[0m
2022-03-31T12:16:41.915Z DEBUG modem << *** Booting Zephyr OS build v2.7.99-ncs1-1  ***
2022-03-31T12:16:42.651Z DEBUG modem << Ready
2022-03-31T12:16:43.632Z DEBUG modem << [00:00:00.915,985] [0m<inf> slm: Serial LTE Modem[0m
2022-03-31T12:16:43.639Z DEBUG modem << [00:00:00.948,059] [0m<inf> slm_at_host: at_host init done[0m
2022-03-31T12:16:56.482Z DEBUG modem >> AT%XSYSTEMMODE=1,0,1,0
2022-03-31T12:16:56.498Z DEBUG modem << OK
2022-03-31T12:17:01.946Z DEBUG modem >> AT%XMAGPIO=1,0,0,1,1,1574,1577
2022-03-31T12:17:01.960Z DEBUG modem << OK
2022-03-31T12:17:06.921Z DEBUG modem >> AT%XCOEX0
2022-03-31T12:17:06.932Z DEBUG modem << OK
2022-03-31T12:17:11.401Z DEBUG modem >> AT+CEREG=5
2022-03-31T12:17:11.414Z DEBUG modem << OK
2022-03-31T12:17:16.289Z DEBUG modem >> AT+CPSMS=1
2022-03-31T12:17:16.302Z DEBUG modem << OK
2022-03-31T12:17:21.488Z DEBUG modem >> AT+CFUN=1
2022-03-31T12:17:21.534Z DEBUG modem << OK
2022-03-31T12:17:23.561Z DEBUG modem << +CEREG: 2,"026F","00332520",7
2022-03-31T12:17:25.178Z DEBUG modem << +CEREG: 5,"026F","00332520",7,,,"00011110","11100000"
2022-03-31T12:17:28.768Z DEBUG modem >> AT#XNRFCLOUD=1
2022-03-31T12:17:28.776Z DEBUG modem << OK
2022-03-31T12:17:36.432Z DEBUG modem >> AT#XAGPS=1,1
2022-03-31T12:17:36.439Z DEBUG modem << ERROR
2022-03-31T12:17:36.440Z ERROR Error: AT#XAGPS=1,1
 failed
2022-03-31T12:17:42.194Z DEBUG modem >> AT#XNRFCLOUD?
2022-03-31T12:17:42.206Z DEBUG modem << #XNRFCLOUD: 0,0,16842753,"nrf-352656108600480"
2022-03-31T12:17:42.208Z DEBUG modem << OK

prj.conf:

#
# Copyright (c) 2020 Nordic Semiconductor ASA
#
# SPDX-License-Identifier: LicenseRef-Nordic-5-Clause
#
# General config
CONFIG_LOG=y
CONFIG_LOG_DEFAULT_LEVEL=3
CONFIG_STACK_SENTINEL=y
CONFIG_NEWLIB_LIBC=y
CONFIG_NEWLIB_LIBC_FLOAT_PRINTF=y
CONFIG_RING_BUFFER=y

# Segger RTT
CONFIG_USE_SEGGER_RTT=y
CONFIG_RTT_CONSOLE=y
CONFIG_UART_CONSOLE=y
CONFIG_LOG_BACKEND_RTT=n
CONFIG_LOG_BACKEND_UART=y

# Network
CONFIG_NETWORKING=y
CONFIG_NET_SOCKETS=y
CONFIG_NET_NATIVE=n

# Modem library
CONFIG_NRF_MODEM_LIB=y
# Align the max FD entry to NRF_MODEM_MAX_SOCKET_COUNT(8)
CONFIG_POSIX_MAX_FDS=8
# Enable below for modem trace
#CONFIG_NRF_MODEM_LIB_TRACE_ENABLED=y

# Use GPIO
CONFIG_GPIO=y
CONFIG_GPIO_NRFX=y

# UART interface
CONFIG_SERIAL=y
CONFIG_UART_ASYNC_API=y
CONFIG_NRFX_TIMER2=y

# Stacks and heaps
CONFIG_MAIN_STACK_SIZE=4096
CONFIG_HEAP_MEM_POOL_SIZE=16384
CONFIG_SYSTEM_WORKQUEUE_STACK_SIZE=4096

# Device power management
CONFIG_PM_DEVICE=y

# FOTA
CONFIG_HTTP_PARSER_URL=y
CONFIG_FOTA_DOWNLOAD=y
CONFIG_FOTA_DOWNLOAD_PROGRESS_EVT=y
CONFIG_DFU_TARGET=y
CONFIG_DOWNLOAD_CLIENT=y
CONFIG_DOWNLOAD_CLIENT_STACK_SIZE=4096
CONFIG_BOOTLOADER_MCUBOOT=y
CONFIG_IMG_MANAGER=y

# FLASH
CONFIG_FLASH=y
CONFIG_FLASH_PAGE_LAYOUT=y
CONFIG_FLASH_MAP=y
CONFIG_MPU_ALLOW_FLASH_WRITE=y
CONFIG_IMG_ERASE_PROGRESSIVELY=y

# Settings
CONFIG_SETTINGS=y
CONFIG_SETTINGS_FCB=y
CONFIG_FCB=y

# nRF Cloud
CONFIG_CLOUD_API=y
CONFIG_NRF_CLOUD_MQTT=y
CONFIG_NRF_CLOUD_FOTA=n
CONFIG_NRF_CLOUD_AGPS=y
CONFIG_NRF_CLOUD_PGPS=y
CONFIG_NRF_CLOUD_CELL_POS=y
CONFIG_NRF_CLOUD_LOG_LEVEL_INF=y
CONFIG_DATE_TIME=y
CONFIG_MODEM_INFO=y
CONFIG_MODEM_INFO_ADD_DATE_TIME=n
CONFIG_AT_MONITOR=y
CONFIG_MODEM_JWT=y
# Use "nrf-<IMEI>" as the default device_id format
# Use "<device_uuid>" as the device_id format by below
#CONFIG_NRF_CLOUD_CLIENT_ID_SRC_INTERNAL_UUID=y

#
# SLM-specific configurations
#
CONFIG_SLM_CUSTOMIZED=n
CONFIG_SLM_LOG_LEVEL_INF=y
CONFIG_SLM_EXTERNAL_XTAL=n
CONFIG_SLM_START_SLEEP=n
#\nUse\nUART_0\n(when\nworking\nwith\nPC\nterminal)
CONFIG_UART_0_NRF_HW_ASYNC_TIMER=2
#\nUse\nUART_2\n(when\nworking\nwith\nexternal\nMCU)
#CONFIG_SLM_CONNECT_UART_2=y
#CONFIG_UART_2_NRF_HW_ASYNC_TIMER=2
#\nnRF\nCloud\nbased\nlocation\nservices
CONFIG_SLM_AGPS=y
CONFIG_SLM_PGPS=y
CONFIG_SLM_CELL_POS=y
#CONFIG_SLM_LOG_LEVEL_DBG=y

[justin]

I see two CLOUD_EVT_CONNECTING events, but no CLOUD_EVT_CONNECTED event. 

In the file slm_at_gnss.c, could you add a value to the log message:

case CLOUD_EVT_CONNECTING:
		LOG_DBG("CLOUD_EVT_CONNECTING: status %d", evt->data.err);

The value in evt->data.err is of type enum cloud_connect_result. 

Setting CONFIG_NRF_CLOUD_LOG_LEVEL_DBG=y might be helpful too.

[Stas Jis]

justin,
I added to the code what you asked for, I am attaching the result:

[00:01:05.608,154] [0m<dbg> slm_gnss.cloud_event_handler: CLOUD_EVT_CONNECTING: status -9

2022-04-04T06:39:16.705Z DEBUG modem << Ready
2022-04-04T06:39:16.718Z DEBUG modem << [00:00:00.221,405] [0m<inf> slm: Serial LTE Modem[0m
2022-04-04T06:39:16.760Z DEBUG modem << [00:00:00.228,424] [0m<dbg> slm_at_host.slm_at_host_init: UART baud: 115200 d/p/s-bits: 3/0/1 HWFC: 1[0m
2022-04-04T06:39:16.766Z DEBUG modem << [00:00:00.228,424] [0m<dbg> slm_at_host.slm_uart_configure: Set uart baudrate to: 115200, hw flow control 1[0m
2022-04-04T06:39:16.768Z DEBUG modem << [00:00:00.244,903] [0m<dbg> nrf_cloud_transport.nct_client_id_set: client_id = nrf-352656108600480[0m
2022-04-04T06:39:16.781Z DEBUG modem << [00:00:00.245,605] [0m<dbg> nrf_cloud_transport.nct_topics_populate: accepted_topic: nrf-352656108600480/shadow/get/accepted[0m
2022-04-04T06:39:16.795Z DEBUG modem << [00:00:00.245,635] [0m<dbg> nrf_cloud_transport.nct_topics_populate: rejected_topic: $aws/things/nrf-352656108600480/shadow/get/re~[0m
2022-04-04T06:39:16.812Z DEBUG modem << [00:00:00.245,635] [0m<dbg> nrf_cloud_transport.nct_topics_populate: update_delta_topic: $aws/things/nrf-352656108600480/shadow/update~[0m
2022-04-04T06:39:16.822Z DEBUG modem << [00:00:00.245,697] [0m<dbg> nrf_cloud_transport.nct_topics_populate: update_topic: <log_strdup alloc failed>[0m
2022-04-04T06:39:16.837Z DEBUG modem << [00:00:00.245,697] [0m<dbg> nrf_cloud_transport.nct_topics_populate: shadow_get_topic: <log_strdup alloc failed>[0m
2022-04-04T06:39:16.848Z DEBUG modem << [00:00:00.245,727] [0m<dbg> nrf_cloud.nfsm_set_current_state_and_notify: state: 1[0m
2022-04-04T06:39:16.853Z DEBUG modem << [00:00:00.245,849] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:16.868Z DEBUG modem <<                                       52 65 61 64 79 0d 0a                             |Ready..          [0m
2022-04-04T06:39:16.879Z DEBUG modem << [00:00:00.245,941] [0m<dbg> slm_fota.slm_fota_post_process: FOTA result 0,0,0[0m
2022-04-04T06:39:16.885Z DEBUG modem << [00:00:00.252,777] [0m<inf> slm_at_host: at_host init done[0m
2022-04-04T06:39:18.987Z DEBUG modem >> AT
2022-04-04T06:39:18.998Z DEBUG modem << OK
2022-04-04T06:39:19.996Z DEBUG modem << [00:00:02.531,982] [0m<dbg> slm_at_host: RX
2022-04-04T06:39:20.009Z DEBUG modem <<                                       41 54                                            |AT               [0m
2022-04-04T06:39:20.015Z DEBUG modem << [00:00:02.538,604] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:20.032Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:39:20.035Z DEBUG modem << [00:00:02.538,635] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:20.050Z DEBUG modem <<                                       4f 4b 0d 0a                                      |OK..             [0m
2022-04-04T06:39:21.371Z DEBUG modem >> AT+CFUN?
2022-04-04T06:39:21.382Z DEBUG modem << +CFUN: 0
2022-04-04T06:39:21.394Z DEBUG modem << OK
2022-04-04T06:39:22.379Z DEBUG modem << [00:00:04.915,802] [0m<dbg> slm_at_host: RX
2022-04-04T06:39:22.395Z DEBUG modem <<                                       41 54 2b 43 46 55 4e 3f                          |AT+CFUN?         [0m
2022-04-04T06:39:22.402Z DEBUG modem << [00:00:04.916,290] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:39:22.408Z DEBUG modem << [00:00:04.922,424] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:22.422Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:39:22.429Z DEBUG modem << [00:00:04.922,454] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:22.441Z DEBUG modem <<                                       2b 43 46 55 4e 3a 20 30  0d 0a 4f 4b 0d 0a       |+CFUN: 0 ..OK..  [0m
2022-04-04T06:39:30.548Z DEBUG modem >> AT%XSYSTEMMODE=1,0,1,0
2022-04-04T06:39:30.563Z DEBUG modem << OK
2022-04-04T06:39:31.558Z DEBUG modem << [00:00:14.095,367] [0m<dbg> slm_at_host: RX
2022-04-04T06:39:31.572Z DEBUG modem <<                                       41 54 25 58 53 59 53 54  45 4d 4d 4f 44 45 3d 31 |AT%XSYST EMMODE=1
2022-04-04T06:39:31.585Z DEBUG modem <<                                       2c 30 2c 31 2c 30                                |,0,1,0           [0m
2022-04-04T06:39:31.594Z DEBUG modem << [00:00:14.095,855] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:39:31.600Z DEBUG modem << [00:00:14.103,424] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:31.613Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:39:31.619Z DEBUG modem << [00:00:14.103,454] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:31.632Z DEBUG modem <<                                       4f 4b 0d 0a                                      |OK..             [0m
2022-04-04T06:39:36.251Z DEBUG modem >> AT%XMAGPIO=1,0,0,1,1,1574,1577
2022-04-04T06:39:36.264Z DEBUG modem << OK
2022-04-04T06:39:37.263Z DEBUG modem << [00:00:19.799,560] [0m<dbg> slm_at_host: RX
2022-04-04T06:39:37.279Z DEBUG modem <<                                       41 54 25 58 4d 41 47 50  49 4f 3d 31 2c 30 2c 30 |AT%XMAGP IO=1,0,0
2022-04-04T06:39:37.289Z DEBUG modem <<                                       2c 31 2c 31 2c 31 35 37  34 2c 31 35 37 37       |,1,1,157 4,1577  [0m
2022-04-04T06:39:37.303Z DEBUG modem << [00:00:19.800,048] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:39:37.306Z DEBUG modem << [00:00:19.806,396] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:37.322Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:39:37.327Z DEBUG modem << [00:00:19.806,457] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:37.342Z DEBUG modem <<                                       4f 4b 0d 0a                                      |OK..             [0m
2022-04-04T06:39:42.266Z DEBUG modem >> AT%XCOEX0
2022-04-04T06:39:42.278Z DEBUG modem << OK
2022-04-04T06:39:43.276Z DEBUG modem << [00:00:25.813,812] [0m<dbg> slm_at_host: RX
2022-04-04T06:39:43.290Z DEBUG modem <<                                       41 54 25 58 43 4f 45 58  30                      |AT%XCOEX 0       [0m
2022-04-04T06:39:43.298Z DEBUG modem << [00:00:25.814,300] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:39:43.308Z DEBUG modem << [00:00:25.820,495] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:43.323Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:39:43.327Z DEBUG modem << [00:00:25.820,526] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:43.339Z DEBUG modem <<                                       4f 4b 0d 0a                                      |OK..             [0m
2022-04-04T06:39:47.394Z DEBUG modem >> AT+CEREG=5
2022-04-04T06:39:47.407Z DEBUG modem << OK
2022-04-04T06:39:48.404Z DEBUG modem << [00:00:30.940,826] [0m<dbg> slm_at_host: RX
2022-04-04T06:39:48.417Z DEBUG modem <<                                       41 54 2b 43 45 52 45 47  3d 35                   |AT+CEREG =5      [0m
2022-04-04T06:39:48.427Z DEBUG modem << [00:00:30.941,314] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:39:48.433Z DEBUG modem << [00:00:30.947,448] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:48.445Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:39:48.450Z DEBUG modem << [00:00:30.947,479] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:48.464Z DEBUG modem <<                                       4f 4b 0d 0a                                      |OK..             [0m
2022-04-04T06:39:52.619Z DEBUG modem >> AT+CPSMS=1
2022-04-04T06:39:52.630Z DEBUG modem << OK
2022-04-04T06:39:53.629Z DEBUG modem << [00:00:36.166,290] [0m<dbg> slm_at_host: RX
2022-04-04T06:39:53.642Z DEBUG modem <<                                       41 54 2b 43 50 53 4d 53  3d 31                   |AT+CPSMS =1      [0m
2022-04-04T06:39:53.650Z DEBUG modem << [00:00:36.166,778] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:39:53.657Z DEBUG modem << [00:00:36.172,943] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:53.670Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:39:53.675Z DEBUG modem << [00:00:36.172,973] [0m<dbg> slm_at_host: TX
2022-04-04T06:39:53.689Z DEBUG modem <<                                       4f 4b 0d 0a                                      |OK..             [0m
2022-04-04T06:40:01.476Z DEBUG modem >> AT+CFUN=1
2022-04-04T06:40:01.526Z DEBUG modem << OK
2022-04-04T06:40:02.491Z DEBUG modem << [00:00:45.028,747] [0m<dbg> slm_at_host: RX
2022-04-04T06:40:02.506Z DEBUG modem <<                                       41 54 2b 43 46 55 4e 3d  31                      |AT+CFUN= 1       [0m
2022-04-04T06:40:02.513Z DEBUG modem << [00:00:45.029,235] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:40:02.519Z DEBUG modem << [00:00:45.068,969] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:02.533Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:40:02.543Z DEBUG modem << [00:00:45.069,000] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:02.553Z DEBUG modem <<                                       4f 4b 0d 0a                                      |OK..             [0m
2022-04-04T06:40:02.893Z DEBUG modem << +CEREG: 2,"026F","00332521",7
2022-04-04T06:40:03.896Z DEBUG modem << [00:00:46.433,746] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:03.909Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:40:03.915Z DEBUG modem << [00:00:46.433,807] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:03.928Z DEBUG modem <<                                       2b 43 45 52 45 47 3a 20  32 2c 22 30 32 36 46 22 |+CEREG:  2,"026F"
2022-04-04T06:40:03.942Z DEBUG modem <<                                       2c 22 30 30 33 33 32 35  32 31 22 2c 37 0d 0a    |,"003325 21",7.. [0m
2022-04-04T06:40:04.591Z DEBUG modem << +CEREG: 5,"026F","00332521",7,,,"00011110","11100000"
2022-04-04T06:40:05.592Z DEBUG modem << [00:00:48.129,974] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:05.606Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:40:05.615Z DEBUG modem << [00:00:48.130,065] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:05.631Z DEBUG modem <<                                       2b 43 45 52 45 47 3a 20  35 2c 22 30 32 36 46 22 |+CEREG:  5,"026F"
2022-04-04T06:40:05.638Z DEBUG modem <<                                       2c 22 30 30 33 33 32 35  32 31 22 2c 37 2c 2c 2c |,"003325 21",7,,,
2022-04-04T06:40:05.664Z DEBUG modem <<                                       22 30 30 30 31 31 31 31  30 22 2c 22 31 31 31 30 |"0001111 0","1110                                      30 30 30 30 22 0d 0a                             |0000"..          [0m
2022-04-04T06:40:15.924Z DEBUG modem >> AT#XNRFCLOUD=1
2022-04-04T06:40:15.928Z DEBUG modem << OK
2022-04-04T06:40:16.933Z DEBUG modem << [00:00:59.471,496] [0m<dbg> slm_at_host: RX
2022-04-04T06:40:16.947Z DEBUG modem <<                                       41 54 23 58 4e 52 46 43  4c 4f 55 44 3d 31       |AT#XNRFC LOUD=1  [0m
2022-04-04T06:40:16.955Z DEBUG modem << [00:00:59.471,984] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:40:16.962Z DEBUG modem << [00:00:59.472,015] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:16.975Z DEBUG modem <<                                       0d 0a 4f 4b 0d 0a                                |..OK..           [0m
2022-04-04T06:40:16.988Z DEBUG modem << [00:00:59.472,137] [0m<dbg> nrf_cloud.nfsm_set_current_state_and_notify: state: 1[0m
2022-04-04T06:40:16.999Z DEBUG modem << [00:00:59.472,137] [0m<dbg> nrf_cloud.api_event_handler: NRF_CLOUD_EVT_TRANSPORT_CONNECTING[0m
2022-04-04T06:40:17.008Z DEBUG modem << [00:00:59.472,137] [0m<dbg> slm_gnss.cloud_event_handler: CLOUD_EVT_CONNECTING: status 0[0m
2022-04-04T06:40:17.021Z DEBUG modem << [00:00:59.927,124] [0m<dbg> nrf_cloud_transport.nct_connect: IPv4 address: 35.172.62.107[0m
2022-04-04T06:40:17.033Z DEBUG modem << [00:00:59.927,124] [0m<dbg> nrf_cloud_transport.nct_mqtt_connect: MQTT clean session flag: 1[0m
2022-04-04T06:40:23.075Z DEBUG modem << [00:01:05.608,123] [0m<dbg> nrf_cloud_transport.nct_mqtt_connect: mqtt_connect failed -111[0m
2022-04-04T06:40:23.086Z DEBUG modem << [00:01:05.608,154] [0m<dbg> nrf_cloud.nfsm_set_current_state_and_notify: state: 1[0m
2022-04-04T06:40:23.100Z DEBUG modem << [00:01:05.608,154] [0m<dbg> nrf_cloud.api_event_handler: NRF_CLOUD_EVT_TRANSPORT_CONNECTING[0m
2022-04-04T06:40:23.116Z DEBUG modem << [00:01:05.608,154] [0m<dbg> slm_gnss.cloud_event_handler: CLOUD_EVT_CONNECTING: status -9[0m
2022-04-04T06:40:28.614Z DEBUG modem << +CEREG: 5,"026F","00332520",7,,,"00011110","11100000"
2022-04-04T06:40:29.615Z DEBUG modem << [00:01:12.154,388] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:29.628Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:40:29.636Z DEBUG modem << [00:01:12.154,449] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:29.654Z DEBUG modem <<                                       2b 43 45 52 45 47 3a 20  35 2c 22 30 32 36 46 22 |+CEREG:  5,"026F"
2022-04-04T06:40:29.661Z DEBUG modem <<                                       2c 22 30 30 33 33 32 35  32 30 22 2c 37 2c 2c 2c |,"003325 20",7,,,
2022-04-04T06:40:29.687Z DEBUG modem <<                                       22 30 30 30 31 31 31 31  30 22 2c 22 31 31 31 30 |"0001111 0","1110                                      30 30 30 30 22 0d 0a                             |0000"..          [0m
2022-04-04T06:40:34.628Z DEBUG modem >> AT#XNRFCLOUD?
2022-04-04T06:40:34.639Z DEBUG modem << #XNRFCLOUD: 0,0,16842753,"nrf-352656108600480"
2022-04-04T06:40:34.640Z DEBUG modem << OK
2022-04-04T06:40:35.637Z DEBUG modem << [00:01:18.176,116] [0m<dbg> slm_at_host: RX
2022-04-04T06:40:35.650Z DEBUG modem <<                                       41 54 23 58 4e 52 46 43  4c 4f 55 44 3f          |AT#XNRFC LOUD?   [0m
2022-04-04T06:40:35.659Z DEBUG modem << [00:01:18.176,605] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:40:35.665Z DEBUG modem << [00:01:18.176,727] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:35.678Z DEBUG modem <<                                       0d 0a 23 58 4e 52 46 43  4c 4f 55 44 3a 20 30 2c |..#XNRFC LOUD: 0,
2022-04-04T06:40:35.704Z DEBUG modem <<                                       30 2c 31 36 38 34 32 37  35 33 2c 22 6e 72 66 2d |0,168427 53,"nrf-                                      33 35 32 36 35 36 31 30  38 36 30 30 34 38 30 22 |35265610 8600480"
2022-04-04T06:40:35.717Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:40:35.724Z DEBUG modem << [00:01:18.176,757] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:35.740Z DEBUG modem <<                                       0d 0a 4f 4b 0d 0a                                |..OK..           [0m
2022-04-04T06:40:40.603Z DEBUG modem >> AT#XAGPS=1,1
2022-04-04T06:40:40.612Z DEBUG modem << ERROR
2022-04-04T06:40:40.613Z ERROR Error: AT#XAGPS=1,1
 failed
2022-04-04T06:40:41.612Z DEBUG modem << [00:01:24.151,947] [0m<dbg> slm_at_host: RX
2022-04-04T06:40:41.628Z DEBUG modem <<                                       41 54 23 58 41 47 50 53  3d 31 2c 31             |AT#XAGPS =1,1    [0m
2022-04-04T06:40:41.634Z DEBUG modem << [00:01:24.152,435] [0m<dbg> slm_at_host.uart_callback: RX_DISABLED[0m
2022-04-04T06:40:41.640Z DEBUG modem << [00:01:24.152,465] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:41.654Z DEBUG modem <<                                       0d 0a 45 52 52 4f 52 0d  0a                      |..ERROR. .       [0m
2022-04-04T06:40:42.416Z DEBUG modem << +CEREG: 5,"026F","00332521",7,,,"00011110","11100000"
2022-04-04T06:40:43.416Z DEBUG modem << [00:01:25.956,268] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:43.437Z DEBUG modem <<                                       0d 0a                                            |..               [0m
2022-04-04T06:40:43.439Z DEBUG modem << [00:01:25.956,329] [0m<dbg> slm_at_host: TX
2022-04-04T06:40:43.456Z DEBUG modem <<                                       2b 43 45 52 45 47 3a 20  35 2c 22 30 32 36 46 22 |+CEREG:  5,"026F"
2022-04-04T06:40:43.474Z DEBUG modem <<                                       2c 22 30 30 33 33 32 35  32 31 22 2c 37 2c 2c 2c |,"003325 21",7,,,
2022-04-04T06:40:43.489Z DEBUG modem <<                                       22 30 30 30 31 31 31 31  30 22 2c 22 31 31 31 30 |"0001111 0","1110                                      30 30 30 30 22 0d 0a                             |0000"..          [0m

[justin]

Great, thanks!

nrf_cloud_transport.nct_mqtt_connect: mqtt_connect failed -111
nrf_cloud.nfsm_set_current_state_and_notify: state: 1
nrf_cloud.api_event_handler: NRF_CLOUD_EVT_TRANSPORT_CONNECTING
slm_gnss.cloud_event_handler: CLOUD_EVT_CONNECTING: status -9

mqtt_connect returned a ECONNREFUSED error.
This usually indicates an issue with the device credentials.
Have you changed or deleted the credentials in the modem sec_tag 16842753?
To list the installed credentials, can use the AT command: AT%CMNG=1

you should see:

%CMNG: 16842753,0,"0000000000000000000000000000000000000000000000000000000000000000"

%CMNG: 16842753,1,"0101010101010101010101010101010101010101010101010101010101010101"

%CMNG: 16842753,2,"0202020202020202020202020202020202020202020202020202020202020202"

I believe at this point your options are:

1. Delete your device from your nRF Cloud account and then re-provision it to ensure the credentials are correct.  See https://docs.nrfcloud.com/Reference/DeviceManagement/Provisioning.  I assume you used the JITP method since this is a DK. You can re-download new JITP certs from nRF Cloud or you can create your own and use the pre-connect provisioning method.
https://docs.nrfcloud.com/Guides/GettingStarted/Devices

2. If you are confident your credentials are correct: capture modem traces and inspect via wireshark to see why the MQTT connection fails.  
https://infocenter.nordicsemi.com/index.jsp?topic=%2Fug_trace_collector%2FUG%2Ftrace_collector%2Fintro.html