Help with serial DFU; "Failed to send data over serial interface!"

RE: Help with serial DFU; "Failed to send data over serial interface!"

bjorn-spockeli — Tue, 27 Aug 2019 14:18:57 GMT

HI nkrinsky,

I apologize for the late reply, I was on vacation the past week.

Ok, so it the following part that's not happening on the custom board.

in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ERROR, Error detected.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDRX, Receive buffer is filled up.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_RXTO, Receiver timeout.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDTX, Last TX byte transmitted.
Last TX byte transmitted.
in function nrf_uarte_event_clear
in function nrf_uarte_tx_amount_get
in nrfx_uarte tx_done_event

[quote user="nkrinsky"]They're the same until the end, where the DK has a NRF_UARTE_EVENT_ENDRX and then a NRF_UARTE_EVENT_ENDTX event, and the custom board does not. Where in the code do serial messages actually get sent? It seems the custom board is not entering that part.[/quote]

It should be nrfx_uarte_tx() in nrfx_uarte.c, which set the tx buffer using nrf_uarte_tx_buffer_set() and then triggers the NRF_UARTE_TASK_STARTTX task using nrf_uarte_task_trigger().

Do you have a way of checking that there is data on the UART lines of the custom board after the last nrfx_uarte_tx call that returns NRF_SUCCESS? i.e. a logic analyzer or an oscilloscope?

Best regards

Bjørn

RE: Help with serial DFU; "Failed to send data over serial interface!"

nkrinsky — Wed, 14 Aug 2019 22:15:22 GMT

Here's what's going on on the custom board:

Enter main loop
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ERROR, Error detected.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDRX, Receive buffer is filled up.
Receive buffer is filled up
in function nrf_uarte_event_clear
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_event_clear
in function nrf_uarte_event_clear
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
task = NRF_UARTE_TASK_STARTRX
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_RXTO, Receiver timeout.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDTX, Last TX byte transmitted.
reached end of uarte_irq_handler
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ERROR, Error detected.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDRX, Receive buffer is filled up.
Receive buffer is filled up
in function nrf_uarte_event_clear
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_event_clear
in function nrf_uarte_event_clear
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
task = NRF_UARTE_TASK_STARTRX
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_RXTO, Receiver timeout.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDTX, Last TX byte transmitted.
reached end of uarte_irq_handler
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ERROR, Error detected.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDRX, Receive buffer is filled up.
Receive buffer is filled up
in function nrf_uarte_event_clear
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_event_clear
in function nrf_uarte_event_clear
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
task = NRF_UARTE_TASK_STARTRX
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_dfu_serial_on_packet_received
Received ping 1
in function payload_free
in function nrf_dfu_req_handler_on_req
end of nrf_dfu_req_handler_on_req
Allocated buffer 20001764
in function nrf_uarte_event_check
NRF_UARTE_EVENT_RXTO, Receiver timeout.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDTX, Last TX byte transmitted.
reached end of uarte_irq_handler
in function nrf_dfu_req_handler_req
in function nrf_dfu_req_handler_req_process
Handle NRF_DFU_OP_PING
Request handling complete. Result: 0x1.
in function dfu_req_handler_rsp_clbk
p_res->requestion != NRF_DFU_OP_OBJECT_WRITE
in function response send
Sending Response: [0x9, 0x1]
p_response->result == NRF_DFU_RES_CODE_SUCCESS
p_response->request = NRF_DFU_OP_PING
in function rsp_send
in nrf_drv_uart_tx
NRF_DRV_UART_USE_UARTE==true
in nrfx_uarte_tx
Transfer tx_len: 5.
Tx data:
60 9 1 1 C0 
in function nrf_uarte_event_clear
in function nrf_uarte_event_clear
in nrf_uarte_tx_buffer_set
in nrf_uarte_task_trigger
task = NRF_UARTE_TASK_STARTTX
Function: nrfx_uarte_tx, error code: NRF_SUCCESS.

And on the DK:

Enter main loop
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ERROR, Error detected.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDRX, Receive buffer is filled up.
Receive buffer is filled up
in function nrf_uarte_event_clear
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_event_clear
in function nrf_uarte_event_clear
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
task = NRF_UARTE_TASK_STARTRX
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_RXTO, Receiver timeout.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDTX, Last TX byte transmitted.
reached end of uarte_irq_handler
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ERROR, Error detected.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDRX, Receive buffer is filled up.
Receive buffer is filled up
in function nrf_uarte_event_clear
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_event_clear
in function nrf_uarte_event_clear
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
task = NRF_UARTE_TASK_STARTRX
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_RXTO, Receiver timeout.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDTX, Last TX byte transmitted.
reached end of uarte_irq_handler
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ERROR, Error detected.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDRX, Receive buffer is filled up.
Receive buffer is filled up
in function nrf_uarte_event_clear
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_event_clear
in function nrf_uarte_event_clear
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
task = NRF_UARTE_TASK_STARTRX
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_dfu_serial_on_packet_received
Received ping 1
in function payload_free
in function nrf_dfu_req_handler_on_req
end of nrf_dfu_req_handler_on_req
Allocated buffer 20001764
in function nrf_uarte_event_check
NRF_UARTE_EVENT_RXTO, Receiver timeout.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDTX, Last TX byte transmitted.
reached end of uarte_irq_handler
in function nrf_dfu_req_handler_req
in function nrf_dfu_req_handler_req_process
Handle NRF_DFU_OP_PING
Request handling complete. Result: 0x1.
in function dfu_req_handler_rsp_clbk
p_res->requestion != NRF_DFU_OP_OBJECT_WRITE
in function response send
Sending Response: [0x9, 0x1]
p_response->result == NRF_DFU_RES_CODE_SUCCESS
p_response->request = NRF_DFU_OP_PING
in function rsp_send
in nrf_drv_uart_tx
NRF_DRV_UART_USE_UARTE==true
in nrfx_uarte_tx
Transfer tx_len: 5.
Tx data:
60 9 1 1 C0 
in function nrf_uarte_event_clear
in function nrf_uarte_event_clear
in nrf_uarte_tx_buffer_set
in nrf_uarte_task_trigger
task = NRF_UARTE_TASK_STARTTX
Function: nrfx_uarte_tx, error code: NRF_SUCCESS.
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ERROR, Error detected.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDRX, Receive buffer is filled up.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_RXTO, Receiver timeout.
in function nrf_uarte_event_check
NRF_UARTE_EVENT_ENDTX, Last TX byte transmitted.
Last TX byte transmitted.
in function nrf_uarte_event_clear
in function nrf_uarte_tx_amount_get
in nrfx_uarte tx_done_event

They're the same until the end, where the DK has a NRF_UARTE_EVENT_ENDRX and then a NRF_UARTE_EVENT_ENDTX event, and the custom board does not. Where in the code do serial messages actually get sent? It seems the custom board is not entering that part.

RE: Help with serial DFU; "Failed to send data over serial interface!"

bjorn-spockeli — Mon, 05 Aug 2019 15:20:48 GMT

Hi nkrinsky,

I apologize for not replying sooner.

The nrfx_uarte_0_irq_handler() will be invoked by any of the following events

EVENTS_CTS	0x100	CTS is activated (set low). Clear To Send.
EVENTS_NCTS	0x104	CTS is deactivated (set high). Not Clear To Send.
EVENTS_RXDRDY	0x108	Data received in RXD (but potentially not yet transferred to Data RAM)
EVENTS_ENDRX	0x110	Receive buffer is filled up
EVENTS_TXDRDY	0x11C	Data sent from TXD
EVENTS_ENDTX	0x120	Last TX byte transmitted
EVENTS_ERROR	0x124	Error detected
EVENTS_RXTO	0x144	Receiver timeout
EVENTS_RXSTARTED	0x14C	UART receiver has started
EVENTS_TXSTARTED	0x150	UART transmitter has started
EVENTS_TXSTOPPED	0x158	Transmitter stopped

Its hard to say whats going on without knowing which events that are triggering the nrfx_uarte_0_irq_handler on the DK, but not the custom board. Do you think you could print the type of event in addition to "in function nrf_uarte_event_check" - It would also be useful if you could do a logic trace of the UART pins,just to verify that there nothing going on HW wise.

Best regards

Bjørn

RE: Help with serial DFU; "Failed to send data over serial interface!"

nkrinsky — Wed, 31 Jul 2019 20:54:58 GMT

UPDATE: In addition to the nRF52832 on the custom board, I also have a BMD-301 evaluation kit which I have flashed with the same bootloader and SoftDevice with a Mac. I noticed that nrfutil starts with an initial ping that contains the hex values 9 1 and 192 so I've been manually sending those bytes to both nRF devices to see how they respond. After cleaning up my debugging statements this is what I get on the custom board:

Enter main loop
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
in function nrf_uarte_event_check
Receive buffer is filled up
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_uarte_event_check
in function nrf_uarte_event_check
reached end of uarte_irq_handler
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
in function nrf_uarte_event_check
Receive buffer is filled up
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_uarte_event_check
in function nrf_uarte_event_check
reached end of uarte_irq_handler
in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
in function nrf_uarte_event_check
Receive buffer is filled up
in function nrf_uarte_rx_amount_get
secondary buffer == 0
in nrfx_uarte rx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_RX_DONE
in functino on_rx_complete
in nrfx_uarte_rx
in function nrf_uarte_int_disable
Transfer rx_len: 1.
in function nrf_uarte_rx_buffer_set
in nrf_uarte_task_trigger
in function nrf_uarte_int_enable
Function: nrfx_uarte_rx, error code: NRF_SUCCESS.
in function nrf_dfu_serial_on_packet_received
Received ping 1
in function payload_free
in function nrf_dfu_req_handler_on_req
end of nrf_dfu_req_handler_on_req
Allocated buffer 20001764
in function nrf_uarte_event_check
in function nrf_uarte_event_check
reached end of uarte_irq_handler
in function nrf_dfu_req_handler_req
in function nrf_dfu_req_handler_req_process
Handle NRF_DFU_OP_PING
Request handling complete. Result: 0x1.
in function dfu_req_handler_rsp_clbk
p_res->requestion != NRF_DFU_OP_OBJECT_WRITE
in function response send
Sending Response: [0x9, 0x1]
p_response->result == NRF_DFU_RES_CODE_SUCCESS
in function rsp_send
in nrf_drv_uart_tx
NRF_DRV_UART_USE_UARTE==true
in nrfx_uarte_tx
Transfer tx_len: 5.
Tx data:
60 9 1 1 C0 
in nrf_uarte_tx_buffer_set
in nrf_uarte_task_trigger
Function: nrfx_uarte_tx, error code: NRF_SUCCESS.

On the evaluation board it is exactly the same except these additional statements are printed at the end:

in nrfx_uarte_0_irq_handler
in nrfx_uarte uarte_irq_handler
in function nrf_uarte_event_check
in function nrf_uarte_event_check
in function nrf_uarte_event_check
in function nrf_uarte_event_check
Last TX byte transmitted.
in function nrf_uarte_tx_amount_get
in nrfx_uarte tx_done_event
in nrf_drv_uart uarte_evt_handler
in function uart_event_handler
event type = NRF_DRV_UART_EVT_TX_DONE
reached end of uarte_irq_handler

For whatever reason my custom board isn't triggering nrfx_uarte_0_irq_handler that final time when the Last TX byte transmitted event occurs. What exactly triggers nrfx_uarte_0_irq_handler? Why would the same exact code result in this difference?

RE: Help with serial DFU; "Failed to send data over serial interface!"

nkrinsky — Wed, 31 Jul 2019 18:59:10 GMT

Yes we are using P0.05 to P0.08. It would be inconvenient to change the pins but I could do that as a last resort. I do want to clarify and say that this exact hardware setup has been used to produce a serial UART connection between the devices in the past with a different project, so I don't think the pins are the problem.

RE: Help with serial DFU; "Failed to send data over serial interface!"

bjorn-spockeli — Wed, 31 Jul 2019 15:05:28 GMT

Oh sorry, didnt think when I asked the question. Yes, nRFutil enables it by default.

Which pins on the nRF52 DK are you using? P0.05 through to P0.08? If that is the case, then try to change the pins to some pins that are not connected to the interface MCU, e.g. P0.22 through to P0.25.

Bjørn

RE: Help with serial DFU; "Failed to send data over serial interface!"

nkrinsky — Wed, 31 Jul 2019 14:22:12 GMT

It's not enabled by pyserial by default, I mean when nrfutil runs and executes dfu_transport_serial.py it creates a serial connection with rtscts flow control enabled (see lines 151 and 199 in https://github.com/NordicSemiconductor/pc-nrfutil/blob/master/nordicsemi/dfu/dfu_transport_serial.py)

RE: Help with serial DFU; "Failed to send data over serial interface!"

bjorn-spockeli — Wed, 31 Jul 2019 14:09:08 GMT

Is it enabled by default? It kinda looks like its not, when looking at the __init__ function here https://pyserial.readthedocs.io/en/latest/pyserial_api.html

RE: Help with serial DFU; "Failed to send data over serial interface!"

nkrinsky — Wed, 31 Jul 2019 13:42:23 GMT

I have RTS and CTS line and flow control is enabled in the pyserial connection (I think by default).

RE: Help with serial DFU; "Failed to send data over serial interface!"

bjorn-spockeli — Wed, 31 Jul 2019 07:20:30 GMT

OK, the serial UART connection, is it only TX and RX or RTS and CTS lines in addition?

RE: Help with serial DFU; "Failed to send data over serial interface!"

nkrinsky — Tue, 30 Jul 2019 14:56:25 GMT

I'm using nrfutil version 5.2.0. The board is connected to the Linux computer via a serial UART connection. I'm not able to test a serial DFU with any computer but the Linux computer due to our setup.

RE: Help with serial DFU; "Failed to send data over serial interface!"

bjorn-spockeli — Tue, 30 Jul 2019 14:43:24 GMT

How is the custom board connected to the linux computer? Through a USB-TTL cable? If so does this have RTS/CTS lines? Which version of nrfutil are you using on the Linux computer? Are you able to perform a serial DFU from a windows computer?

BEst regards

Bjørn