Send dfu image between two nrf5340

RE: Send dfu image between two nrf5340

Simon — Thu, 06 Oct 2022 08:10:32 GMT

Sounds good.

Let me know if you encounter any issues.

Make sure to test the solution thoroughly before using it in the product, as this is not an official solution.

RE: Send dfu image between two nrf5340

MaximSh — Thu, 06 Oct 2022 06:28:30 GMT

Hi,
Thanks you it is amazing full solution.
From first review it looks like my partition implementation so i think it should work.
I will test it after our Holidays.

RE: Send dfu image between two nrf5340

Simon — Wed, 05 Oct 2022 12:28:59 GMT

[quote user="Hash5422"]Could you assign the other thread to yourself so we can continue the discussion there? [/quote]

I have assigned Perform NRF52840 OTA over the NRF9160 and UART to myself, so let us continue the discussion there.

Best regards,

Simon

RE: Send dfu image between two nrf5340

Simon — Wed, 05 Oct 2022 12:21:47 GMT

enpre

Again, if you're not running NCS/Zephyr on the ESP32 I don't think using my solution will be the best option. Please see my earlier answer continue the discussion in Perform NRF52840 OTA over the NRF9160 and UART.

Actually in this ticket the thread starter is using NCS on both ends of the transfer, and if you don't do it, I think the solution will be a little different. Please create a new case, and inform what SDK you're using on both the ESP32 and the nRF52840, and link to it here, and I will assign it to myself and continue to help you out there.

Best regards,

Simon

RE: Send dfu image between two nrf5340

Hash5422 — Wed, 05 Oct 2022 01:59:49 GMT

Hey Simon! Thanks for all your help. I was taking time to do some reading since I am not super familiar with smp and mcuboot as well. I am moving my 52840 code to NCS so both nrf9160 and nrf52840 are running NCS based code now.

So for the two solutions you proposed, I have follow up questions for you -
1. Using the ncs2.0.0 version of the solution I was trying:

- I can copy the changes to the 14 files that this solution touches in ncs2.0.0. But from what I understand, this is a library implementation of DFU over UART. Seems like it is doing exactly what I am trying to achieve, but I am not sure how to effectively use it in an example or my own code. Is there an example that can help me test these changes or understand how I can use them in my project once I download the image from the server over LTE.
- NCS2.0.0 only supports VSCODE and I use SES as my compiler, can I use the same changes on ncs1.9.1 which continues to support ses ide.

2. Using the solution you provided in this thread:

- You mentioned that I could use this as well, if I manage to receive binary chunks from the cloud instead of reading it from the flash. However, your solution does the image transfer over BLE if I understand correctly. So I would have to find a way to send it over UART as well, correct?

- Could you provide a changelist of changed files so I can make sense of what you're doing in your implementation.

I apologize if I'm missing something obvious here, I am fairly new to this.

I've broken down my task into these steps:

1. Generating the nrf52840 image with the right OTA header
2. Uploading the image to our servers
3. Downloading the image over LTE on the nrf9160
4. Dividing the image into header + fixed size chunks
5. Sending the data over UART
6. Storing the image into FLASH Secondary storage
7. Copying the data over to the Primary Storage
8. Reboot and take new image

Correct me if I am wrong, my understanding is step 5 is implemented here and I could use your code for steps 6,7, 8.

Could you assign the other thread to yourself so we can continue the discussion there?

RE: Send dfu image between two nrf5340

enpre — Mon, 03 Oct 2022 14:45:53 GMT

Hi Simon, I'm in trouble with a new task this week so I'll try it maybe next week.
Meantime very big thanks about it, I think it'll be a great start point to implement an OTA update as meand Hash5422 needs to do.

RE: Send dfu image between two nrf5340

Simon — Mon, 03 Oct 2022 14:29:01 GMT

The solution is complete now

https://github.com/simon-iversen/ncs_samples/blob/master/central_smp_client_dfu/README.md

If you follow the instructions in the README, you will be able to perform a DFU from one nRF52840DK to another nRF52840DK over Bluetooth using NCS v2.0.0.

Let me know if you're not able to get it to work with nRF5340DK's

Best regards,

Simon

RE: Send dfu image between two nrf5340

Simon — Thu, 29 Sep 2022 12:39:18 GMT

I tested it on NCS v2.0.0.

Yesterday I was able to receive and parse the image list response, which is required to run in order to get the image hash. I have not implemented it yet, but now it should be straigth forward to test/confirm the image from the app. What is needed to do next is to run the image list command after doing the update, then store the hash of the newly updated image, confirm/test the new update using the stored hash and eventually reset it using the reset command.

After doing this + cleaning up the sample, the solution is complete

Feel free to create a pull request on https://github.com/simon-iversen/ncs_samples/tree/master/central_smp_client_dfu

RE: Send dfu image between two nrf5340

MaximSh — Thu, 29 Sep 2022 11:59:16 GMT

Hi,
Thanks.
Did you test it on sdk 1.9.1?

RE: Send dfu image between two nrf5340

Simon — Thu, 29 Sep 2022 10:52:32 GMT

Okay, so let me try to clarify:

Hash5422

If I understand it correctly, you want to perform a DFU update in the following manner: Cloud/server-->LTE-->9160 (NCS)-->UART-->52840 (nRF5 SDK).

It may be a good idea to port the 52840 to NCS, especially if it's a new design. If you do port to NCS, then you could look at this pull request https://github.com/nrfconnect/sdk-nrf/pull/8839 (a customer updated the solution you've been looking to NCS v2.0.0). I think my (almost complete) solution should work fine as well (if 52840 runs NCS), you just need to modify it to get the binary chunks from the library that receives the binary from the cloud, instead of reading it from flash. If you're not planning to go for my solution, please continue the discussion in this thread: Perform NRF52840 OTA over the NRF9160 and UART, since it's nice to keep the thread clean and on-topic. I have worked some with this, so I could probably re-assign the ticket to me and give more inputs

enpre

Is this what you're trying to achieve? Cloud/server-->WiFi-->ESP32 (SDK?)-->UART-->52840 (SDK?)

What SDK are you using on the ESP32? What SDK are you running on the 52840? If both are running NCS/Zephyr you could use my solution, and continue the discussion in this thread.

If the esp32 is running some other SDK and the 52840 is running NCS, I think it is easier to just skip the SMP protocol (which the solution in this thread uses) and send the binary image as raw bytes. Check out this ticket for more information, it is the opposite of your solution but should still be relevant since it explains how to send the image as raw bytes and what to do on the 9160 once the update is received (the same should be done on the 52840 if NCS is used). However, if you have more questions regarding this, please continue the discussion in Perform NRF52840 OTA over the NRF9160 and UART. I have worked some with this, so I could probably re-assign the ticket to me and give more inputs

If the esp32 is running some other SDK and the 52840 is running nRF5SDK, I will not be of much help, since I have not touched the nRF5 SDK in many years. Then you should probably continue the discussion in Perform NRF52840 OTA over the NRF9160 and UART, or if Håkon is not familiar with the nRF5 SDK either just create a new ticket. Remember to specify in the title that the 52840 is running the nRF5 SDK and the ticket will be assigned to an engineer with knowledge about this.

Best regards,

Simon

RE: Send dfu image between two nrf5340

enpre — Thu, 29 Sep 2022 06:47:07 GMT

Exactly, I have the same task to do as Hash5422
To be honest Simon it's the first time I approach OTA on zephyr ( or generally linux based devices) and so I have to go deep into some topics, as MCUBoot / Images I haven't used before.

When I asked support here I believed that OTA was a common task on a IoT device as Nordic's MCU, but I imagined wrong

So, what I can do, is to go deep into the main concepts and support you if you are doing something on this, I think that help one to each other in this open source world is a great opportunity to make the world better than now.

RE: Send dfu image between two nrf5340

Hash5422 — Wed, 28 Sep 2022 17:35:01 GMT

Hey Simon,

Thank you for putting this together. Like @enpre, I was directed to this thread from another thread.

What Enpre and I are trying to do is download an image for nrf52840 over an LTE/WIFI chip (nrf9160 in my case) and then send it to the BLE chip over UART. I've been trying to follow this link to formulate a solution that works, but there's very little documentation that explains what's going on there.

So my question is - what modifications does your code need to be able to DFU over UART. I use a zephyr ncs code on my nrf9160 and an sdk17 based code on my NRF52840, but I am happy to port to ncs if it makes the OTA solution easier.

Also, thank you so much for helping out with this!

RE: Send dfu image between two nrf5340

Simon — Wed, 28 Sep 2022 09:01:22 GMT

The solution I'm working on is intended for two chips running Zephyr/NCS, is that the case for you enpre?

MaximSh I was just able to successfully perform a dfu update using this central_smp_client_dfu and the smp_svr sample. I have not been able to implement the image list command, which is needed in order to get the hash of the new image, which is used to test and confirm the image.

As a temporary workaround, I modifed the img_mgmt.c library in the following manner:

diff --git a/subsys/mgmt/mcumgr/lib/cmd/img_mgmt/src/img_mgmt.c b/subsys/mgmt/mcumgr/lib/cmd/img_mgmt/src/img_mgmt.c
index 119906204c..e12bb3f0aa 100644
--- a/subsys/mgmt/mcumgr/lib/cmd/img_mgmt/src/img_mgmt.c
+++ b/subsys/mgmt/mcumgr/lib/cmd/img_mgmt/src/img_mgmt.c
@@ -448,6 +448,10 @@ img_mgmt_upload(struct mgmt_ctxt *ctxt)
 #endif
 		/* If this is the last chunk */
 		if (g_img_mgmt_state.off + req.img_data.len == g_img_mgmt_state.size) {
+			rc = boot_set_pending_multi(0, false);
+			if (rc != 0) {
+				return rc;
+			}
 			last = true;
 		}

So on the smp_svr side, it will set the image as pending right after the update is complete. After doing this, after resetting the chip running the smp_svr sample, MCUboot saw the new update in the secondary slot and swapped it into the primary slot.

In order for the update to not revert back, you should call boot_write_img_confirmed() from within the new updated image. Like it's done in the http application update sample

I will continue to work with implementing the image list command.

Best regards,

Simon

RE: Send dfu image between two nrf5340

enpre — Wed, 28 Sep 2022 08:07:24 GMT

Hi Guys, I need to integrate into my project an OTA update.
I have a gateway (nrf52840) connected using UART to an external microcontroller to the cloud, and IoT nodes connected using BLE.

I begin following one thread on devzone, and then the guys talk to me about your dev thread.
I purpose to join together to make a def. guide as in Nordic Doc I always can't find the solutions to my problems 🙂

My idea was to get data from UART (as I connect the nordic to an ESP32 with AT commands for Wifi Connection) and then store them into flash, and after getting the file .hex from uart, restart the micro.

Into the bootloader, pick up data from flash and store to the program memory zone, and after that, restart the micro and that's it.

When the gateway is updated, the next step is to update also IoT node, but in this case, using the BLE and not the UART obviously.

Using STM it's a child's play, using nordic everything seems to be impossible... is it the way you are proceding ?

RE: Send dfu image between two nrf5340

Simon — Mon, 19 Sep 2022 08:12:21 GMT

Now I'm able to parse the incoming image upload CBOR response in the central_smp_client sample. So to complete the image upload command, I just need to repeat the process and send all of image chunks.

RE: Send dfu image between two nrf5340

Simon — Tue, 13 Sep 2022 14:37:13 GMT

Check it out here: https://github.com/simon-iversen/ncs_samples/tree/master/central_smp_client_dfu

The code is really messy and not cleaned up at all. Sorry about that. I'm using nRF52840 DK on both sides by the way, but I don't think that should matter.

Program the central_smp_client_dfu to one nRF5340 DK and the smp_svr sample to another nRF55340 DK (I used 52840 DK)
Put the app_update.bin file into flash address 0xf6000 using jlink commander and loadbin
Then press button 2 on the device running central_smp_client_dfu sample, to send the image upload command.

Then you should receive 0x300c0101bf6272630636f66661820ff in response.

You can see these bytes by adding the following piece of code to C:\v2.0.0\nrf\subsys\bluetooth\services\dfu_smp.c--notify_process()

printk("Received %d amount of bytes\n", length);
printk("Bytes: 0x");
for(int x = 0;x < length; x++){
	printk("%x", ((uint8_t *)data)[x]);
}
printk("\n");

Currently I'm struggling to parse the response in the app itself (using this method). But using cbor.me I'm able to see that the received data corresponds to this:

300c0101bf → ???

627263 → "rc"

0 → 0

636f6666 → "off"

1820 → 32 (unsigned(32))

ff → end of packet I think

So you can see that it contains rc=0 and off=32

Let me know if you achieve any progress.

RE: Send dfu image between two nrf5340

MaximSh — Tue, 13 Sep 2022 14:05:54 GMT

Amazing.
if it is ok i can also test it on my side, i have an image stored at the external flash that i downloaded and i can read data and send it.
You can attach a code for this.

RE: Send dfu image between two nrf5340

Simon — Tue, 13 Sep 2022 13:53:53 GMT

I've now put the app_update.bin file into flash of the device running the central_smp_client sample, then I read out the first 32 bytes containing the image header and sends it to the device running the smp_svr sample. The smp_svr side sends an image upload response in return, with "rc"=0 and "off"=32.

RE: Send dfu image between two nrf5340

MaximSh — Sun, 11 Sep 2022 06:07:20 GMT

Thanks for update

RE: Send dfu image between two nrf5340

Simon — Fri, 09 Sep 2022 11:09:05 GMT

Some progress. Now I was able to sucessfully send the first packet of an image upload command and correctly parse it on the smp_svr side.

RE: Send dfu image between two nrf5340

Simon — Thu, 08 Sep 2022 10:49:03 GMT

I would like to inform you that I'm still working on this. I encountered some issues with the parsing of the image upload command on the smp_svr side, but I talked to a developer internally and got some tips on how to debug it. Will keep you updated.

Best regards,

Simon

RE: Send dfu image between two nrf5340

Simon — Wed, 31 Aug 2022 14:05:49 GMT

Hello,

I will be gone until Monday and won't be able to continue with this until then. My apologies for that.

Best regards,

Simon

RE: Send dfu image between two nrf5340

MaximSh — Tue, 30 Aug 2022 10:26:49 GMT

Thanks for update.
I was also created a reset command.
still stack at image upload command.

RE: Send dfu image between two nrf5340

Simon — Tue, 30 Aug 2022 10:04:23 GMT

Some update: I did some investigation on Friday and was easily able to integrate the reset command. Next, I tried to implement the image list command and encountered some issues. I had to modify the SDK two places to get rid of some error messages, and then a new error popped up. Will talk to some developers internally, continue to investigate and keep you updated.

RE: Send dfu image between two nrf5340

MaximSh — Wed, 24 Aug 2022 06:36:29 GMT

Thank, waiting for update