dfu removes bonds

RE: dfu removes bonds

bjorn-spockeli — Wed, 31 Jul 2019 15:32:12 GMT

If the nRF device has issued a Service Changed Indication and the Android device is not performing a new Service Discovery then Yes I would say it is a phone issue. No, not really, the Android DFU library which is used by nRF Connect will try to refresh the cache if it cannot find the DFU service at the location it expects it to be in the GATT table.

RE: dfu removes bonds

Carlos — Mon, 29 Jul 2019 15:11:23 GMT

Thank you Bjorn,

Do you mean that this is a phone issue? I checked several Android phones and all have same issue.

If this is the case, it should happen to everybody using DFU with bonds, do you have any other claim about it?

Regading HID, I am not sure about the meaning, but I guess no, I am usin Nordic Android App nRF Toolbox / nRf Connect.

Regards,

RE: dfu removes bonds

bjorn-spockeli — Tue, 23 Jul 2019 09:12:03 GMT

HI Carlos,

I apologize for the late reply. I have been on vacation.

I took another look at the sniffer trace you attached in case 229977 (https://devzone.nordicsemi.com/support-private/support/229977) and I see that after the DFU completes the nRF device is issuing a Service Changed notification that is confirmed by the central. So the GATT table on the phone should be up to date at that point.

The issue in in case 39184 was related to HID reports not being available to a custom application due to these being controlled by the Android Settings App. are you using HID in your application?

RE: dfu removes bonds

Carlos — Fri, 05 Jul 2019 23:00:15 GMT

Thank you Bjorn

Since its been a long time and if you only read the last question I guess you may lose the background I made a short summary.

The DFU with bonds is working fine, so yes NRF_DFU_BLE_REQUIRES_BONDS and NRF_DFU_BLE_BUTTONLESS_SUPPORTS_BONDS are set to 1.

Regarding NRF_SDH_BLE_SERVICE_CHANGED, yes it is set to 1 in both, as I already wrote above.

And also I provided you full logs and traces.

So the issue is why service cache refresh is needed?

I guess it may be related to Android as states in what I think is a similar issue:

https://devzone.nordicsemi.com/f/nordic-q-a/39184/refreshing-cached-services-on-bonded-peer-after-dfu

Can you please confirm it is same? And do you have any news about how to fix it or if Google will fix it (if I understood well it seems an Android issue)?

Thank you,

RE: dfu removes bonds

bjorn-spockeli — Fri, 05 Jul 2019 13:34:11 GMT

If NRF_SDH_BLE_SERVICE_CHANGED is set to 1 in both the bootloader and application, then the bootloader should issue a Service Changed notification.

Did you compile the bootloader with NRF_DFU_BLE_REQUIRES_BONDS set to 1 in the bootloader's sdk_config.h file and did you compile your application with NRF_DFU_BLE_BUTTONLESS_SUPPORTS_BONDS set to 1 in the application's sdk_config.h file?

Best regards

Bjørn

RE: dfu removes bonds

Carlos — Tue, 25 Jun 2019 21:35:23 GMT

Regarding my last question below:

"Can you please tell me a bit more...

...

Is this expected behavior or is it due to I miss something in my code?"

Is is there any advice?

thks

RE: dfu removes bonds

Carlos — Mon, 10 Jun 2019 21:23:29 GMT

Thank you Bjorn,

regarding you questions;

>>Does the DFU update increase or modify the GATT table of the application compared to the application >>that was replaced? OItherwise,the GATT attribute table handles should be the same as before the >>DFU.

No, application is exactly same before and after because dfu, after compile I generate hex and app_package. I write hex files in the board and then I update app to the same version, so no change in the application.

>>Can you check if the NRF_SDH_BLE_SERVICE_CHANGED define in sdk_config.h is set in the >>bootloader project? Could you also check if this is set in the applicaiton as well?

Yes, it is defined on both application and bootloader.

>>We do have a "refresh device cache" feature in nRF Connect. Connect to the device, then press the >>three vertical dots in the upper-right corner and then press "Refresh device cache". Does the Android >>device perform a new service discovery and display the services and characteristics after doing this?

And here comes the good news, by doing 'refresh services' when fRF is connected or 'refresh device cache' when it is disconnected and the connect it all services appear again and it work normally.

The option name in nRF Connect changes when it is connected or disconnected but it seems to have same effect.

Can you please tell me a bit more about this option and how would it be possible to make it work without the user need to do this refresh?

Is this expected behavior or is it due to I miss something in my code?

Thank you!!

RE: dfu removes bonds

bjorn-spockeli — Mon, 10 Jun 2019 10:49:30 GMT

Hi Carlos,

Looking at the sniffer trace and the last connection I cannot see anything wrong with regards to the reencryption using the bonding data( i.e. stored encryption key). The link layer packets(i.e. LL_ENC_REQ/RSP, LL_START_ENC_REQ/RSP) are all send in the correct order and the parameters look good.

So the bonding data must be preserved during the DFU otherwise you should have gotten a LL_REJECT_IND or LL_REJECT_EXT_IND packet in return.

The sniffer trace does not show any LL activity nor ATT activity after the link is encrypted. If the nRF device was bonded with the Android device, then it should have cached the GATT table of the application. However, it could be that you simply have to update the GATT attribute

Does the DFU update increase or modify the GATT table of the application compared to the application that was replaced? OItherwise,the GATT attribute table handles should be the same as before the DFU.

Can you check if the NRF_SDH_BLE_SERVICE_CHANGED define in sdk_config.h is set in the bootloader project? Could you also check if this is set in the applicaiton as well?

We do have a "refresh device cache" feature in nRF Connect. Connect to the device, then press the three vertical dots in the upper-right corner and then press "Refresh device cache". Does the Android device perform a new service discovery and display the services and characteristics after doing this?

Best regards

Bjørn

RE: dfu removes bonds

Carlos — Wed, 05 Jun 2019 22:21:35 GMT

Hello,

I uploaded full sniffer for all proces normal condition, dfu and post-dfu normal condition on private case: Case ID: 229977

I hope you can have a look and help me to fix the issue.

Here I paste the log from the board corresponding to the sniffer trace

**********First launch of phone app and nRf board, fails to bond*****************
<info> app: ble_evt_handler 0x10
<info> app: Connected
<info> peer_manager_handler: Connection security failed: role: Peripheral, conn_handle: 0x0, procedure: Encryption, error: 4102
<info> app: ble_evt_handler 0x14
<info> app: ble_evt_handler 0x13
<info> peer_manager_handler: Connection security failed: role: Peripheral, conn_handle: 0x0, procedure: Bonding, error: 132
<info> app: ble_evt_handler 0x19
<info> app: BLE_GAP_EVT_AUTH_STATUS: status=0x84 bond=0x0 lv4: 0 kdist_own:0x0 kdist_peer:0x0
<info> app: ble_evt_handler 0x12
<info> app: Fast advertising.
<info> app: PLX on_disconnect
<info> app: ble_evt_handler 0x11
<info> app: Disconnected, reason 0x13.
<info> app: Disconnected, reason BLE_HCI_REMOTE_USER_TERMINATED_CONNECTION

Switch off and on nRF board
**********Second launch of phone app and nRf board, everything goes fine, all sucessive uses works fine always from this point*****************
<info> app: ble_evt_handler 0x10
<info> app: Connected
<info> app: ble_evt_handler 0x12
<info> app: ble_evt_handler 0x12
<info> app: ble_evt_handler 0x13
<info> app: ble_evt_handler 0x12
<info> app: ble_evt_handler 0x1A
<info> peer_manager_handler: Connection secured: role: Peripheral, conn_handle: 0, procedure: Bonding
<info> app: ble_evt_handler 0x19
<info> app: BLE_GAP_EVT_AUTH_STATUS: status=0x0 bond=0x1 lv4: 0 kdist_own:0x3 kdist_peer:0x3
<info> app: ble_evt_handler 0x35
<info> app: ble_evt_handler 0x36
<info> app: ble_evt_handler 0x50
<info> app: ble_evt_handler 0x53
<info> app: Fast advertising.
<info> app: PLX on_disconnect
<info> app: ble_evt_handler 0x11
<info> app: Disconnected, reason 0x13.
<info> app: Disconnected, reason BLE_HCI_REMOTE_USER_TERMINATED_CONNECTION

Switch off and on nRF board
**********Second launch of phone app and nRf board, everything goes fine*****************
<info> app: ble_evt_handler 0x10
<info> app: Connected
<info> app: ble_evt_handler 0x14
<info> peer_manager_handler: Connection secured: role: Peripheral, conn_handle: 0, procedure: Encryption
<info> app: ble_evt_handler 0x1A
<info> app: ble_evt_handler 0x50
<info> app: ble_evt_handler 0x53
<info> app: Fast advertising.
<info> app: ble_evt_handler 0x11
<info> app: Disconnected, reason 0x13.
<info> app: Disconnected, reason BLE_HCI_REMOTE_USER_TERMINATED_CONNECTION

Switch off and on nRF board
**********Made secure dfu bonded to the same application, everything goes fine*****************
<info> app: ble_evt_handler 0x10
<info> app: Connected
<info> app: ble_evt_handler 0x14
<info> peer_manager_handler: Connection secured: role: Peripheral, conn_handle: 0, procedure: Encryption
<info> app: ble_evt_handler 0x1A
<info> app: ble_evt_handler 0x50
<info> app: Received indication state 1
<info> app: ble_evt_handler 0x50
<info> app: Writing peer data to the bootloader...
<info> app: ble_evt_handler 0x51
<info> app: Device is preparing to enter bootloadã[info> app: Device is preparing to enter bootloader mode.
<info> app: Disconnected 1 links.
<info> app: ble_evt_handler 0x53
<info> app: Device will enter bootloader mode.
<info> pwr_mgmt: Shutdown request 2
<info> pwr_mgmt: Shutdown started. Type 2
<info> app: Power management wants to reset to DFU mode.
<info> app: Power management allowed to reset to DFU mode.
<info> pwr_mgmt: SysOff handler 0x0002C405 => ready
<info> pwr_mgmt: Shutdown complete.
<info> pwr_mgmt: NVIC_SystemReset

**********First start after DFU, connects to phone but no services are displayed. From this point all sucesive trials are same until we remove bonds on both phone and nRF and then we go to step1 and we got the system working fine forever (till next dfu)*****************
<info> app: ble_evt_handler 0x10
<info> app: Connected
<info> app: ble_evt_handler 0x54
<info> app: ble_evt_handler 0x14
<info> peer_manager_handler: Connection secured: role: Peripheral, conn_handle: 0, procedure: Encryption
<info> app: ble_evt_handler 0x1A
<info> app: ble_evt_handler 0x12

Thank you for your help!

RE: dfu removes bonds

Carlos — Wed, 05 Jun 2019 12:10:30 GMT

I will try to get full sniffer, before dfu (bond and normal operation) -> dfu -> normal operation after dfu (mobile app reports 'cannot subscribe to event' and if I check with nRF connect I can connect but cannot see any service like bas, dis, dfu...).

Would it help this trace or do you already have an idea to check? Please tell me how to proceeed. I guess issue is related with service change... but learning and understanding the full SDK is hard without your support.

Thks

RE: dfu removes bonds

Carlos — Mon, 03 Jun 2019 15:27:49 GMT

Sorry, may be my explanation was not precise, I can connect but cannot see services that are SEC_JUST_WORKS after the dfu.

The only way to see again the resources is to remove bonds on all sides (phone and nRf) and connect again.

I guess is similar issue as stated in:

https://devzone.nordicsemi.com/f/nordic-q-a/36346/a-problem-on-buttonless-dfu-bonding-valid

That after dfu resources are lost and only way to see them again is to remove bonds.

Thks

RE: dfu removes bonds

bjorn-spockeli — Mon, 03 Jun 2019 14:59:07 GMT

Looking up the event IDs from the debug log:

Event ID 0x10 = BLE_GAP_EVT_CONNECTED

Event ID 0x12 = BLE_GAP_EVT_CONN_PARAM_UPDATE/**< Connection Parameters updated.

Event ID 0x14 = BLE_GAP_EVT_SEC_INFO_REQUEST /**< Request to provide security information.

Event ID 0x1A = BLE_GAP_EVT_CONN_SEC_UPDATE /**< Connection security updated.

Event ID 50 = BLE_GATTS_EVT_WRITE /**< Write operation performed.

Event ID 51 = BLE_GATTS_EVT_RW_AUTHORIZE_REQUEST /**< Read/Write Authorization request.

Event ID 53 = BLE_GATTS_EVT_HVC /**< Handle Value Confirmation.

Event ID 54 = BLE_GATTS_EVT_SC_CONFIRM /**< Service Changed Confirmation.

I cannot see anything abnormal in the sniffer trace you attached. The nRF device responding with the LL_ENC_RSP and the LL_START_ENC_REQ and after that the link is secured.

You say that:

[quote user="ca.itech"]After that only works if I delete bond on both nrf and phone...[/quote]

Do you mean that you are not able to connect to the device again if you disconnect after this point? If so did you also capture a sniffer trace when try to reconnect?

RE: dfu removes bonds

Carlos — Sun, 02 Jun 2019 21:04:47 GMT

Hello again,

I found a similar case

https://devzone.nordicsemi.com/f/nordic-q-a/36346/a-problem-on-buttonless-dfu-bonding-valid

The effect I have is same as described here, however I didn't change MTU size...

Anyway, do you know if this issues was fixed?

During the dfu I see this logs:

<info> app: ble_evt_handler 0x10
<info> app: Connected.
<info> app: ble_evt_handler 0x14
<info> peer_manager_handler: Connection secured: role: Peripheral, conn_handle: 0, procedure: Encryption
<info> app: ble_evt_handler 0x1A
<info> app: ble_evt_handler 0x50
<info> app: Received indication state 1
<info> app: ble_evt_handler 0x50
<info> app: Writing peer data to the bootloader...
<info> app: ble_evt_handler 0x51
<info> app: Device is preparing to enter bootloadï[info> app: Device is preparing to enter bootloader mode.
<info> app: Disconnected 1 links.
<info> app: ble_evt_handler 0x53
<info> app: Device will enter bootloader mode.
<info> pwr_mgmt: Shutdown request 2
<info> pwr_mgmt: Shutdown started. Type 2
<info> app: Power management wants to reset to DFU mode.
<info> app: Power management allowed to reset to DFU mode.
<info> pwr_mgmt: SysOff handler 0x0002C401 => ready
<info> pwr_mgmt: Shutdown complete.
<info> pwr_mgmt: NVIC_SystemReset

When I connect same phone after dfu I see this logs I print event on evt_handler(this should correspond to the sniffer I sent you):

<info> app: ble_evt_handler 0x10
<info> app: Connected.
<info> app: ble_evt_handler 0x54
<info> app: ble_evt_handler 0x14
<info> peer_manager_handler: Connection secured: role: Peripheral, conn_handle: 0, procedure: Encryption
<info> app: ble_evt_handler 0x1A
<info> app: ble_evt_handler 0x12

Could you look at the sniffer log?

After that only works if I delete bond on both nrf and phone...

Thanks,

Carlos

RE: dfu removes bonds

Carlos — Wed, 29 May 2019 21:54:23 GMT

Hi,

using nRF Connect has the same problem.

I have attached the sniffer log on private case: Case ID: 229977

Thks,

Carlos

RE: dfu removes bonds

bjorn-spockeli — Wed, 29 May 2019 14:55:02 GMT

HI Carlos,

I agree that the NRF_DFU_APP_DATA_AREA_SIZE looks correct.

[quote user=""]Can you btw tell me what is doing exactly this option and how is this setting is transfered to the secure dfu code to remove or not the bonds?[/quote]

The "keep bonds" in the nrf Toolbox app refers to the bonding information on the Android device. No bonding data is transferred to the nRF device by the nRF Toolbox app.

Could you try to use the nRF Connect app to perform the DFU instead of nRF Toolbox? Do you see the same behavior there?

If you do, could you capture a sniffer trace using our nRF Sniffer v2? It will make it easier to see which peer, i.e. the nRF or the Android, that does not have the correct bonding data.

Best regards

Bjørn