CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

kendallgoto — Fri, 24 Jan 2025 22:56:47 GMT

To summarize + close out this ticket:

Immediate Post-OTA Validation (OTA Client Cluster): will not be addressed due to Zigbee deprecation

FOTA Endpoint Restriction: will not be addressed due to Zigbee deprecation

Resetting Attribute State on Leave: confirmed + noted in Known issues NCSIDB-1411

NWK_addr_req Extended Response: confirmed + resolved in ZBOSS 3.11.6.0+5.1.7 / NCS v2.9.0

Access to standard ZBOSS PICS descriptors: not available

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

kendallgoto — Fri, 03 Jan 2025 20:22:28 GMT

Marte,

Thanks for the workaround sample. We'll implement this and re-test.

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Fri, 03 Jan 2025 09:39:20 GMT

Hi,

Here is a workaround for the resetting attribute state on leave issue:

devzone.nordicsemi.com/.../2275.app_5F00_clear_5F00_zcl_5F00_reporting_5F00_cfg_5F00_on_5F00_leave.diff

This can be added to the ZBOSS signal handler in the application code.

Additionally, the nwk_addr_req issue has been fixed in nRF Connect SDK v2.9.0.

Best regards,
Marte

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Tue, 19 Nov 2024 11:45:08 GMT

Hi Kendall,

Regarding the nwk_addr_req problem, we have received fixes from DSR, but these need to be tested to confirm that they are working before they can be integrated into the SDK.

The "Resetting Attribute State on Leave" issue is under consideration.

The other issues raised here will not be prioritized due to Zigbee R22 being deprecated in v2.8.0 of the nRF Connect SDK.

Best regards,
Marte

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

kendallgoto — Thu, 14 Nov 2024 20:30:49 GMT

Hi Marte,

I wanted to follow up and check in if there's any progress on the certification issues I mentioned here, & confirmations / expected SDK changes / etc to follow?

Thanks

Kendall

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Tue, 08 Oct 2024 12:06:52 GMT

Hi,

Thank you for providing the log. I have forwarded it to the developers.

Best regards,
Marte

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

kendallgoto — Sun, 06 Oct 2024 01:18:01 GMT

Hi Marte,

Sorry for the delay - I missed this message. I've attached the pcap file for the trace I previously sent. The ZB encryption key is `85acabc02f7ede90dae3d8455ecf80d1` as previously shared.

devzone.nordicsemi.com/.../zboss_2D00_nwk_5F00_addr_5F00_req_2D00_bug.pcap

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Fri, 27 Sep 2024 12:23:40 GMT

Hi,

Can you upload the capture as a pcap file?

Best regards,
Marte

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

kendallgoto — Thu, 26 Sep 2024 19:04:53 GMT

Hi Marte,

I just took a capture now + attached the dissection below.

Note in the capture the first packet which performs a nwk_addr_req with extended flag set, and receives a 20 byte response, only containing the status, IEEEaddr, NWKaddr fields, omitting NumAssocDev and StartIndex. The second request (third packet) is a nwk_addr_req without the extended flag set, which yields the same result.

The specification states that

If the RequestType in the request is Extended Response and there are no associated devices on the Remote Device, this field SHALL be set to 0.

Since the initial request type is extended, the CSA tests appear to expect this byte to at least be included and set to zero to properly parse the message, otherwise the test fails. Whether that is an issue with the ZBOSS stack or with CSA's expectations in their testing, I am not sure however. Regardless, it is an official CSA test that will inhibit certification until the discrepancy is resolved between ZBOSS + the CSA tests.

devzone.nordicsemi.com/.../zboss_2D00_nwk_5F00_addr_5F00_req_2D00_bug.txt

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Thu, 26 Sep 2024 11:22:22 GMT

Hi,

Do you have any sniffer logs from test FB-PRE-TC-02 that you can share?

Best regards,
Marte

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Wed, 25 Sep 2024 09:41:17 GMT

Hi,

Thank you for providing the information and logs!

I have forwarded it internally, and I will let you know if I have more questions or any updates.

Best regards,
Marte

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

kendallgoto — Tue, 24 Sep 2024 17:00:40 GMT

Marte,

Here are some example failing test cases that we found, relating to issues mentioned above. All testing was performed using CSA's ZUTH software v3.1.20240514. The specific test hash is included in the log header of each submission.

OTA Validation

OTA-TC-10C - Cryptographically invalid file OTA; failed due to not receiving invalid response from DUT, resolved with user-space OTA validation as per above.

devzone.nordicsemi.com/.../OTA_2D00_TC_2D00_10C.log

Mgmt_Leave_req

DR-TAR-TC-03B - configured reporting then sent leave with no rejoin; upon re-pairing to the network, the reporting value had not been reset due to in-memory cached state of ZBOSS configurables. Manually resolved by power cycle on leave.

devzone.nordicsemi.com/.../DR_2D00_TAR_2D00_TC_2D00_03B.log

NWK_addr_req

FB-PRE-TC-02-ZED - failed due to improper received message for extended addr req message; exempted by CSA request (message too short to unpack, since the DUT responded to the extended request with a non-extended response).

devzone.nordicsemi.com/.../FB_2D00_PRE_2D00_TC_2D00_02_2D00_ZED.log

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Tue, 24 Sep 2024 07:38:54 GMT

Hi,

Can you provide more information about the exact tests that failed, what software was used, and upload logs if you have any so we can investigate?

If there is any information you do not wish to share in a public ticket, you can either create a new private ticket with the information and refer to this ticket, or I can make this ticket private. Please let me know what you prefer if this is relevant.

Best regards,
Marte

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

kendallgoto — Fri, 20 Sep 2024 10:11:29 GMT

> We are using tests provided by DSR and test towards the specification, so our devices should follow the specifications set by DSR.

While this may be the case, DSR is not (solely) the certifying body for Zigbee. The test cases available directly from the CSA and executed by CSA's ZUTH tool, which are the mandatory executions for Zigbee 3.0.1 certification, do not pass this test, whereas other Zigbee platforms like EmberZNet do. As mentioned, we had to receive an exemption from the CSA to bypass this requirement.

> The ZBOSS PICS are available to download on CSA's webpage, where our SoCs are listed

My understanding is that these PICS are the platform certification PICs, however they do not cover the full scope of questions required to be answered for the end-device certification PICs using the ZBOSS platform. Other vendors have both sample end device PICs as well as the published platform PICs available. This is a minor ask, since the PICs are not terribly difficult to figure out, but having official documentation for an expected certification pathway would be valuable.

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Fri, 20 Sep 2024 08:46:30 GMT

Hi,

The Zigbee team is still looking into your concerns, but I have feedback on a couple of them.

[quote user=""]NWK_addr_req Extended Response[/quote]

We are using tests provided by DSR and test towards the specification, so our devices should follow the specifications set by CSA.

[quote user=""]Access to standard ZBOSS PICS descriptors[/quote]

The ZBOSS PICS are available to download on CSA's webpage, where our SoCs are listed:

If you or any customers have issues completing certification, we recommend creating a ticket on DevZone or contacting your local sales representative from Nordic Semiconductor.

Best regards,
Marte

RE: CSA Certification Issues for ZBOSS 3.11.4.0 End Devices

Marte Myrvold — Tue, 17 Sep 2024 09:18:01 GMT

Hi,

Thank you for reporting this. I will look into it and get back to you by the end of the week.

Best regards,
Marte