Assistance Required: Multiple Matter Certification Failures on nRF54L15 (NCS v3.1.1 / Matter 1.4.2)

[xiongwei.wang]

Dear Nordic Support Team,

I am currently performing Matter certification testing on our device based on the nRF54L15 using NCS v3.1.1 (Matter SDK 1.4.2). I am using the Matter Test Harness (v2.14+fall2025).

I have encountered several persistent failures during the "Mandatories" test suite run. Despite verifying our PICS and configuration, these tests continue to fail.

Below is a summary of the key failures and the specific error messages observed in the logs:

1. Device Type & Data Model Validation (TC-IDM-10.5)

Error: Invalid device type ID (out of valid range) But I just have a custom device type in endpoint 5 and I am testing the endpoint 0 now.

2. Access Control & Privileges (TC-ACE-2.3)
3. other failures:

TC-CADMIN-1.22 / 1.25.
TC-CCTRL-2.2 / 2.3.
TC-CGEN-2.2.
TC-CNET-4.10 / 4.12 / 4.16
TC-DA-1.2

How to analyze and solve them? Should I upload more information like PICS files ?

Environment Details:

Chip: nRF54L15
SDK: NCS v3.1.1
Matter Version: 1.4.2
Test Harness: v2.14+fall2025
Transport: BLE + Thread

Here is the total logs.

UI_Test_Run_2025_11_21_10_53_00.log

Best regards,

Xiongwei.Wang

[Elfving]

Hi, 

First of all, I should mention that we do offer a lot of documentation about this. And that the general way to fix these issues is to simply have a second look at your PICS and ZAP files. There is typically something missing, or maybe the ZAP files were generated with the wrong version of the tool, or rather a version that doesn't match the SDK.

Have you also seen this?

Get back to me if none of this helped, and I'll take another look.

Regards,

Elfving

[xiongwei.wang]

Hi,   Elfving

Sorry about it, I incorrectly assumed the latest version would be backward compatible. I will test it again. Thanks you very much.

Best regards,

Xiongwei.Wang 

[Elfving]

Could you send me the ZAP and PICS files?

[xiongwei.wang]

Sure, here they are. If you want more information, please let me know. I'm happy to provide it.

THCertification.zip7178.Valve.matter.txtValve.zap.txt

[xiongwei.wang]

I have retested EP0 using the file from THCertification.zip. The output is as follows. Regarding the issue with ep5, I believe we can disregard it, as it involves a custom device with a custom cluster.

UI_Test_Run_2025_12_02_06_18_02.log

[xiongwei.wang]

https://github.com/project-chip/connectedhomeip/commit/2346319ac69e9551fe0c4a44ce31f31ab1525700

It seems this file was updated by the upstream repository four months ago, but your SDK still remains at the version from a year ago, which has led to attestation issues.

[xiongwei.wang]

Hi, Elfving,

I forked your repository, updated the files from the upstream source, and then synced my local SDK with my fork. After that, the OTA-related issue was resolved.
However, some steps are still failing, such as AccessControlEntryChanged. Here are the logs.

EmitSomesTest_2025_12_03_05_47_09.log

Best regards,

Xiongwei.Wang