RE: Matter Test Harness failed in TC-IDM-10.2

Marte Myrvold — Wed, 27 Aug 2025 12:43:42 GMT
Hi,
It failed while executing the Python script for TC-IDM-10.2.
These are the logs that show what failed:
[MatterTest] 08-25 12:22:52.084 INFO ***** Test Step 1 : Run entire test
success = False
[MatterTest] 08-25 12:22:52.108 ERROR Exception occurred in test_TC_IDM_10_2.
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/dist-packages/mobly/base_test.py", line 801, in exec_one_test
    test_method()
  File "/root/python_testing/scripts/sdk/TC_DeviceConformance.py", line 462, in test_TC_IDM_10_2
    self.fail_current_test("Problems with conformance")
  File "/usr/local/lib/python3.12/dist-packages/chip/testing/basic_composition.py", line 233, in fail_current_test
    asserts.fail(msg)
  File "/usr/local/lib/python3.12/dist-packages/mobly/asserts.py", line 441, in fail
    raise signals.TestFailure(msg, extras)
mobly.signals.TestFailure: Details=Problems with conformance, Extras=None
[MatterTest] 08-25 12:22:52.127 ERROR 

******************************************************************
*
* Test test_TC_IDM_10_2 failed for the following reason:
* Details=Problems with conformance, Extras=None
*
* File "/usr/local/lib/python3.12/dist-packages/chip/testing/basic_composition.py", line 233, in fail_current_test
* asserts.fail(msg)
*
* Test step:
*     UNKNOWN - no test steps provided in test script
*
* Endpoint: None
*
*******************************************************************

[MatterTest] 08-25 12:22:52.128 INFO [Test] test_TC_IDM_10_2 FAIL
[MatterTest] 08-25 12:22:52.135 INFO ###########################################################
[MatterTest] 08-25 12:22:52.135 INFO Problems found:
[MatterTest] 08-25 12:22:52.136 INFO ===============
[MatterTest] 08-25 12:22:52.136 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  49 (0x31) NetworkCommissioning
      Attribute:8 (0x08)
    problem: Attribute 0x08 is included, but is disallowed by conformance. Conformance: WI, implemented features: TH
    spec_location: 

[MatterTest] 08-25 12:22:52.137 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:6 (0x06)
    problem: Attribute 0x06 is included, but is disallowed by conformance. Conformance: ERRCNT, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.137 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:14 (0x0e)
    problem: Attribute 0x0e is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.138 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:15 (0x0f)
    problem: Attribute 0x0f is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.138 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:16 (0x10)
    problem: Attribute 0x10 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.139 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:17 (0x11)
    problem: Attribute 0x11 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.140 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:18 (0x12)
    problem: Attribute 0x12 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.140 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:19 (0x13)
    problem: Attribute 0x13 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.141 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:20 (0x14)
    problem: Attribute 0x14 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.141 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:21 (0x15)
    problem: Attribute 0x15 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.142 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:22 (0x16)
    problem: Attribute 0x16 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.142 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:23 (0x17)
    problem: Attribute 0x17 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.143 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:24 (0x18)
    problem: Attribute 0x18 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.143 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:25 (0x19)
    problem: Attribute 0x19 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.144 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:26 (0x1a)
    problem: Attribute 0x1a is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.144 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:27 (0x1b)
    problem: Attribute 0x1b is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.144 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:28 (0x1c)
    problem: Attribute 0x1c is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.145 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:29 (0x1d)
    problem: Attribute 0x1d is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.145 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:30 (0x1e)
    problem: Attribute 0x1e is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.146 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:31 (0x1f)
    problem: Attribute 0x1f is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.146 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:32 (0x20)
    problem: Attribute 0x20 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.146 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:33 (0x21)
    problem: Attribute 0x21 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.147 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:34 (0x22)
    problem: Attribute 0x22 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.147 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:35 (0x23)
    problem: Attribute 0x23 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.148 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:36 (0x24)
    problem: Attribute 0x24 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.148 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:37 (0x25)
    problem: Attribute 0x25 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.149 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:38 (0x26)
    problem: Attribute 0x26 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.149 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:39 (0x27)
    problem: Attribute 0x27 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.150 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:40 (0x28)
    problem: Attribute 0x28 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.150 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:41 (0x29)
    problem: Attribute 0x29 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.151 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:42 (0x2a)
    problem: Attribute 0x2a is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.151 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:43 (0x2b)
    problem: Attribute 0x2b is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.152 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:44 (0x2c)
    problem: Attribute 0x2c is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.152 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:45 (0x2d)
    problem: Attribute 0x2d is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.153 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:46 (0x2e)
    problem: Attribute 0x2e is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.153 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:47 (0x2f)
    problem: Attribute 0x2f is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.154 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:48 (0x30)
    problem: Attribute 0x30 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.154 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:49 (0x31)
    problem: Attribute 0x31 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.155 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  56 (0x38) TimeSynchronization
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: NTPC, implemented features: TZ,TSC
    spec_location: 

[MatterTest] 08-25 12:22:52.155 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  56 (0x38) TimeSynchronization
       Command:  5 (0x05)
    problem: Command 0x05 is included, but disallowed by conformance. Conformance: NTPC, implemented features: TZ,TSC
    spec_location: 

[MatterTest] 08-25 12:22:52.155 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 6,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.156 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 7,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.156 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 8,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.157 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 9,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.157 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 10,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.157 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.158 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.158 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.158 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.159 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.159 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.159 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.160 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.160 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.160 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.160 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.161 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.161 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.162 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.162 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.163 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.163 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.163 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.164 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.164 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.164 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.165 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.165 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.165 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.165 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.166 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.166 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.166 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.166 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.167 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.167 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.167 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.168 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.168 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.168 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.169 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.169 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.170 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.170 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.170 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.171 INFO 
Problem: ProblemSeverity.ERROR
    test_name: Choice conformance
    location: 
       Endpoint: 16,
       Cluster:  258 (0x102) WindowCovering
      Attribute:65532 (0xfffc)
    problem: Problem with choice conformance .a+ - 0 selected
    spec_location: 

[MatterTest] 08-25 12:22:52.171 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 16,
       Cluster:  768 (0x300) ColorControl
       Command:  64 (0x40)
    problem: Command 0x40 is included, but disallowed by conformance. Conformance: EHUE, implemented features: HS,XY,CT
    spec_location: 

[MatterTest] 08-25 12:22:52.171 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 16,
       Cluster:  768 (0x300) ColorControl
       Command:  71 (0x47)
    problem: Command 0x47 is required, but is not present on the DUT. Conformance: HS | XY | CT, implemented features: HS,XY,CT
    spec_location: 

[MatterTest] 08-25 12:22:52.172 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 16,
       Cluster:  768 (0x300) ColorControl
       Command:  75 (0x4b)
    problem: Command 0x4b is required, but is not present on the DUT. Conformance: CT, implemented features: HS,XY,CT
    spec_location: 

[MatterTest] 08-25 12:22:52.172 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 16,
       Cluster:  768 (0x300) ColorControl
       Command:  76 (0x4c)
    problem: Command 0x4c is required, but is not present on the DUT. Conformance: CT, implemented features: HS,XY,CT
    spec_location: 

[MatterTest] 08-25 12:22:52.172 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.173 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.173 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.173 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.174 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.174 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.174 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.175 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.175 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.175 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.176 INFO ###########################################################
[MatterTest] 08-25 12:22:52.177 INFO Summary for test class TC_DeviceConformance: Error 0, Executed 1, Failed 1, Passed 0, Requested 1, Skipped 0
[MatterTest] 08-25 12:22:52.179 INFO Summary for test run MatterTest@08-25-2025_12-22-20-576:
Total time elapsed 31.552026929042768s
Artifacts are saved in "/tmp/matter_testing/logs/MatterTest/08-25-2025_12-22-20-576"
Test summary saved in "/tmp/matter_testing/logs/MatterTest/08-25-2025_12-22-20-576/test_summary.yaml"
Test results: Error 0, Executed 1, Failed 1, Passed 0, Requested 1, Skipped 0
According to this, there are multiple attributes that are included on your device, but that are disallowed by conformance.
Please verify that you have all the required PICS, that they conform to the specification for the Matter version you are using, and that you have provided all of them to the Test Harness. You need to provide Base.xml and PICS for each cluster implemented on the device. We have example PICS for the Matter Weather Station, which you can take a look at: https://github.com/nrfconnect/sdk-nrf/tree/v2.1.4/applications/matter_weather_station/certification/PICS. These PICS are from nRF Connect SDK v2.1.4, so they are a few years old, but it is just to give a general idea of what files you need, etc.
Best regards,
Marte