Matter Test Harness failed in TC-IDM-10.2

[xiongwei.wang]

Hello, Nordic Team!

I am conducting Matter Test Harness testing and have successfully built the test environment. However, I am encountering some issues during test execution.

1452.UI_Test_Run_2025_08_25_20_21_38-43.json

3036.UI_Test_Run_2025_08_25_20_21_38.log

And here is the log:

PICS_USER_PROMPT=1' > /var/tmp/pics"
INFO       | 2025-08-25 12:21:48.624347 | ================================================================================
INFO       | 2025-08-25 12:21:48.629021 | Executing Test Case: TC-IDM-10.2
INFO       | 2025-08-25 12:21:48.630436 | Test Setup
INFO       | 2025-08-25 12:21:48.631706 | User prompt: "Should the DUT be commissioned to run this test case?"
INFO       | 2025-08-25 12:21:58.128668 | User prompt: "Do you want to reuse the previous commissioning information?
If you select NO, a new commissioning will be performed"
INFO       | 2025-08-25 12:22:09.758025 | User chose prompt option DONE
INFO       | 2025-08-25 12:22:09.760647 | Copying file /app/admin_storage.json to container
INFO       | 2025-08-25 12:22:09.809352 | --------------------------------------------------------------------------------
INFO       | 2025-08-25 12:22:09.811613 | Executing Test Step: Start Python test
INFO       | 2025-08-25 12:22:09.813581 | Running Python Test: TC_IDM_10_2
INFO       | 2025-08-25 12:22:10.000145 | Sending command to SDK container: python3 /root/python_testing/scripts/sdk/matter_testing_infrastructure/chip/testing/test_harness_client.py sdk/TC_DeviceConformance TC_DeviceConformance --tests test_TC_IDM_10_2 --trace-to json:log --in-test-commissioning-method ble-thread --qr-code MT:Y.K90CEK01HBTF25X10  --PICS /var/tmp/pics
INFO       | 2025-08-25 12:22:52.088293 | Test Step Completed [PASSED]: Start Python test
INFO       | 2025-08-25 12:22:52.089935 | --------------------------------------------------------------------------------
INFO       | 2025-08-25 12:22:52.106976 | --------------------------------------------------------------------------------
INFO       | 2025-08-25 12:22:52.108564 | Executing Test Step: Run entire test
WARNING    | 2025-08-25 12:22:52.125711 | Test Failure: Python test step failure
INFO       | 2025-08-25 12:22:52.133347 | --------------------------------------------------------------------------------
INFO       | 2025-08-25 12:22:52.135055 | Executing Test Step: Show test logs
INFO       | 2025-08-25 12:22:52.181456 | ---- Start of Python test logs ----
PYTHON_TEST | 2025-08-25 12:22:52.191025 | [MatterTest] 08-25 12:22:20.644 INFO ==========> TC_DeviceConformance <==========

And here is my UART output information:

I: 24861888 [DL]Device Configuration:
I: 24861891 [DL]  Serial Number: 1145141919813
I: 24861895 [DL]  Vendor Id: 65521 (0xFFF1)
I: 24861899 [DL]  Product Id: 32768 (0x8000)
I: 24861903 [DL]  Product Name: Test Product
I: 24861907 [DL]  Hardware Version: 1
I: 24861911 [DL]  Setup Pin Code (0 for UNKNOWN/ERROR): 88581739
I: 24861916 [DL]  Setup Discriminator (0xFFFF for UNKNOWN/ERROR): 1145 (0x479)
I: 24861923 [DL]  Manufacturing Date: 2025-08-01
I: 24861928 [DL]  Device Type: 65535 (0xFFFF)
I: 24861932 [SVR]SetupQRCode: [MT:Y.K90CEK01HBTF25X10]
I: 24861937 [SVR]Copy/paste the below URL in a browser to see the QR Code:
I: 24861943 [SVR]https://project-chip.github.io/connectedhomeip/qrcode.html?data=MT%3AY.K90CEK01HBTF25X10
I: 24861953 [SVR]Manual pairing code: [10983554067]
I: Initialize binding Handler
I: 24861960 [SVR]Cannot load binding table: a0
I: Binding Table size: [0]:
I: 24861967 [ZCL]Emit DSTTableEmpty event [ep=0]
D: Global watchdog started with timeout 600000 ms
E: 24861975 [DL]Long dispatch time: 636 ms, for event type 2
I: NO DEVICE BOUND
D: [DeviceWorkerHandler] LINE: 233 Release unique id 1
I: 24861988 [DL]CHIPoBLE advertising started
I: 24861992 [DL]NFC Tag emulation started
I: 24891992 [DL]CHIPoBLE advertising mode changed to slow
I: 24891998 [DL]CHIPoBLE advertising started
I: 25761992 [DL]CHIPoBLE advertising mode changed to extended
I: 25761998 [DL]CHIPoBLE advertising started

There are also some useful logs.

ubuntu@ubuntu:~/ScriptRunner$ ./OTBRStart.sh 
Using BR Interface: wlan0
Using BR Variant: 37


################################################################################
otbr_start.sh: Starting...
################################################################################


********************************************************************************
otbr_start.sh: Removing 'otbr-chip' container
********************************************************************************
nrfconnect/otbr                                        9185bda                                    083c8472bc52   2 years ago     1.21GB
otbr image nrfconnect/otbr:9185bda already installed


********************************************************************************
otbr_start.sh: Starting 'otbr-chip' container
********************************************************************************
a195577e2a7e0ac850ca65bdaab0eb10e53d5c2304f1adca3f7e34441202a314


********************************************************************************
otbr_start.sh: Waiting 10 seconds to give the the docker container enough time to start up...
********************************************************************************


********************************************************************************
otbr_start.sh: Setting up Thread Network
********************************************************************************
Param: 'dataset init new'Done
Param: 'dataset channel 25'Done
Param: 'dataset panid 0x5b37'Done
Param: 'dataset extpanid 5b37dead5b37beef'Done
Param: 'dataset networkname 5b37'Done
Param: 'dataset networkkey 00112233445566778899aabbccddeeff'Done
Param: 'dataset commit active'Done
Param: 'prefix add fd11:37::/64 pasor'Done
Param: 'ifconfig up'Done
Param: 'thread start'Done
Param: 'netdata register'Done
Param: 'dataset active -x'0e08000000000001000035060004001fffe00708fd5e18d459de590904109e90c98379c9a88e1ce94b613a1405890c0402a0f7f8000300001901025b3702085b37dead5b37beef030435623337051000112233445566778899aabbccddeeff
Done
Simple Dataset: 000300001902085b37dead5b37beef051000112233445566778899aabbccddeeff01025b37

********************************************************************************
otbr_start.sh: Restarting the Raspi avahi to have it in a clean state
********************************************************************************


################################################################################
otbr_start.sh: Finishing...
################################################################################

ubuntu@ubuntu:~/ScriptRunner$ docker ps
CONTAINER ID   IMAGE                                                                     COMMAND                  CREATED              STATUS              PORTS                                                                                          NAMES
5f10d282fd8e   connectedhomeip/chip-cert-bins:1b2b3fd571feaca7328db35798b99ab7ba4e6212   "tail -f /dev/null"      53 seconds ago       Up 53 seconds                                                                                                      th-sdk
a195577e2a7e   nrfconnect/otbr:9185bda                                                   "/app/etc/docker/doc…"   About a minute ago   Up About a minute                                                                                                  otbr-chip
de5a6e52f066   ghcr.io/project-chip/csa-certification-tool-frontend:e3af91a              "docker-entrypoint.s…"   3 days ago           Up 3 days           4200/tcp                                                                                       certification-tool-frontend-1
01ebe05ec272   ghcr.io/project-chip/csa-certification-tool-backend:9bf5d9f               "bash -c './prestart…"   3 days ago           Up 3 days           0.0.0.0:8888->8888/tcp, [::]:8888->8888/tcp, 0.0.0.0:50000->50000/tcp, [::]:50000->50000/tcp   certification-tool-backend-1
817e087de054   postgres:12                                                               "docker-entrypoint.s…"   3 days ago           Up 3 days           0.0.0.0:5432->5432/tcp, [::]:5432->5432/tcp                                                    certification-tool-db-1
879a52b318c8   traefik:v2.2                                                              "/entrypoint.sh --pr…"   3 days ago           Up 3 days           0.0.0.0:80->80/tcp, [::]:80->80/tcp, 0.0.0.0:8090->8080/tcp, [::]:8090->8080/tcp               certification-tool-proxy-1
ubuntu@ubuntu:~/ScriptRunner$ docker ps | grep otbr
a195577e2a7e   nrfconnect/otbr:9185bda                                                   "/app/etc/docker/doc…"   About a minute ago   Up About a minute                                                                                                  otbr-chip

And I create such a test

{
  "config": {
    "test_parameters": {
      "qr-code": "MT:Y.K90CEK01HBTF25X10"
    },
    "network": {
      "wifi": {
        "ssid": "testharness",
        "password": "wifi-password"
      },
      "thread": {
        "rcp_serial_path": "/dev/ttyACM0",
        "rcp_baudrate": 115200,
        "on_mesh_prefix": "fd11:37::/64",
        "network_interface": "wlan0",
        "dataset": {
          "channel": "25",
          "panid": "0x5b37",
          "extpanid": "5b37dead5b37beef",
          "networkkey": "00112233445566778899aabbccddeeff",
          "networkname": "5b37"
        },
        "otbr_docker_image": null
      }
    },
    "dut_config": {
      "discriminator": "1145",
      "setup_code": "88581739",
      "pairing_mode": "ble-thread",
      "chip_timeout": null,
      "chip_use_paa_certs": true,
      "trace_log": true,
      "enhanced_setup_flow": null
    }
  },
  "pics": {
    "clusters": {
      "Base": {
        "name": "Base",
        "items": {
          "MCORE.DT_SW_COMP": {
            "number": "MCORE.DT_SW_COMP",
            "enabled": false
          },
          "MCORE.COM.BLE": {
            "number": "MCORE.COM.BLE",
            "enabled": true
          },
          "MCORE.COM.WIFI_2P4GHZ": {
            "number": "MCORE.COM.WIFI_2P4GHZ",
            "enabled": false
          },
          "MCORE.COM.WIFI_5GHZ": {
            "number": "MCORE.COM.WIFI_5GHZ",
            "enabled": false
          },
          "MCORE.COM.WIFI": {
            "number": "MCORE.COM.WIFI",
            "enabled": false
          },
          "MCORE.COM.ETH": {
            "number": "MCORE.COM.ETH",
            "enabled": false
          },
          "MCORE.COM.THR": {
            "number": "MCORE.COM.THR",
            "enabled": true
          },
          "MCORE.COM.WIRELESS": {
            "number": "MCORE.COM.WIRELESS",
            "enabled": true
          },
          "MCORE.ROLE.COMMISSIONER": {
            "number": "MCORE.ROLE.COMMISSIONER",
            "enabled": false
          },
          "MCORE.ROLE.COMMISSIONEE": {
            "number": "MCORE.ROLE.COMMISSIONEE",
            "enabled": true
          },
          "MCORE.ROLE.CONTROLLER": {
            "number": "MCORE.ROLE.CONTROLLER",
            "enabled": false
          },
          "MCORE.DLOG.S.UTCTIMESTAMP": {
            "number": "MCORE.DLOG.S.UTCTIMESTAMP",
            "enabled": false
          },
          "MCORE.DLOG.S.TIMESINCEBOOT": {
            "number": "MCORE.DLOG.S.TIMESINCEBOOT",
            "enabled": false
          },
          "MCORE.DD.CHIP_DEV": {
            "number": "MCORE.DD.CHIP_DEV",
            "enabled": true
          },
          "MCORE.DD.DEV_LOCK": {
            "number": "MCORE.DD.DEV_LOCK",
            "enabled": false
          },
          "MCORE.DD.DEV_BARRIER": {
            "number": "MCORE.DD.DEV_BARRIER",
            "enabled": false
          },
          "MCORE.DD.IE": {
            "number": "MCORE.DD.IE",
            "enabled": false
          },
          "MCORE.DD.QR": {
            "number": "MCORE.DD.QR",
            "enabled": false
          },
          "MCORE.DD.MANUAL_PC": {
            "number": "MCORE.DD.MANUAL_PC",
            "enabled": true
          },
          "MCORE.DD.NFC": {
            "number": "MCORE.DD.NFC",
            "enabled": false
          },
          "MCORE.DD.UI": {
            "number": "MCORE.DD.UI",
            "enabled": true
          },
          "MCORE.DD.COMM_DISCOVERY": {
            "number": "MCORE.DD.COMM_DISCOVERY",
            "enabled": true
          },
          "MCORE.DD.CONCATENATED_QR_CODE": {
            "number": "MCORE.DD.CONCATENATED_QR_CODE",
            "enabled": false
          },
          "MCORE.DD.CTRL_CONCATENATED_QR_CODE_1": {
            "number": "MCORE.DD.CTRL_CONCATENATED_QR_CODE_1",
            "enabled": false
          },
          "MCORE.DD.CTRL_CONCATENATED_QR_CODE_1_INORDER": {
            "number": "MCORE.DD.CTRL_CONCATENATED_QR_CODE_1_INORDER",
            "enabled": false
          },
          "MCORE.DD.CTRL_CONCATENATED_QR_CODE_2": {
            "number": "MCORE.DD.CTRL_CONCATENATED_QR_CODE_2",
            "enabled": false
          },
          "MCORE.DD.DISCOVERY_BLE": {
            "number": "MCORE.DD.DISCOVERY_BLE",
            "enabled": false
          },
          "MCORE.DD.DISCOVERY_PAF": {
            "number": "MCORE.DD.DISCOVERY_PAF",
            "enabled": false
          },
          "MCORE.DD.DISCOVERY_IP": {
            "number": "MCORE.DD.DISCOVERY_IP",
            "enabled": false
          },
          "MCORE.DD.DISCOVERY_SOFTAP": {
            "number": "MCORE.DD.DISCOVERY_SOFTAP",
            "enabled": false
          },
          "MCORE.DD.STANDARD_COMM_FLOW": {
            "number": "MCORE.DD.STANDARD_COMM_FLOW",
            "enabled": true
          },
          "MCORE.DD.NON_CONCURRENT_CONNECTION": {
            "number": "MCORE.DD.NON_CONCURRENT_CONNECTION",
            "enabled": false
          },
          "MCORE.DD.USER_INTENT_COMM_FLOW": {
            "number": "MCORE.DD.USER_INTENT_COMM_FLOW",
            "enabled": false
          },
          "MCORE.DD.CUSTOM_COMM_FLOW": {
            "number": "MCORE.DD.CUSTOM_COMM_FLOW",
            "enabled": false
          },
          "MCORE.DD.MANUAL_PC_COMMISSIONING": {
            "number": "MCORE.DD.MANUAL_PC_COMMISSIONING",
            "enabled": true
          },
          "MCORE.DD.11_MANUAL_PC": {
            "number": "MCORE.DD.11_MANUAL_PC",
            "enabled": true
          },
          "MCORE.DD.21_MANUAL_PC": {
            "number": "MCORE.DD.21_MANUAL_PC",
            "enabled": false
          },
          "MCORE.DD.PHYSICAL_TAMPERING": {
            "number": "MCORE.DD.PHYSICAL_TAMPERING",
            "enabled": false
          },
          "MCORE.DD.SCAN_NFC": {
            "number": "MCORE.DD.SCAN_NFC",
            "enabled": false
          },
          "MCORE.DD.QR_COMMISSIONING": {
            "number": "MCORE.DD.QR_COMMISSIONING",
            "enabled": false
          },
          "MCORE.DD.SCAN_QR_CODE": {
            "number": "MCORE.DD.SCAN_QR_CODE",
            "enabled": false
          },
          "MCORE.DD.EXTENDED_DISCOVERY": {
            "number": "MCORE.DD.EXTENDED_DISCOVERY",
            "enabled": false
          },
          "MCORE.DD.COMMISSIONING_SUBTYPE_V": {
            "number": "MCORE.DD.COMMISSIONING_SUBTYPE_V",
            "enabled": false
          },
          "MCORE.DD.COMMISSIONING_SUBTYPE_T": {
            "number": "MCORE.DD.COMMISSIONING_SUBTYPE_T",
            "enabled": false
          },
          "MCORE.DD.TXT_KEY_VP": {
            "number": "MCORE.DD.TXT_KEY_VP",
            "enabled": true
          },
          "MCORE.DD.TXT_KEY_DT": {
            "number": "MCORE.DD.TXT_KEY_DT",
            "enabled": true
          },
          "MCORE.DD.TXT_KEY_DN": {
            "number": "MCORE.DD.TXT_KEY_DN",
            "enabled": false
          },
          "MCORE.DD.TXT_KEY_RI": {
            "number": "MCORE.DD.TXT_KEY_RI",
            "enabled": false
          },
          "MCORE.DD.TXT_KEY_PH": {
            "number": "MCORE.DD.TXT_KEY_PH",
            "enabled": false
          },
          "MCORE.DD.TXT_KEY_PI": {
            "number": "MCORE.DD.TXT_KEY_PI",
            "enabled": false
          },
          "MCORE.COM.PAF": {
            "number": "MCORE.COM.PAF",
            "enabled": false
          },
          "MCORE.DD.ESF_TC_COMMISSIONER": {
            "number": "MCORE.DD.ESF_TC_COMMISSIONER",
            "enabled": false
          },
          "MCORE.SC.VENDOR_SUBTYPE": {
            "number": "MCORE.SC.VENDOR_SUBTYPE",
            "enabled": false
          },
          "MCORE.SC.DEVTYPE_SUBTYPE": {
            "number": "MCORE.SC.DEVTYPE_SUBTYPE",
            "enabled": false
          },
          "MCORE.SC.VP_KEY": {
            "number": "MCORE.SC.VP_KEY",
            "enabled": false
          },
          "MCORE.SC.DT_KEY": {
            "number": "MCORE.SC.DT_KEY",
            "enabled": false
          },
          "MCORE.SC.DN_KEY": {
            "number": "MCORE.SC.DN_KEY",
            "enabled": false
          },
          "MCORE.SC.RI_KEY": {
            "number": "MCORE.SC.RI_KEY",
            "enabled": false
          },
          "MCORE.SC.PH_KEY": {
            "number": "MCORE.SC.PH_KEY",
            "enabled": false
          },
          "MCORE.SC.PI_KEY": {
            "number": "MCORE.SC.PI_KEY",
            "enabled": false
          },
          "MCORE.SC.SII_OP_DISCOVERY_KEY": {
            "number": "MCORE.SC.SII_OP_DISCOVERY_KEY",
            "enabled": false
          },
          "MCORE.SC.SAI_OP_DISCOVERY_KEY": {
            "number": "MCORE.SC.SAI_OP_DISCOVERY_KEY",
            "enabled": false
          },
          "MCORE.SC.SAT_OP_DISCOVERY_KEY": {
            "number": "MCORE.SC.SAT_OP_DISCOVERY_KEY",
            "enabled": false
          },
          "MCORE.SC.T_KEY": {
            "number": "MCORE.SC.T_KEY",
            "enabled": false
          },
          "MCORE.SC.SII_COMM_DISCOVERY_KEY": {
            "number": "MCORE.SC.SII_COMM_DISCOVERY_KEY",
            "enabled": false
          },
          "MCORE.SC.SAI_COMM_DISCOVERY_KEY": {
            "number": "MCORE.SC.SAI_COMM_DISCOVERY_KEY",
            "enabled": false
          },
          "MCORE.SC.EXTENDED_DISCOVERY": {
            "number": "MCORE.SC.EXTENDED_DISCOVERY",
            "enabled": false
          },
          "MCORE.SC.SIT_ICD": {
            "number": "MCORE.SC.SIT_ICD",
            "enabled": false
          },
          "MCORE.SC.TCP": {
            "number": "MCORE.SC.TCP",
            "enabled": false
          },
          "MCORE.IDM.S": {
            "number": "MCORE.IDM.S",
            "enabled": true
          },
          "MCORE.IDM.C": {
            "number": "MCORE.IDM.C",
            "enabled": false
          },
          "MCORE.IDM.C.InvokeRequest": {
            "number": "MCORE.IDM.C.InvokeRequest",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest": {
            "number": "MCORE.IDM.C.ReadRequest",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest": {
            "number": "MCORE.IDM.C.WriteRequest",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeRequest": {
            "number": "MCORE.IDM.C.SubscribeRequest",
            "enabled": false
          },
          "MCORE.IDM.C.InvokeRequest.BatchCommands": {
            "number": "MCORE.IDM.C.InvokeRequest.BatchCommands",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_Bool": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_Bool",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_String": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_String",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_UnsignedInteger": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_UnsignedInteger",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_SignedInteger": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_SignedInteger",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_Struct": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_Struct",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_FloatingPoint": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_FloatingPoint",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_List": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_List",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_OctetString": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_OctetString",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_Enum": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_Enum",
            "enabled": false
          },
          "MCORE.IDM.C.ReadRequest.Attribute.DataType_Bitmap": {
            "number": "MCORE.IDM.C.ReadRequest.Attribute.DataType_Bitmap",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_Bool": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_Bool",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_String": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_String",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_UnsignedInteger": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_UnsignedInteger",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_SignedInteger": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_SignedInteger",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_Struct": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_Struct",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_FloatingPoint": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_FloatingPoint",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_List": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_List",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_OctetString": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_OctetString",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_Enum": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_Enum",
            "enabled": false
          },
          "MCORE.IDM.C.WriteRequest.Attribute.DataType_Bitmap": {
            "number": "MCORE.IDM.C.WriteRequest.Attribute.DataType_Bitmap",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_Bool": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_Bool",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_String": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_String",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_UnsignedInteger": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_UnsignedInteger",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_SignedInteger": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_SignedInteger",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_Struct": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_Struct",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_FloatingPoint": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_FloatingPoint",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_List": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_List",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_OctetString": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_OctetString",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_Enum": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_Enum",
            "enabled": false
          },
          "MCORE.IDM.S.Attribute_W.DataType_Bitmap": {
            "number": "MCORE.IDM.S.Attribute_W.DataType_Bitmap",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_Bool": {
            "number": "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_Bool",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_String": {
            "number": "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_String",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_UnsignedInteger": {
            "number": "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_UnsignedInteger",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_Integer": {
            "number": "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_Integer",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_FloatingPoint": {
            "number": "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_FloatingPoint",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_List": {
            "number": "MCORE.IDM.C.SubscribeRequest.Attribute.DataType_List",
            "enabled": false
          },
          "MCORE.IDM.S.LargeData": {
            "number": "MCORE.IDM.S.LargeData",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeEvent": {
            "number": "MCORE.IDM.C.SubscribeEvent",
            "enabled": false
          },
          "MCORE.IDM.C.ReadEvent": {
            "number": "MCORE.IDM.C.ReadEvent",
            "enabled": false
          },
          "MCORE.IDM.C.SubscribeRequest.MultipleAttributes": {
            "number": "MCORE.IDM.C.SubscribeRequest.MultipleAttributes",
            "enabled": false
          },
          "MCORE.IDM.S.PersistentSubscription": {
            "number": "MCORE.IDM.S.PersistentSubscription",
            "enabled": true
          },
          "MCORE.BRIDGE": {
            "number": "MCORE.BRIDGE",
            "enabled": false
          },
          "MCORE.BRIDGE.BatInfo": {
            "number": "MCORE.BRIDGE.BatInfo",
            "enabled": false
          },
          "MCORE.BRIDGE.OtherControl": {
            "number": "MCORE.BRIDGE.OtherControl",
            "enabled": false
          },
          "MCORE.BRIDGE.AllowDeviceRename": {
            "number": "MCORE.BRIDGE.AllowDeviceRename",
            "enabled": false
          },
          "MCORE.BRIDGECLIENT": {
            "number": "MCORE.BRIDGECLIENT",
            "enabled": false
          },
          "MCORE.DEVLIST.UseDevices": {
            "number": "MCORE.DEVLIST.UseDevices",
            "enabled": false
          },
          "MCORE.DEVLIST.UseDeviceName": {
            "number": "MCORE.DEVLIST.UseDeviceName",
            "enabled": false
          },
          "MCORE.DEVLIST.UseDeviceState": {
            "number": "MCORE.DEVLIST.UseDeviceState",
            "enabled": false
          },
          "MCORE.DEVLIST.UseBatInfo": {
            "number": "MCORE.DEVLIST.UseBatInfo",
            "enabled": false
          },
          "MCORE.BDX.Sender": {
            "number": "MCORE.BDX.Sender",
            "enabled": false
          },
          "MCORE.BDX.Receiver": {
            "number": "MCORE.BDX.Receiver",
            "enabled": false
          },
          "MCORE.BDX.SynchronousSender": {
            "number": "MCORE.BDX.SynchronousSender",
            "enabled": false
          },
          "MCORE.BDX.SynchronousReceiver": {
            "number": "MCORE.BDX.SynchronousReceiver",
            "enabled": false
          },
          "MCORE.BDX.AsynchronousSender": {
            "number": "MCORE.BDX.AsynchronousSender",
            "enabled": false
          },
          "MCORE.BDX.AsynchronousReceiver": {
            "number": "MCORE.BDX.AsynchronousReceiver",
            "enabled": false
          },
          "MCORE.BDX.Driver": {
            "number": "MCORE.BDX.Driver",
            "enabled": false
          },
          "MCORE.BDX.Initiator": {
            "number": "MCORE.BDX.Initiator",
            "enabled": false
          },
          "MCORE.BDX.Responder": {
            "number": "MCORE.BDX.Responder",
            "enabled": false
          },
          "MCORE.BDX.BlockQueryWithSkip": {
            "number": "MCORE.BDX.BlockQueryWithSkip",
            "enabled": false
          },
          "MCORE.OTA.Requestor": {
            "number": "MCORE.OTA.Requestor",
            "enabled": true
          },
          "MCORE.OTA.Provider": {
            "number": "MCORE.OTA.Provider",
            "enabled": false
          },
          "MCORE.OTA.HTTPS": {
            "number": "MCORE.OTA.HTTPS",
            "enabled": false
          },
          "MCORE.OTA.RequestorConsent": {
            "number": "MCORE.OTA.RequestorConsent",
            "enabled": true
          },
          "MCORE.OTA.Resume": {
            "number": "MCORE.OTA.Resume",
            "enabled": false
          },
          "MCORE.OTA.VendorSpecific": {
            "number": "MCORE.OTA.VendorSpecific",
            "enabled": false
          },
          "MCORE.ACL.Administrator": {
            "number": "MCORE.ACL.Administrator",
            "enabled": false
          },
          "MCORE.OTA.Retry": {
            "number": "MCORE.OTA.Retry",
            "enabled": false
          },
          "MCORE.FS": {
            "number": "MCORE.FS",
            "enabled": false
          },
          "MCORE.SM.S": {
            "number": "MCORE.SM.S",
            "enabled": true
          },
          "MCORE.DT.S": {
            "number": "MCORE.DT.S",
            "enabled": true
          },
          "MCORE.G.MULTIENDPOINT": {
            "number": "MCORE.G.MULTIENDPOINT",
            "enabled": false
          }
        }
      },
      "On/Off Cluster Test Plan": {
        "name": "On/Off Cluster Test Plan",
        "items": {
          "OO.S": {
            "number": "OO.S",
            "enabled": true
          },
          "OO.C": {
            "number": "OO.C",
            "enabled": false
          },
          "OO.S.A0000": {
            "number": "OO.S.A0000",
            "enabled": true
          },
          "OO.S.A4000": {
            "number": "OO.S.A4000",
            "enabled": false
          },
          "OO.S.A4001": {
            "number": "OO.S.A4001",
            "enabled": false
          },
          "OO.S.A4002": {
            "number": "OO.S.A4002",
            "enabled": false
          },
          "OO.S.A4003": {
            "number": "OO.S.A4003",
            "enabled": false
          },
          "OO.S.C00.Rsp": {
            "number": "OO.S.C00.Rsp",
            "enabled": true
          },
          "OO.S.C01.Rsp": {
            "number": "OO.S.C01.Rsp",
            "enabled": true
          },
          "OO.S.C02.Rsp": {
            "number": "OO.S.C02.Rsp",
            "enabled": true
          },
          "OO.S.C40.Rsp": {
            "number": "OO.S.C40.Rsp",
            "enabled": false
          },
          "OO.S.C41.Rsp": {
            "number": "OO.S.C41.Rsp",
            "enabled": false
          },
          "OO.S.C42.Rsp": {
            "number": "OO.S.C42.Rsp",
            "enabled": false
          },
          "OO.S.F00": {
            "number": "OO.S.F00",
            "enabled": false
          },
          "OO.S.F01": {
            "number": "OO.S.F01",
            "enabled": false
          },
          "OO.S.F02": {
            "number": "OO.S.F02",
            "enabled": false
          },
          "OO.M.ManuallyControlled": {
            "number": "OO.M.ManuallyControlled",
            "enabled": false
          },
          "OO.C.C00.Tx": {
            "number": "OO.C.C00.Tx",
            "enabled": false
          },
          "OO.C.C01.Tx": {
            "number": "OO.C.C01.Tx",
            "enabled": false
          },
          "OO.C.C02.Tx": {
            "number": "OO.C.C02.Tx",
            "enabled": false
          },
          "OO.C.C40.Tx": {
            "number": "OO.C.C40.Tx",
            "enabled": false
          },
          "OO.C.C41.Tx": {
            "number": "OO.C.C41.Tx",
            "enabled": false
          },
          "OO.C.C42.Tx": {
            "number": "OO.C.C42.Tx",
            "enabled": false
          }
        }
      }
    }
  }
}

Here are my pics files

6254.PICS.zip

And I want to what happen, and how to solve it. My otbr seems fine, because I can run the following command:

ubuntu@ubuntu:~/ScriptRunner$ sudo docker exec -ti otbr-chip ot-ctl state
leader
Done

4606.MatterTH.zip

NCS vesion is v3.0.2. NRF54L15 DK

Thanks!

Xiongwei.Wang

[Kenneth]

Hello,

Key person are out of office this week, but here are some debugging steps you can try:

Check that the ZAP files have been generated with the version of the ZAP tool supported by the NCS version in use. The supported version can be found in modules/lib/matter/scripts/setup/zap.version. For NCS v3.0.2, the version is v2024.08.14-nightly (from https://github.com/nrfconnect/sdk-connectedhomeip/blob/v3.0.2/scripts/setup/zap.version).

The version of the ZAP tool being used can be verified by going to Settings > About in the ZAP tool:

If that doesn't solve it, then what you can try if possible go through the attributes you get an error on in the conformance test, and check that both PICS- and ZAP-files are according to spec. In this particular case you may try debugging log with chatgpt also.

Kenneth

[xiongwei.wang]

Hi, Kenneth,

Thank you for your response. It doesn’t seem to be a configuration issue. TC-IDM-10.2 is the first test in my Matter Test Harness, and it didn’t execute the Python script.

If there’s any additional information I can provide, please let me know.

Thanks!
Xiongwei.Wang

[Marte Myrvold]

Hi,

It failed while executing the Python script for TC-IDM-10.2.

These are the logs that show what failed:

[MatterTest] 08-25 12:22:52.084 INFO ***** Test Step 1 : Run entire test
success = False
[MatterTest] 08-25 12:22:52.108 ERROR Exception occurred in test_TC_IDM_10_2.
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/dist-packages/mobly/base_test.py", line 801, in exec_one_test
    test_method()
  File "/root/python_testing/scripts/sdk/TC_DeviceConformance.py", line 462, in test_TC_IDM_10_2
    self.fail_current_test("Problems with conformance")
  File "/usr/local/lib/python3.12/dist-packages/chip/testing/basic_composition.py", line 233, in fail_current_test
    asserts.fail(msg)
  File "/usr/local/lib/python3.12/dist-packages/mobly/asserts.py", line 441, in fail
    raise signals.TestFailure(msg, extras)
mobly.signals.TestFailure: Details=Problems with conformance, Extras=None
[MatterTest] 08-25 12:22:52.127 ERROR 

******************************************************************
*
* Test test_TC_IDM_10_2 failed for the following reason:
* Details=Problems with conformance, Extras=None
*
* File "/usr/local/lib/python3.12/dist-packages/chip/testing/basic_composition.py", line 233, in fail_current_test
* asserts.fail(msg)
*
* Test step:
*     UNKNOWN - no test steps provided in test script
*
* Endpoint: None
*
*******************************************************************

[MatterTest] 08-25 12:22:52.128 INFO [Test] test_TC_IDM_10_2 FAIL
[MatterTest] 08-25 12:22:52.135 INFO ###########################################################
[MatterTest] 08-25 12:22:52.135 INFO Problems found:
[MatterTest] 08-25 12:22:52.136 INFO ===============
[MatterTest] 08-25 12:22:52.136 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  49 (0x31) NetworkCommissioning
      Attribute:8 (0x08)
    problem: Attribute 0x08 is included, but is disallowed by conformance. Conformance: WI, implemented features: TH
    spec_location: 

[MatterTest] 08-25 12:22:52.137 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:6 (0x06)
    problem: Attribute 0x06 is included, but is disallowed by conformance. Conformance: ERRCNT, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.137 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:14 (0x0e)
    problem: Attribute 0x0e is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.138 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:15 (0x0f)
    problem: Attribute 0x0f is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.138 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:16 (0x10)
    problem: Attribute 0x10 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.139 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:17 (0x11)
    problem: Attribute 0x11 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.140 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:18 (0x12)
    problem: Attribute 0x12 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.140 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:19 (0x13)
    problem: Attribute 0x13 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.141 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:20 (0x14)
    problem: Attribute 0x14 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.141 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:21 (0x15)
    problem: Attribute 0x15 is included, but is disallowed by conformance. Conformance: [MLECNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.142 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:22 (0x16)
    problem: Attribute 0x16 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.142 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:23 (0x17)
    problem: Attribute 0x17 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.143 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:24 (0x18)
    problem: Attribute 0x18 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.143 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:25 (0x19)
    problem: Attribute 0x19 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.144 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:26 (0x1a)
    problem: Attribute 0x1a is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.144 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:27 (0x1b)
    problem: Attribute 0x1b is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.144 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:28 (0x1c)
    problem: Attribute 0x1c is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.145 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:29 (0x1d)
    problem: Attribute 0x1d is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.145 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:30 (0x1e)
    problem: Attribute 0x1e is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.146 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:31 (0x1f)
    problem: Attribute 0x1f is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.146 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:32 (0x20)
    problem: Attribute 0x20 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.146 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:33 (0x21)
    problem: Attribute 0x21 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.147 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:34 (0x22)
    problem: Attribute 0x22 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.147 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:35 (0x23)
    problem: Attribute 0x23 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.148 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:36 (0x24)
    problem: Attribute 0x24 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.148 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:37 (0x25)
    problem: Attribute 0x25 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.149 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:38 (0x26)
    problem: Attribute 0x26 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.149 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:39 (0x27)
    problem: Attribute 0x27 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.150 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:40 (0x28)
    problem: Attribute 0x28 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.150 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:41 (0x29)
    problem: Attribute 0x29 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.151 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:42 (0x2a)
    problem: Attribute 0x2a is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.151 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:43 (0x2b)
    problem: Attribute 0x2b is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.152 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:44 (0x2c)
    problem: Attribute 0x2c is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.152 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:45 (0x2d)
    problem: Attribute 0x2d is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.153 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:46 (0x2e)
    problem: Attribute 0x2e is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.153 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:47 (0x2f)
    problem: Attribute 0x2f is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.154 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:48 (0x30)
    problem: Attribute 0x30 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.154 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  53 (0x35) ThreadNetworkDiagnostics
      Attribute:49 (0x31)
    problem: Attribute 0x31 is included, but is disallowed by conformance. Conformance: [MACCNT], implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.155 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  56 (0x38) TimeSynchronization
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: NTPC, implemented features: TZ,TSC
    spec_location: 

[MatterTest] 08-25 12:22:52.155 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 0,
       Cluster:  56 (0x38) TimeSynchronization
       Command:  5 (0x05)
    problem: Command 0x05 is included, but disallowed by conformance. Conformance: NTPC, implemented features: TZ,TSC
    spec_location: 

[MatterTest] 08-25 12:22:52.155 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 6,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.156 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 7,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.156 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 8,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.157 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 9,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.157 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 10,
       Cluster:  29 (0x1d) Descriptor
      Attribute:4 (0x04)
    problem: Attribute 0x04 is included, but is disallowed by conformance. Conformance: TAGLIST, implemented features: 
    spec_location: 

[MatterTest] 08-25 12:22:52.157 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.158 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.158 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.158 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.159 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.159 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.159 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.160 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.160 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.160 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 11,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.160 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.161 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.161 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.162 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.162 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.163 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.163 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.163 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.164 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.164 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 12,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.164 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.165 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.165 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.165 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.165 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.166 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.166 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.166 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.166 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.167 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 14,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.167 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.167 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.168 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.168 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.168 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.169 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.169 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.170 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.170 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.170 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 15,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.171 INFO 
Problem: ProblemSeverity.ERROR
    test_name: Choice conformance
    location: 
       Endpoint: 16,
       Cluster:  258 (0x102) WindowCovering
      Attribute:65532 (0xfffc)
    problem: Problem with choice conformance .a+ - 0 selected
    spec_location: 

[MatterTest] 08-25 12:22:52.171 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 16,
       Cluster:  768 (0x300) ColorControl
       Command:  64 (0x40)
    problem: Command 0x40 is included, but disallowed by conformance. Conformance: EHUE, implemented features: HS,XY,CT
    spec_location: 

[MatterTest] 08-25 12:22:52.171 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 16,
       Cluster:  768 (0x300) ColorControl
       Command:  71 (0x47)
    problem: Command 0x47 is required, but is not present on the DUT. Conformance: HS | XY | CT, implemented features: HS,XY,CT
    spec_location: 

[MatterTest] 08-25 12:22:52.172 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 16,
       Cluster:  768 (0x300) ColorControl
       Command:  75 (0x4b)
    problem: Command 0x4b is required, but is not present on the DUT. Conformance: CT, implemented features: HS,XY,CT
    spec_location: 

[MatterTest] 08-25 12:22:52.172 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 16,
       Cluster:  768 (0x300) ColorControl
       Command:  76 (0x4c)
    problem: Command 0x4c is required, but is not present on the DUT. Conformance: CT, implemented features: HS,XY,CT
    spec_location: 

[MatterTest] 08-25 12:22:52.172 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.173 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.173 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.173 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.174 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  4 (0x04)
    problem: Command 0x04 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.174 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  5 (0x05)
    problem: Command 0x05 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.174 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  0 (0x00)
    problem: Command 0x00 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.175 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  1 (0x01)
    problem: Command 0x01 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.175 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  2 (0x02)
    problem: Command 0x02 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.175 INFO 
Problem: ProblemSeverity.ERROR
    test_name: IDM-10.2
    location: 
       Endpoint: 17,
       Cluster:  4 (0x04) Groups
       Command:  3 (0x03)
    problem: Command 0x03 is required, but is not present on the DUT. Conformance: M, implemented features: GN
    spec_location: 

[MatterTest] 08-25 12:22:52.176 INFO ###########################################################
[MatterTest] 08-25 12:22:52.177 INFO Summary for test class TC_DeviceConformance: Error 0, Executed 1, Failed 1, Passed 0, Requested 1, Skipped 0
[MatterTest] 08-25 12:22:52.179 INFO Summary for test run MatterTest@08-25-2025_12-22-20-576:
Total time elapsed 31.552026929042768s
Artifacts are saved in "/tmp/matter_testing/logs/MatterTest/08-25-2025_12-22-20-576"
Test summary saved in "/tmp/matter_testing/logs/MatterTest/08-25-2025_12-22-20-576/test_summary.yaml"
Test results: Error 0, Executed 1, Failed 1, Passed 0, Requested 1, Skipped 0

According to this, there are multiple attributes that are included on your device, but that are disallowed by conformance.

Please verify that you have all the required PICS, that they conform to the specification for the Matter version you are using, and that you have provided all of them to the Test Harness. You need to provide Base.xml and PICS for each cluster implemented on the device. We have example PICS for the Matter Weather Station, which you can take a look at: https://github.com/nrfconnect/sdk-nrf/tree/v2.1.4/applications/matter_weather_station/certification/PICS. These PICS are from nRF Connect SDK v2.1.4, so they are a few years old, but it is just to give a general idea of what files you need, etc.

Best regards,
Marte

[xiongwei.wang]

Hi Marte,

Thank you very much for your help once again. You are very experienced. As I am new to the Matter Test Harness, please forgive me for not noticing the issues you pointed out earlier. I will look into this tomorrow.

Thanks again.

Best regards,

Xiongwei.Wang

[Marte Myrvold]

Hi,

No problem! Let me know what you find and if you have any issues.

Best regards,
Marte