Matter，Test harness，When testing the UI-python project with the test harness, may encounter a failure message indicating a timeout.

RE: Matter，Test harness，When testing the UI-python project with the test harness, may encounter a failure message indicating a timeout.

Amanda Hsieh — Mon, 28 Oct 2024 18:44:23 GMT

Don't know what is the reason for the failure, however, if the test case validates the device type composition (what clusters need to be enabled on the app endpoint), you should follow the requirement defined in the device type libraries specification and choose proper for your device type.

RE: Matter，Test harness，When testing the UI-python project with the test harness, may encounter a failure message indicating a timeout.

DoubleAmaing — Wed, 23 Oct 2024 02:05:28 GMT

Hi, thanks for your reply.
1. I'm using TestHarness auto-test "TC-IDM-10.4
So, I don't know how to specify test endpoint 1.

Please teach me how to configure. Thank you

{
  "config": {
    "network": {
      "wifi": {
        "ssid": "testharness",
        "password": "wifi-password"
      },
      "thread": {
        "rcp_serial_path": "/dev/ttyACM0",
        "rcp_baudrate": 115200,
        "on_mesh_prefix": "fd15:35::/64",
        "network_interface": "eth0",
        "dataset": {
          "channel": "25",
          "panid": "0x2b35",
          "extpanid": "2b35dead5b35beef",
          "networkkey": "67892233445566778899aabbccdd5612",
          "networkname": "2b35"
        },
        "otbr_docker_image": null
      }
    },
    "dut_config": {
      "discriminator": "3210",
      "setup_code": "40634394",
      "pairing_mode": "ble-thread",
      "chip_timeout": null,
      "chip_use_paa_certs": true,
      "trace_log": true
    },
    "test_parameters": {
      "thread-dataset-hex": "0e08000000000001000035060004001fffe00708fd893173e1f042310410a2ed118932f24f8542b385fe51523d5a0c0402a0f7f8000300001901022b3502082b35dead5b35beef030432623335051067892233445566778899aabbccdd5612",
      "paa-trust-store-path": "/paa-root-certs",
      "manual-code": "30207424805"
    }
  },
  "pics": {
    "clusters": {
      "Level Control Cluster Test Plan": {
        "name": "Level Control Cluster Test Plan",
        "items": {
          "LVL.S": {
            "number": "LVL.S",
            "enabled": true
          },
          "LVL.S.A0000": {
            "number": "LVL.S.A0000",
            "enabled": true
          },
          "LVL.S.A0001": {
            "number": "LVL.S.A0001",
            "enabled": true
          },
          "LVL.S.A0002": {
            "number": "LVL.S.A0002",
            "enabled": true
          },
          "LVL.S.A0003": {
            "number": "LVL.S.A0003",
            "enabled": true
          },
          "LVL.S.A0004": {
            "number": "LVL.S.A0004",
            "enabled": false
          },
          "LVL.S.A0005": {
            "number": "LVL.S.A0005",
            "enabled": false
          },
          "LVL.S.A0006": {
            "number": "LVL.S.A0006",
            "enabled": false
          },
          "LVL.S.A000f": {
            "number": "LVL.S.A000f",
            "enabled": true
          },
          "LVL.S.A0010": {
            "number": "LVL.S.A0010",
            "enabled": true
          },
          "LVL.S.A0011": {
            "number": "LVL.S.A0011",
            "enabled": true
          },
          "LVL.S.A0012": {
            "number": "LVL.S.A0012",
            "enabled": true
          },
          "LVL.S.A0013": {
            "number": "LVL.S.A0013",
            "enabled": true
          },
          "LVL.S.A0014": {
            "number": "LVL.S.A0014",
            "enabled": true
          },
          "LVL.S.A4000": {
            "number": "LVL.S.A4000",
            "enabled": true
          },
          "LVL.S.C00.Rsp": {
            "number": "LVL.S.C00.Rsp",
            "enabled": true
          },
          "LVL.S.C01.Rsp": {
            "number": "LVL.S.C01.Rsp",
            "enabled": true
          },
          "LVL.S.C02.Rsp": {
            "number": "LVL.S.C02.Rsp",
            "enabled": true
          },
          "LVL.S.C03.Rsp": {
            "number": "LVL.S.C03.Rsp",
            "enabled": true
          },
          "LVL.S.C04.Rsp": {
            "number": "LVL.S.C04.Rsp",
            "enabled": true
          },
          "LVL.S.C05.Rsp": {
            "number": "LVL.S.C05.Rsp",
            "enabled": true
          },
          "LVL.S.C06.Rsp": {
            "number": "LVL.S.C06.Rsp",
            "enabled": true
          },
          "LVL.S.C07.Rsp": {
            "number": "LVL.S.C07.Rsp",
            "enabled": true
          },
          "LVL.S.C08.Rsp": {
            "number": "LVL.S.C08.Rsp",
            "enabled": false
          },
          "LVL.S.F00": {
            "number": "LVL.S.F00",
            "enabled": true
          },
          "LVL.S.F01": {
            "number": "LVL.S.F01",
            "enabled": true
          },
          "LVL.S.F02": {
            "number": "LVL.S.F02",
            "enabled": false
          },
          "LVL.S.M.VarRate": {
            "number": "LVL.S.M.VarRate",
            "enabled": true
          }
        }
      }
    }
  }
}

2. Do I have to enable a server or client? Can I not choose？

RE: Matter，Test harness，When testing the UI-python project with the test harness, may encounter a failure message indicating a timeout.

Amanda Hsieh — Tue, 22 Oct 2024 18:41:19 GMT

1. You need to divide for this test case desperately PICS for Endpoint 0 and for Endpoint 1 in different project configurations in TH and run it for each endpoint to be sure to expected result.

2. It depends on your implementation of the device as a client or server.

RE: Matter，Test harness，When testing the UI-python project with the test harness, may encounter a failure message indicating a timeout.

DoubleAmaing — Tue, 22 Oct 2024 08:47:04 GMT

Hi, Expert:
I understand the first question, it turned out to be to test endpoint:0, LevelControl Cluster I implemented in endpoint 1, how should I modify the PICS file? I didn't find the relevant modifications

2. As a DUT, DUT is a "Lighting", do I need to enable "Server", it's an optional property, can I not enable it?

Do I need to configure it as a server in the program?

RE: Matter，Test harness，When testing the UI-python project with the test harness, may encounter a failure message indicating a timeout.

DoubleAmaing — Tue, 22 Oct 2024 08:04:26 GMT

Hello
Thanks for the reply, I know the problem and solved it, but there are a lot of bugs in the UI-Python test, please help me again。

1. I test "TC-IDM-10.4“，The error appears in "For every cluster present in the spec, for every feature in the cluster"。

The error message is as follows：

devzone.nordicsemi.com/.../TC_2D00_IDM_2D00_10_2D00_4_5F00_2024_5F00_10_5F00_22_5F00_15_5F00_37_5F00_52.log

example：
”Endpoint: 0, Cluster: 8 (0x08) LevelControl, Attribute:0 (0x00) problem: PICS LVL.S.A0000 found in PICS list, but not on device spec_location: [MatterTest] 10-22 07:39:16.198 INFO Problem: ProblemSeverity.ERROR test_name: PICS check location: Endpoint: 0, Cluster: 8 (0x08) LevelControl, Attribute:1 (0x01) problem: PICS LVL.S.A0001 found in PICS list, but not on device spec_location: [MatterTest] 10-22 07:39:16.199 INFO Problem: “

These commands are enabled on DUT, why do I get this error?？？？？？？？

Here's what I read by command, it's there： ”./chip-tool levelcontrol read attribute-list 1 1“

2. As a DUT, DUT is a "Lighting", do I need to enable "Server", it's an optional property, can I not enable it?

Do I need to configure it as a server in the program?

RE: Matter，Test harness，When testing the UI-python project with the test harness, may encounter a failure message indicating a timeout.

Amanda Hsieh — Wed, 16 Oct 2024 12:37:02 GMT

Hi,

Logs from the Python test are cut, or some of the logs are not captured, so I don't know what the issue is with the logs.

After running the test case, you can try to take the logs from the backend docker to have more information.

to get the the logs let the client check the name of the backend docker docker ps

and get the logs docker logs <name_of_backend_docker_conainter>

Regards,
Amanda H.