During the R&D phase, the testing of the Matter certification items failed

Hi,

    During the initial screening of Matter certification during the R&D phase, it was found that several test items did not pass the test. Could you please help investigate the possible reasons for this。Failed items such as below PDF documents.

ncs 3.0.2

    0552.Test Report.pdf

2627.UI_Test_Run_2025_12_24_09_31_08.zip

Parents
  • Hello, 

    TC_IDM_10_2 fails because of a disallowed attribute (0x08) for the NetworkCommissioning (0x31) cluster: 

    [MatterTest] 12-24 09:32:16.457 INFO [Test] test_TC_IDM_10_2 FAIL
    [MatterTest] 12-24 09:32:16.465 INFO ###########################################################
    [MatterTest] 12-24 09:32:16.465 INFO Problems found:
    [MatterTest] 12-24 09:32:16.465 INFO ===============
    [MatterTest] 12-24 09:32:16.466 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: IDM-10.2
        location: 
           Endpoint: 0,
           Cluster:  49 (0x31) NetworkCommissioning
          Attribute:8 (0x08)
        problem: Attribute 0x08 is included, but is disallowed by conformance. Conformance: WI, implemented features: TH
        spec_location: 

    TC_IDM_10_3 fails because of mismatched revision numbers for the PowerSource cluster and the expected revision. 

    [MatterTest] 12-24 09:33:30.147 INFO [Test] test_TC_IDM_10_3 FAIL
    [MatterTest] 12-24 09:33:30.154 INFO ###########################################################
    [MatterTest] 12-24 09:33:30.154 INFO Problems found:
    [MatterTest] 12-24 09:33:30.155 INFO ===============
    [MatterTest] 12-24 09:33:30.155 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: IDM-10.3
        location: 
           Endpoint: 1,
           Cluster:  47 (0x2f) PowerSource
          Attribute:65533 (0xfffd)
        problem: Revision found on cluster (1) does not match revision listed in the spec (3)
        spec_location: 

    From what I can tell, TC_IDM_10_4 fails because the PICS file is not populated correctly. There are many missing elements, that is the below copied from your test logs: 

    [MatterTest] 12-24 09:34:32.737 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  43 (0x2b) LocalizationConfiguration
        problem: An element found on the device, but the corresponding PICS LCFG.S was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.737 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  46 (0x2e) PowerSourceConfiguration
        problem: PICS PSCFG.S found in PICS list, but not on device
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.738 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  50 (0x32) DiagnosticLogs
        problem: An element found on the device, but the corresponding PICS DLOG.S was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.738 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  52 (0x34) SoftwareDiagnostics
        problem: An element found on the device, but the corresponding PICS DGSW.S was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.739 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  31 (0x1f) AccessControl
          Attribute:1 (0x01)
        problem: An element found on the device, but the corresponding PICS ACL.S.A0001 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.739 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  40 (0x28) BasicInformation
          Attribute:11 (0x0b)
        problem: An element found on the device, but the corresponding PICS BINFO.S.A000b was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.739 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  40 (0x28) BasicInformation
          Attribute:20 (0x14)
        problem: PICS BINFO.S.A0014 found in PICS list, but not on device
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.740 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  43 (0x2b) LocalizationConfiguration
          Attribute:0 (0x00)
        problem: An element found on the device, but the corresponding PICS LCFG.S.A0000 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.740 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  43 (0x2b) LocalizationConfiguration
          Attribute:1 (0x01)
        problem: An element found on the device, but the corresponding PICS LCFG.S.A0001 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.740 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  46 (0x2e) PowerSourceConfiguration
          Attribute:0 (0x00)
        problem: PICS PSCFG.S.A0000 found in PICS list, but not on device
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.741 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  51 (0x33) GeneralDiagnostics
          Attribute:3 (0x03)
        problem: An element found on the device, but the corresponding PICS DGGEN.S.A0003 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.741 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  51 (0x33) GeneralDiagnostics
          Attribute:4 (0x04)
        problem: An element found on the device, but the corresponding PICS DGGEN.S.A0004 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.741 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  52 (0x34) SoftwareDiagnostics
          Attribute:1 (0x01)
        problem: An element found on the device, but the corresponding PICS DGSW.S.A0001 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.742 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  52 (0x34) SoftwareDiagnostics
          Attribute:2 (0x02)
        problem: An element found on the device, but the corresponding PICS DGSW.S.A0002 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.742 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  50 (0x32) DiagnosticLogs
           Command:  0 (0x00)
        problem: An element found on the device, but the corresponding PICS DLOG.S.C00.Rsp was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.742 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  60 (0x3c) AdministratorCommissioning
           Command:  1 (0x01)
        problem: An element found on the device, but the corresponding PICS CADMIN.S.C01.Rsp was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.743 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  50 (0x32) DiagnosticLogs
           Command:  1 (0x01)
        problem: An element found on the device, but the corresponding PICS DLOG.S.C01.Tx was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.743 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  31 (0x1f) AccessControl
           Feature:  EXTS
        problem: An element found on the device, but the corresponding PICS ACL.S.F00 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.743 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  60 (0x3c) AdministratorCommissioning
           Feature:  BC
        problem: An element found on the device, but the corresponding PICS CADMIN.S.F00 was not found in pics list
        spec_location: 
    

    Please let me know  if you have verified that your PICS file matches the functionality you have for your device. 

    Best regards,

    Maria

Reply
  • Hello, 

    TC_IDM_10_2 fails because of a disallowed attribute (0x08) for the NetworkCommissioning (0x31) cluster: 

    [MatterTest] 12-24 09:32:16.457 INFO [Test] test_TC_IDM_10_2 FAIL
    [MatterTest] 12-24 09:32:16.465 INFO ###########################################################
    [MatterTest] 12-24 09:32:16.465 INFO Problems found:
    [MatterTest] 12-24 09:32:16.465 INFO ===============
    [MatterTest] 12-24 09:32:16.466 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: IDM-10.2
        location: 
           Endpoint: 0,
           Cluster:  49 (0x31) NetworkCommissioning
          Attribute:8 (0x08)
        problem: Attribute 0x08 is included, but is disallowed by conformance. Conformance: WI, implemented features: TH
        spec_location: 

    TC_IDM_10_3 fails because of mismatched revision numbers for the PowerSource cluster and the expected revision. 

    [MatterTest] 12-24 09:33:30.147 INFO [Test] test_TC_IDM_10_3 FAIL
    [MatterTest] 12-24 09:33:30.154 INFO ###########################################################
    [MatterTest] 12-24 09:33:30.154 INFO Problems found:
    [MatterTest] 12-24 09:33:30.155 INFO ===============
    [MatterTest] 12-24 09:33:30.155 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: IDM-10.3
        location: 
           Endpoint: 1,
           Cluster:  47 (0x2f) PowerSource
          Attribute:65533 (0xfffd)
        problem: Revision found on cluster (1) does not match revision listed in the spec (3)
        spec_location: 

    From what I can tell, TC_IDM_10_4 fails because the PICS file is not populated correctly. There are many missing elements, that is the below copied from your test logs: 

    [MatterTest] 12-24 09:34:32.737 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  43 (0x2b) LocalizationConfiguration
        problem: An element found on the device, but the corresponding PICS LCFG.S was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.737 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  46 (0x2e) PowerSourceConfiguration
        problem: PICS PSCFG.S found in PICS list, but not on device
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.738 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  50 (0x32) DiagnosticLogs
        problem: An element found on the device, but the corresponding PICS DLOG.S was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.738 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  52 (0x34) SoftwareDiagnostics
        problem: An element found on the device, but the corresponding PICS DGSW.S was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.739 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  31 (0x1f) AccessControl
          Attribute:1 (0x01)
        problem: An element found on the device, but the corresponding PICS ACL.S.A0001 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.739 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  40 (0x28) BasicInformation
          Attribute:11 (0x0b)
        problem: An element found on the device, but the corresponding PICS BINFO.S.A000b was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.739 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  40 (0x28) BasicInformation
          Attribute:20 (0x14)
        problem: PICS BINFO.S.A0014 found in PICS list, but not on device
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.740 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  43 (0x2b) LocalizationConfiguration
          Attribute:0 (0x00)
        problem: An element found on the device, but the corresponding PICS LCFG.S.A0000 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.740 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  43 (0x2b) LocalizationConfiguration
          Attribute:1 (0x01)
        problem: An element found on the device, but the corresponding PICS LCFG.S.A0001 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.740 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  46 (0x2e) PowerSourceConfiguration
          Attribute:0 (0x00)
        problem: PICS PSCFG.S.A0000 found in PICS list, but not on device
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.741 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  51 (0x33) GeneralDiagnostics
          Attribute:3 (0x03)
        problem: An element found on the device, but the corresponding PICS DGGEN.S.A0003 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.741 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  51 (0x33) GeneralDiagnostics
          Attribute:4 (0x04)
        problem: An element found on the device, but the corresponding PICS DGGEN.S.A0004 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.741 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  52 (0x34) SoftwareDiagnostics
          Attribute:1 (0x01)
        problem: An element found on the device, but the corresponding PICS DGSW.S.A0001 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.742 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  52 (0x34) SoftwareDiagnostics
          Attribute:2 (0x02)
        problem: An element found on the device, but the corresponding PICS DGSW.S.A0002 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.742 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  50 (0x32) DiagnosticLogs
           Command:  0 (0x00)
        problem: An element found on the device, but the corresponding PICS DLOG.S.C00.Rsp was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.742 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  60 (0x3c) AdministratorCommissioning
           Command:  1 (0x01)
        problem: An element found on the device, but the corresponding PICS CADMIN.S.C01.Rsp was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.743 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  50 (0x32) DiagnosticLogs
           Command:  1 (0x01)
        problem: An element found on the device, but the corresponding PICS DLOG.S.C01.Tx was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.743 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  31 (0x1f) AccessControl
           Feature:  EXTS
        problem: An element found on the device, but the corresponding PICS ACL.S.F00 was not found in pics list
        spec_location: 
    
    [MatterTest] 12-24 09:34:32.743 INFO 
    Problem: ProblemSeverity.ERROR
        test_name: PICS check
        location: 
           Endpoint: 0,
           Cluster:  60 (0x3c) AdministratorCommissioning
           Feature:  BC
        problem: An element found on the device, but the corresponding PICS CADMIN.S.F00 was not found in pics list
        spec_location: 
    

    Please let me know  if you have verified that your PICS file matches the functionality you have for your device. 

    Best regards,

    Maria

Children
No Data
Related