Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Hieu — Sat, 09 Aug 2025 23:12:27 GMT

Hi chew_moon_cake,

Could you please provide more details?

We need to have logs from border router to check what "not properly" started.

If the Border Router (BR) is started by the Test harness, you can check if the srp server is running on the Border Router with:

docker exec -ti <otbr_container> ot-ctl srp server state

If the srp server is not running, you can enable it with:

docker exec -ti <otbr_container> ot-ctl srp server enable

If the Border Router is not started by the Test Harness, you can start it on your own.
For example, you can start it with the script in certification-tool/backend/test_collections/matter/scripts/OTBR/.

If the Border Router is on a separated device from the Test Harness, that also works.

On the Border Router, you need to get the dataset hex with

dataset active -x

Then please set the dataset hex in the project config in the Test Harness at these locations:

"test_parameters": {
    ...
    "thread-dataset-hex":  <output_of_dataset_active_x>
}

and

"thread": {
    "operational_dataset_hex": <output_of_dataset_active_x>
}

Hieu

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Hieu — Fri, 08 Aug 2025 11:29:42 GMT

Hi chew_moon_cake,

I just want to update you that Maria is out of office. I tried to resume her internal communication thread, but there hasn't been any feedback yet.

Another of our engineer with more Matter experience is returning next week. I will try to loop her in and see if she can help better.

Our apologies for the inconvenience. Thank you for your patience.

Hieu

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

chew_moon_cake — Thu, 31 Jul 2025 02:11:07 GMT

Hi Maria.

Yes, the summary is correct. And any update of this issue? thanks

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Maria Gilje — Tue, 15 Jul 2025 12:08:40 GMT

Hi,

Is this a good and correct summary of your issue? I'll forward it internally.

Failing test cases: TC-DGGEN-2.1, TC-ACE-2.2.

Error: Test Suite Error: Error occurred during setup of test suite.FirstChipToolSuite. Border router does not start properly for nrfconnect/otbr:9185bda

HW: nRF52840 DK

FW: Light bulb, nRF Connect SDK v2.9.2

OTBR: Pi4 (Ubuntu Server 24.04.2 LTS (64-bit)) + nrf52840 dongle as RCP (FW: otbr_9185bda_nrf52840dongle_ncs_2_4_3_1_1.4.zip from CSA link)

Best regards,

Maria

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

chew_moon_cake — Fri, 11 Jul 2025 06:45:10 GMT

Hi Maria,

Thanks.

But it still has the same issue after rewrite the RCP FW. （nrf52840 RCP FW: otbr_9185bda_nrf52840dongle_ncs_2_4_3_1_1.4.zip (download from csa link)）

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Maria Gilje — Fri, 11 Jul 2025 05:42:29 GMT

I found this issue on GitHub: https://github.com/project-chip/certification-tool/issues/250

It mentions to rewrite the RCP FW. I'm not sure if that means to edit the RCP FW or to just reprogram it to the board. Please try to reprogram the board first.

Best regards,

Maria

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

chew_moon_cake — Thu, 10 Jul 2025 09:58:59 GMT

Hi, Maria.

But My OTBR+RCP is still Matter 1.4.0. So I didn't update.

By the way, Other case like TC-ACE-1.3, TC-ACE-2.1, TC-ACL-2.2 can pass.

and TC-ACE-2.2 also has the same issue with TC-DGGEN-2.1

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Maria Gilje — Thu, 10 Jul 2025 09:39:36 GMT

Hello,

[quote user="chew_moon_cake"]Thanks, I updated my DUT_nrf52840 DK(bulb) to Matter 1.4.0, But it still fail.[/quote][quote user="chew_moon_cake"]

OTBR: Pi4 (Ubuntu Server 24.04.2 LTS (64-bit)) + nrf52840 dongle as RCP.

nrf52840 RCP FW: otbr_9185bda_nrf52840dongle_ncs_2_4_3_1_1.4.zip (download from csa link)

[/quote]

Did you also update the OTBR and RCP?

Best regards,

Maria

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

chew_moon_cake — Thu, 10 Jul 2025 09:08:52 GMT

Hi Maria.

Thanks, I updated my DUT_nrf52840 DK(bulb) to Matter 1.4.0, But it still fail.

And the Error Log Info like this: （can't upload full log）

PICS_USER_PROMPT=1' > /var/tmp/pics"
INFO | 2025-07-10 08:43:47.980035 | Commission DUT
INFO | 2025-07-10 08:43:47.981479 | User prompt: "Make sure the DUT is in Commissioning Mode"
INFO | 2025-07-10 08:43:50.184120 | User chose prompt option DONE
ERROR | 2025-07-10 08:44:11.695135 | Test Suite Error: Error occurred during setup of test suite.FirstChipToolSuite. Border router does not start properly for nrfconnect/otbr:9185bda
INFO | 2025-07-10 08:44:11.697158 | Cancel test step
INFO | 2025-07-10 08:44:11.707305 | Cancel test step

Before I run TC-DGGEN-2.1， I check OTBR status is leader, But after run TC-DGGEN-2.1, the OTBR status become "Connect session failed: connection refuse".

I check via below cmd:

docker exec -it otbr-chip bash

ot-ctl state

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Maria Gilje — Wed, 18 Jun 2025 09:15:20 GMT

Hi,

Matter 1.4.0 is supported by nRF Connect SDK v2.9.0-v2.9.2 and Matter 1.4.1 is supported from v3.0.0.

This is the same table as in my previous reply, but I changed the documentation version to the latest one to get the latest information.

Best regards,

Maria

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

chew_moon_cake — Wed, 18 Jun 2025 07:31:31 GMT

Hi Maria.

Thanks for your answer.

By the way, where can I get the nRF SDK supported matter 1.4？

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Maria Gilje — Tue, 17 Jun 2025 11:45:44 GMT

Hi,

I got feedback on my internal ticket. Since the DUT succeeds commissioning in other test cases, the likely explanation is that there is something wrong with the border router or the test harness.

I see that you are using TH v2.11+fall2024 which is for Matter v1.4, but for nRF Connect SDK v2.8.0, Matter 1.3.0 is supported.

The table is from here: https://docs.nordicsemi.com/bundle/ncs-2.8.0/page/nrf/protocols/matter/index.html

Try to run TH v2.10.2+spring2024 instead and let me know if this helps.

Best regards,

Maria

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Maria Gilje — Fri, 13 Jun 2025 12:57:29 GMT

Hi,

Thank you for the extra information. I have posted a ticket internally to get some advice. I expect to check back in with you by the end of June 17th.

Best regards,

Maria

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

chew_moon_cake — Fri, 13 Jun 2025 10:55:35 GMT

Hi Maria.

update the latest status:

Auto commission fail only happened in TC-DGGEN-2.1

I try run TC-ACL-2.4, TC-CGEN-2.1, TC-CGEN-2.4, TC-DESC-2.2, it can all pass.

could you give me some advices for TC-DGGEN-2.1?

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

chew_moon_cake — Fri, 13 Jun 2025 01:02:46 GMT

DUT：nrf52840 DK, FW: NCS 2.8.0 -> Bulb

OTBR: Pi4 (Ubuntu Server 24.04.2 LTS (64-bit)) + nrf52840 dongle as RCP.

nrf52840 RCP FW: otbr_9185bda_nrf52840dongle_ncs_2_4_3_1_1.4.zip (download from csa link)

https://groups.csa-iot.org/wg/members-all/document/folder/4120

TH: v2.11+fall2024

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

Maria Gilje — Thu, 12 Jun 2025 15:29:55 GMT

Hello,

Which nRF Connect SDK version are you using?

Also as a side note: When posting many lines of logs or code, please use the Insert->Code feature (or upload it as a file like you did with the test log).

Best regards,

Maria

RE: Run Matter Certification case TC-DGGEN-2.1 can't auto commission success

chew_moon_cake — Thu, 12 Jun 2025 10:24:49 GMT

after commission fail, I input below cmd:

docker exec -it otbr-chip bash

root@ubunbtu:/app# ot-ctl state

connect session failed: Connection refused （error info）

but it display like this before I run this case. Why?

root@ubunbtu:/app# ot-ctl state
leader
Done