Generation of .matter files from .zap files

RE: Generation of .matter files from .zap files

mlampacher — Wed, 03 Apr 2024 13:22:31 GMT

Thanks for the explanation! Yeah, I've added a little CMake target to generate the `.matter` file, it's straight-forward enough. I just found it very confusing that this is not part of the `chip_configure_data_model` already.

I'm very happy that Nordic integrated the `chip` project, that's huge, great work!

RE: Generation of .matter files from .zap files

Amanda Hsieh — Wed, 03 Apr 2024 12:51:01 GMT

Hi,

[quote user=""]what is the reason why the samples use "BYPASS_IDL"?[/quote]

We use "BYPAS_IDL" in CMakeList.txt files because we decided to use static device-related Matter Data Model configuration in our samples. What does it mean? In the Matter Upstream repository, all Data Model files are generated dynamically utilizing ZAP tool while building an application. There are common .zap files for all samples and they have enabled all possible options. This approach requires the newest ZAP tool frequently, so users need to take care of it. In NCS samples we bypassed those operations, and we generated all Data Model configurations to the zap_generated directory within each sample and in this way, users don't need to update ZAP within the same NCS revision, and also we removed many unnecessary options from samples .zapfiles, and thanks to that we reduced the code size. Moreover, after bypassing those Data Model files are not generated during the building anymore.

[quote user="mlampacher"] I couldn't find a single step where the .matter file would be generated.[/quote]

To generate Data Model files, they can follow the instructions from here: https://developer.nordicsemi.com/nRF_Connect_SDK/doc/2.6.0/nrf/protocols/matter/getting_started/adding_clusters.html#edit-clusters-using-the-zap-tool or use the following command to re-generate the .matter file only (from NCS main directory):

./modules/lib/matter/scripts/tools/zap/generate.py -o zap-gen-dir zap-file

Where zap-gen-dir is the directory where .matter file will be stored into, and zap-file is the source .zapfile.Also it is worth mention, that they need to remove "zap" temporary directory to avoid many problems with zap tool":Please read the note under that section: https://developer.nordicsemi.com/nRF_Connect_SDK/doc/2.6.0/nrf/protocols/matter/getting_started/adding_clusters.html#edit-clusters-using-the-zap-tool

Regards,
Amanda H.

RE: Generation of .matter files from .zap files

mlampacher — Fri, 29 Mar 2024 08:19:20 GMT

I had a deeper look into ZAP and the generator scripts and I guess I came to the same conclusion as you did:

The CMake integration of the Matter project does not have any targets to generate the .matter file from the .zap file (yet).
The chip_codegen.cmake, however, assumes that a .matter file is used (with the same name as the .zap input file, except for the file type) as input for the generate.py script.
Therefore, it is anyhow always necessary to trigger the code generation either via ZAP's GUI or call generate.py elsewhere.
Thus the code generation provided by the CMake integration may as well be skipped altogether (it is also very rare to update the .zap file and virtually impossible to forget generating the files since otherwise nothing will work anyhow), also saving some compile/configuration time.

I'm still a bit unsure why the Matter project uses a .matter file even though the same information is present in the .zap file, which for now is always present (and can be used with generate.py to generate the correct set of files, also shown in your documentation for adding a cluster to the example application).

They mention in their codegen documentation that they "strive to make them contain only Matter-specific data" and that the "codegen.py" has less dependencies (but currently also doesn't generate the full set of required files (?)) and that linting of .matter files is possible.

I guess it's still a lot of "work in progress". Due to the large amount of scripts and their awkward path handling (e.g., assuming either absolute paths or paths relative to the Matter root directory as parameters) this is currently still very confusing.

They also mention that "Currently .matter files are generated from .zap files during the application specific codegen." but that is not true for the CMake integration - or at least I couldn't find a single step where the .matter file would be generated.

RE: Generation of .matter files from .zap files

mlampacher — Thu, 28 Mar 2024 14:34:59 GMT

Happy Easter!

RE: Generation of .matter files from .zap files

Amanda Hsieh — Thu, 28 Mar 2024 14:12:02 GMT

Hi,

Due to the Easter holidays in Norway, we are less staffed than usual. You can expect an answer sometime next week,

Sorry for the inconvenience and thanks for your patience.

Regards,
Amanda