Integration of PDM microphone with thingy53

RE: Integration of PDM microphone with thingy53

ovrebekk — Mon, 04 Mar 2024 12:43:35 GMT

Hi Rakshita

In order to configure the microphone you need to use the vesper, vm3011 driver and configure it over the I2C interface. The snoring example I shared earlier shows you how you can set this up in the overlay, but unfortunately this driver is not available in the official Zephyr repository. Instead it is provided here as part of the EdgeImpulse fork of the SDK.

Do you know how to merge this driver from one SDK to another, so that you can use it from the nRF Connect SDK?

If not I can try to provide a patch making this process easier.

Best regards
Torbjørn

RE: Integration of PDM microphone with thingy53

Rakshita — Thu, 29 Feb 2024 08:18:32 GMT

If some sound is also detected there should be a threshold value right to compare so how is that decided

RE: Integration of PDM microphone with thingy53

Rakshita — Thu, 29 Feb 2024 05:25:37 GMT

And what about this
RMS value: 43.991271
RMS value: 54.246826
RMS value: 75.447407
RMS value: 97.405862
RMS value: 99.503123
RMS value: 99.571268
RMS value: 478.356399
RMS value: 492.462257
RMS value: 501.362197
RMS value: 502.130812
RMS value: 491.400654
RMS value: 473.611738

RE: Integration of PDM microphone with thingy53

Rakshita — Thu, 29 Feb 2024 05:20:41 GMT

devzone.nordicsemi.com/.../0456.microphone.zip

RE: Integration of PDM microphone with thingy53

Rakshita — Thu, 29 Feb 2024 05:16:43 GMT

So should I change the gain value?

RE: Integration of PDM microphone with thingy53

ovrebekk — Wed, 28 Feb 2024 14:46:25 GMT

[quote user="Rakshita"]Can u tell me how to attach a zip file[/quote]

You can just drag drop a file into the reply window. Alternatively you can click on Insert -> Image/Video/File

[quote user="Rakshita"]I went through the snoring example and added the necessary files into my code so right now getting the attached below result[/quote]

This looks like real audio data to me, just very low amplitude. You would expect values that oscillate between positive and negative values, like in your log.

I also did a quick test changing my modified dmic sample to use the proper PDM pins, and I seem to get valid audio data as well (but I haven't verified this properly by playing the audio back).

Best regards
Torbjørn

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 13:49:00 GMT

[00:00:03.110,351] <inf> NRFX_PDM: Function: nrfx_pdm_start, error code: NRFX_SUCCESS.
TRUE 
  17,    b,    7,    b,   14, ffe9,   2c,    6, 
ffc0,    8,   49,   1d,   36,   5d,    6, ffc8, 
[00:00:04.111,877] <inf> NRFX_PDM: Function: nrfx_pdm_start, error code: NRFX_SUCCESS.
TRUE 
  24,   18,    5,    1,    4,   18,   21,   1a, 
   3,    5,    3,    5,    e,   13,    a,   10, 
[00:00:05.113,494] <inf> NRFX_PDM: Function: nrfx_pdm_start, error code: NRFX_SUCCESS.
TRUE 
  53,   2a,   2e,   1d,    b, ffed, ffdd, ffd8, 
   9, fffe, fffe,    8, fffe,    9,    5, ffff, 
[00:00:06.115,020] <inf> NRFX_PDM: Function: nrfx_pdm_start, error code: NRFX_SUCCESS.
TRUE 
   b,    9,    f,   36,   4f,   44,   3b,   15, 
  1c,   1d,   14,    e,    6,    7, fffa,    2, 
[00:00:07.116,607] <inf> NRFX_PDM: Function: nrfx_pdm_start, error code: NRFX_SUCCESS.
TRUE 
ffda, ffd1, ffdd, ffb4, ff98, ffad, ffde, ffc3, 
   6,   25,   34,   21,   12, fff2, ffdb, ffcf, 
[00:00:08.118,164] <inf> NRFX_PDM: Function: nrfx_pdm_start, error code: NRFX_SUCCESS.
TRUE 
ffc0, ffd5,    3,   13,   2c,   1d,   15,   10, 
ffb6, ffa0, ffbb, ffcb, ffbc, ffc0, ffd2, ffbb, 
[00:00:09.119,750] <inf> NRFX_PDM: Function: nrfx_pdm_start, error code: NRFX_SUCCESS.
TRUE

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 13:48:22 GMT

I went through the snoring example and added the necessary files into my code so right now getting the attached below result

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 13:20:56 GMT

Can u tell me how to attach a zip file

RE: Integration of PDM microphone with thingy53

ovrebekk — Wed, 28 Feb 2024 12:56:04 GMT

Hi Rakshita

Sure, please share your code. I will take a look at that before attempting to create a new example.

Best regards
Torbjørn

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 12:40:37 GMT

No issues
If u say I can send u the code on which I was trying to enable microphone

RE: Integration of PDM microphone with thingy53

ovrebekk — Wed, 28 Feb 2024 12:37:51 GMT

Hi Rakshita

[quote user="Rakshita"]Also I didn't get that why u configured the clk and data pin on 8 and 9 because as per the datasheet the clk is at gpio1, 9th pin and data is at gpio0, 27th pin[/quote]

My mistake. I incorrectly assumed you were connecting to an external PDM mic, not the one included in the Thingy53.

I found a project on github where they use the internal mic for a machine learning application, possibly you could get some inspiration there?
https://github.com/metanav/thingy53_snoring_detection/blob/main/src/sensors/ei_microphone.cpp

In the mean time I will try to set up a small example using the internal mic on the Thingy53 and share it with you, but I don't think I will have time to complete this today unfortunately. I will try to get back to you tomorrow.

Best regards
Torbjørn

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 10:32:56 GMT

Also if I send u the code which was based on nrfx pdm driver can u help me with that as I have been working on that code for a long time and still not able to get that what is the issue

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 10:31:48 GMT

Actually I was trying to build the code which u send me, than I added the actual dmic sample code which is available in zephyr it got builded but not able to understand the code at all, I dont know even that pdm clock is working or not
Also I didn't get that why u configured the clk and data pin on 8 and 9 because as per the datasheet the clk is at gpio1, 9th pin and data is at gpio0, 27th pin

RE: Integration of PDM microphone with thingy53

ovrebekk — Wed, 28 Feb 2024 09:40:42 GMT

[quote user="Rakshita"]In main.c file dmic_dev is actually not present in common.dtsi file so did u added it externally[/quote]

Yes, I added this in the overlay files in the board folder of the example I sent you:

dmic_dev: &pdm0 {
	status = "okay";
	pinctrl-0 = <&pdm0_default_alt>;
	pinctrl-names = "default";
	clock-source = "ACLK";
};

[quote user="Rakshita"]

There is also an error in main function

Can u please help me out to solve it

[/quote]

Could you zip your example and attach it to the case? Then I will try to build it and see if I can spot the issue.

Best regards
Torbjørn

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 09:19:49 GMT

In main.c file dmic_dev is actually not present in common.dtsi file so did u added it externally

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 09:10:37 GMT

There is also an error in main function

Can u please help me out to solve it

RE: Integration of PDM microphone with thingy53

Rakshita — Wed, 28 Feb 2024 05:48:54 GMT

Can you tell me what to do next, I am kind of stuck on this microphone thing only

RE: Integration of PDM microphone with thingy53

Rakshita — Tue, 27 Feb 2024 08:31:51 GMT

Executing task: nRF Connect: Build: dmic_thingy53/build (active) 

Building dmic_thingy53
west build --build-dir c:/nrf/samples/bluetooth/dmic_thingy53/build c:/nrf/samples/bluetooth/dmic_thingy53

-- west build: generating a build system
Loading Zephyr default modules (Zephyr base (cached)).
-- Application: C:/nrf/samples/bluetooth/dmic_thingy53
-- CMake version: 3.20.5
-- Cache files will be written to: C:/ncs/v2.5.2/zephyr/.cache
-- Zephyr version: 3.4.99 (C:/ncs/v2.5.2/zephyr)
-- Found west (found suitable version "1.1.0", minimum required is "0.14.0")
-- Board: thingy53_nrf5340_cpuapp
-- Found host-tools: zephyr 0.16.1 (C:/ncs/toolchains/c57af46cb7/opt/zephyr-sdk)
-- Found toolchain: zephyr 0.16.1 (C:/ncs/toolchains/c57af46cb7/opt/zephyr-sdk)
-- Found BOARD.dts: C:/ncs/v2.5.2/zephyr/boards/arm/thingy53_nrf5340/thingy53_nrf5340_cpuapp.dts
-- Found devicetree overlay: C:/nrf/samples/bluetooth/dmic_thingy53/boards/thingy53_nrf5340_cpuapp.overlay
devicetree error: pinctrl-names property in /soc/peripheral@50000000/pdm@26000 in C:/ncs/v2.5.2/zephyr/misc/empty_file.c has 1 strings, expected 2 strings
-- In: C:/nrf/samples/bluetooth/dmic_thingy53/build/zephyr, command: C:/ncs/toolchains/c57af46cb7/opt/bin/python.exe;C:/ncs/v2.5.2/zephyr/scripts/dts/gen_defines.py;--dts;C:/nrf/samples/bluetooth/dmic_thingy53/build/zephyr/zephyr.dts.pre;--dtc-flags;'-Wno-unique_unit_address_if_enabled';--bindings-dirs;C:/ncs/v2.5.2/nrf/dts/bindings;C:/ncs/v2.5.2/zephyr/dts/bindings;--header-out;C:/nrf/samples/bluetooth/dmic_thingy53/build/zephyr/include/generated/devicetree_generated.h.new;--dts-out;C:/nrf/samples/bluetooth/dmic_thingy53/build/zephyr/zephyr.dts.new;--edt-pickle-out;C:/nrf/samples/bluetooth/dmic_thingy53/build/zephyr/edt.pickle;--vendor-prefixes;C:/ncs/v2.5.2/nrf/dts/bindings/vendor-prefixes.txt;--vendor-prefixes;C:/ncs/v2.5.2/zephyr/dts/bindings/vendor-prefixes.txt
-- Configuring incomplete, errors occurred!
CMake Error at C:/ncs/v2.5.2/zephyr/cmake/modules/dts.cmake:279 (message):
  gen_defines.py failed with return code: 1
Call Stack (most recent call first):
  C:/ncs/v2.5.2/zephyr/cmake/modules/zephyr_default.cmake:129 (include)
  C:/ncs/v2.5.2/zephyr/share/zephyr-package/cmake/ZephyrConfig.cmake:66 (include)
  C:/ncs/v2.5.2/zephyr/share/zephyr-package/cmake/ZephyrConfig.cmake:97 (include_boilerplate)
  CMakeLists.txt:5 (find_package)


FATAL ERROR: command exited with status 1: 'C:\ncs\toolchains\c57af46cb7\opt\bin\cmake.EXE' -DWEST_PYTHON=C:/ncs/toolchains/c57af46cb7/opt/bin/python.exe '-Bc:\nrf\samples\bluetooth\dmic_thingy53\build' -GNinja '-Sc:\nrf\samples\bluetooth\dmic_thingy53'

 *  The terminal process terminated with exit code: 1. 
 *  Terminal will be reused by tasks, press any key to close it.

RE: Integration of PDM microphone with thingy53

Rakshita — Mon, 26 Feb 2024 12:05:13 GMT

Yes but as per the thingy's schematic the clk pin is P1.09 and data pin is P0.27
sdk v2.5.2

RE: Integration of PDM microphone with thingy53

ovrebekk — Mon, 26 Feb 2024 11:54:26 GMT

Hi Rakshita

I set the PDM_CLK to P0.08 and the data pin to P0.09, as you can see from the overlay:

	psels = <NRF_PSEL(PDM_CLK, 0, 8)>,
		<NRF_PSEL(PDM_DIN, 0, 9)>;

Which SDK version are you using to build it?

Can you share the full build output with me so I can try to figure out what is happening?
Please use the Insert -> Code feature in devzone to add a larger block of text, or attach the build output as a text file.

Best regards
Torbjørn

RE: Integration of PDM microphone with thingy53

Rakshita — Mon, 26 Feb 2024 11:40:55 GMT

The code which you shared is not building, terminating with exit code 1

RE: Integration of PDM microphone with thingy53

Rakshita — Mon, 26 Feb 2024 11:07:15 GMT

The PDM_CLK pin is at P1.09 right?

RE: Integration of PDM microphone with thingy53

ovrebekk — Mon, 26 Feb 2024 10:35:23 GMT

Hi Rakshita

Could you try to build for thingy53_nrf5340_cpuapp instead of thingy53_nrf5340_cpuapp_ns?

I am also struggling to get it to work when building for the non secure target.

When building for thingy53_nrf5340_cpuapp I was able to see activity on the PDM clock line, which I routed to P0.08 so that it can be accessed from the debug and extension board.

I have included my modified dmic example below:

devzone.nordicsemi.com/.../dmic_5F00_thingy53.zip

Best regards
Torbjørn

RE: Integration of PDM microphone with thingy53

Rakshita — Fri, 23 Feb 2024 09:51:41 GMT

dmic is not working with thingy53 even after changing the overlay files