Cis mode - Mic issues

[Abdulmohaimen]

Hi,

With this setup in Issue with Stereo Sound from External Codec on nRF5340 DK (SDK v2.6.2) , I successfully built a CIS mode using my nRF5340 DKs, enabling stereo sound while the microphone is active.

However, I am currently experiencing several issues:

• The recorded microphone signal is accelerated, playing back faster than it was recorded.
• The input signal quality is poor when using an analog microphone, but it improves significantly with a digital microphone.
• When using the microphone and playing audio through the headset simultaneously, the recorded sound is barely audible (very low signal strength).
• Occasionally, one of the DKs disconnects, causing a complete loss of audio.

Any insights into what might be causing these issues? and how might they be solved?

Thank you in advance—I truly appreciate your time and support.

Best regards,
Abdulmohaimen Algamoudi 

[dejans]

Hi,

On which specific board do you experience issues?

Do you still use NCS v2.6.2?

Best regards,
Dejan

[Abdulmohaimen]

Hey Dejan,
The nrf5340 audio DK as well as the BC40C from Fanstel.
The sdk is V2.8.0

Thank you in advance

Best regards,
Abdulmohaimen Algamoudi 

[Abdulmohaimen]

Hi Dejan, i have showed them to this privat artical.
Can you check it?
 
Thank you in advance
Best regards,
Dejan

[dejans]

Hi Abdulmohaimen,

Thank you for showing your code changes in another ticket.

Before looking into it, I have some questions related to your previous reply where you provided additional details about microphones. I also need some clarifications and additional information.
1. For two DKs that you use for left and right channel (described as headsets), do you want to use them as earbuds, one channel per ear with a single channel to each?
2. It looks like you have 2 microphones. Are these 2 microphones connected to the same DK or to different DKs?
3. How many DKs do you use in total?
4. Which kit do you have connected to the computer - headset kit or microphone kit?
5. Is the recorded signal audio that has been sent over LE Audio and then recorded, or is it tapped directly from the microphone DK?
6. Can you provide picture/diagram of all devices involved, how they are connected, and which signals are transferred between them? Please label external HW codec, the microphone kits, the headset kits, the computer used for the recording, any other devices involved and the connections/signals going between them.
7. Do you want to have stereo bidirectional communication?
8. Did you try to use demo branch provided in the previous ticket which you linked in your initial post?
9. Are you trying to use USB (not I2S) as audio interface?

Best regards,
Dejan

[Abdulmohaimen]

Hi Dejan,

1. Yes, 2 channels in CIS mode are used to provide stereo sound while also supporting on-device microphone input.

2. The microphones are connected to the DA7212 evaluation board, which is connected to the nRF5340 DK via I²S.

3. There are 3 nRF5340 Audio DKs in the setup (2 headsets and 1 gateway), with each gateway connected to a DA7212 evaluation board over I²S.

4.The gateway is connected to the computer via USB.

5. Audio is recorded from the microphones using the DA7212, then sent over I²S to the headset and over BLE to the gateway.

6

7 as far as i know yes.
8 yes 
9 the gateway is connected to the computer via usb.

I believe the issue may be related to the USB interface. I tested recording an input signal using the unmodified configuration of the nRF5340 Audio DK from the SDK. I used the on-board codec in two scenarios:

1. Connecting the gateway to the computer via USB.

2. Using the I²S source in prj.conf and feeding the signal through the line-in input.

I noticed that the signal recorded via USB was accelerated. Is it possible to change the data format or sampling rate of the USB configuration?

Thank you in advance
Best regards,
Dejan

[dejans]

Hi Abdulmohaimen,

I am not able to open your picture/diagram for point 6. Which format is you picture/diagram in? Can you please try to upload it again by first zipping the file and then upload it using Insert->Image/video/file->Upload?

Best regards,
Dejan

[Abdulmohaimen]

Hi Dejan,
Sure. can you see it know?
Best regards,
Dejan

[dejans]

Hi Abdulmohaimen, 

Thank you for additional information.

Abdulmohaimen said:

Sure. can you see it know?

I can see it now. I will look into this. I expect to get back to you by the end of the week.

Best regards,
Dejan

[Abdulmohaimen]

Hi Dejan,
Thank you so much—Looking forward to your feedback. 

I truly appreciate your time and support.

Best regards 
Abdulmohaimen 

[dejans]

Hi Abdulmohaimen,

Previous demo worked for combining L and R into one frame and sending it to a single headset. I have checked internally the requirements which could be supported by the CPU. 
Scenario of having CIS gateway sending stereo channel stream (combined left and right into a frame) to 2 headsets and having USB as interface to collect MIC from both headsets, will probably (i.e. can be expected to) overload available bandwidth. Unfortunately, it cannot be expected that gateway side will be able to handle
- encoding 2 streams for 2 headsets
- decoding 2 streams from MIC in both headsets
- use USB as audio interface

Best regards,
Dejan

[Abdulmohaimen]

Hi Dejan,

Thank you for your feedback.

However, the issue with the accelerated microphone signal persists even when using a single headset board connected to the gateway, running the initial code from the nRF SDK (without no modification with on board codec and using the jack onboard nrf5340 by pluginng headphone with mic to it). You might want to try the initial setup pf the sdk yourself—by enabling:

CONFIG_STREAM_BIDIRECTIONAL=y

in the prj.conf file, you should be able to hear the accelerated  recorded microphone signal.

The main problem for me right now is the accelerated microphone signal. Ideally, I can like to use just one headset board and still achieve a proper CIS mode that handles both left and right channels.

Could you advise how to fix this microphone issue? It occurs even with the initial configuration of the nrf SDK, or using only one headset board and the extarnal hardware codec.

Thanks in advance!

Best regards,
Abdulmohaimen 

[dejans]

Hi Abdulmohaimen,

Abdulmohaimen said:

However, the issue with the accelerated microphone signal persists even when using a single headset board connected to the gateway, running the initial code from the nRF SDK (without no modification with on board codec and using the jack onboard nrf5340 by pluginng headphone with mic to it).

Is scenario the same as shown in the picture previously, just with one headset instead of two? Which code changes (specified in your second ticket) are now relevant to gateway and headset? Please provide details about the setup and code changes in this case. If you want to keep your code changes private, you can specify changes in your second ticket. If you do so, please let me know here.

Best regards,
Dejan