Unable to get UnicastClient to connect to UnicastServer that only supports stereo audio stream

My application is based on the ncs nrf5340_audio application, but my application and hardware target are both out-of-tree and I am using ncs v2.9.0.

I am able to connect to several different models of earbuds that support BLE audio where the UnicastClient connects to two independent BT addresses and sends a mono audio stream to each earbud.  However, if I connect to the TWS style of earbuds that only expose one BT address I get an error when parsing the PACS records.  I'll insert the debug log output below.

I have tried increasing several of the configuration variables that seem like they would allow the firmware to parse all of the endpoints, but so far I have not been able to get the nrf5340 firmware to connect to these kinds of earbuds.  Here are the configuration variables that I have updated to try to resolve this issue:

# Gor testing Creative Aurvana earbuds
#CONFIG_BT_MAX_CONN=6
#CONFIG_BT_BUF_ACL_RX_COUNT=8
#CONFIG_BT_BAP_UNICAST_CLIENT_ASE_SNK_COUNT=12
#CONFIG_BT_BAP_UNICAST_CLIENT_ASE_SRC_COUNT=4

Do you have any other suggestions on how to make the nrf5340 firmware connect to this type of earbud system?

Best regards,

Kristopher