BLE Audio: Dual Stream to Gateway

Question

Hello 
 I was attempting to update a pre-production project where we have 2 servers connected to one gateway where the servers send the audio data back to the gateway with no data being transmitted from the gateway. I had originally use a 2t1r project from https://github.com/rick1082/sdk-nrf/tree/2t1r_mic_demo and updateing it to 3.0 but there have been significant updates to the mainline as that demo is over 2 years old. I was wanting to integrate into the newer 3.2+ builds and was told if i set device configs to bidirectional and comment out the below from le_audio_rx it would work. The issue is that while I do see a left and a right connecting I only get audio from the device connecting first. The stranger part is depending on the order of connection there are different errors.

If Left is added first then i get invalid location index ret -22 and the frames fail to aggregate this appears to happen because when the right is added stream_locations parameter remains one rather then 2. When the Right is added first then I get audio_datapath: Duplicate sdu_ref_us (21333197) - Dropping audio frame because it seed the frames as duplicates because it is not taking location into context or aggregating the audio data. 
 
 I have tried this with audio_system_encoder_start(); left in and commented out with the same result so that seems to have no effect other then CPU load. Due to the recent changes of net buffers and meta data it seems like something has been missed in the update to cause this diverging behavior. It is fairly clear from the errors that the frames are being received but not used. Any insight would be appreciated and I am currently on the 3.2.1 release.

Left Device: 
 CONFIG_DEVICE_LOCATION_SET_COMPILE_TIME =y 
 CONFIG_DEVICE_LOCATION_AT_COMPILE_TIME =1 
 
 Right Device:

CONFIG_DEVICE_LOCATION_SET_COMPILE_TIME =y 
 CONFIG_DEVICE_LOCATION_AT_COMPILE_TIME =2

// if (location_index != 0 && (CONFIG_AUDIO_DEV == GATEWAY)) { 
 // /* Only the first device will be used as mic input on gateway */ 
 // return; 
 // }