Using CONFIG_DEBUG_OPTIMIZATIONS with Thingy:91 and Asset Tracker v2

I'm getting started with the nRF Connect SDK v2.6 and the Asset Tracker v2 application on a Thingy:91.
I can build and flash the unmodified app, and it pushes sensor data to nRF Cloud, using both `overlay-debug.conf` and `overlay-low-power.conf`.
When I set CONFIG_DEBUG_OPTIMIZATIONS=y for the debug conf the build fails with memory problems when building TFM:
[20/461] Performing build step for 'tfm'
[170/174] Linking C executable bin/tfm_s.axf
/usr/local/zephyr-sdk-0.16.4/arm-zephyr-eabi/bin/../lib/gcc/arm-zephyr-eabi/12.2.0/../../../../arm-zephyr-eabi/bin/ld: address 0x1a460 of bin/tfm_s.axf section `.TFM_UNPRIV_CODE' is not within region `FLASH'
/usr/local/zephyr-sdk-0.16.4/arm-zephyr-eabi/bin/../lib/gcc/arm-zephyr-eabi/12.2.0/../../../../arm-zephyr-eabi/bin/ld: bin/tfm_s.axf section `.psa_interface_thread_fn_call' will not fit in region `FLASH'
/usr/local/zephyr-sdk-0.16.4/arm-zephyr-eabi/bin/../lib/gcc/arm-zephyr-eabi/12.2.0/../../../../arm-zephyr-eabi/bin/ld: address 0x1fc40 of bin/tfm_s.axf section `.gnu.sgstubs' is not within region `FLASH'
/usr/local/zephyr-sdk-0.16.4/arm-zephyr-eabi/bin/../lib/gcc/arm-zephyr-eabi/12.2.0/../../../../arm-zephyr-eabi/bin/ld: address 0x1a460 of bin/tfm_s.axf section `.TFM_UNPRIV_CODE' is not within region `FLASH'
/usr/local/zephyr-sdk-0.16.4/arm-zephyr-eabi/bin/../lib/gcc/arm-zephyr-eabi/12.2.0/../../../../arm-zephyr-eabi/bin/ld: address 0x1fc40 of bin/tfm_s.axf section `.gnu.sgstubs' is not within region `FLASH'
/usr/local/zephyr-sdk-0.16.4/arm-zephyr-eabi/bin/../lib/gcc/arm-zephyr-eabi/12.2.0/../../../../arm-zephyr-eabi/bin/ld: region `FLASH' overflowed by 32136 bytes
Memory region    Used Size       Region Size   %age Used
            FLASH:      80776 B              48640 B       166.07%
               RAM: 1.     8540 B                 32 KB         56.58%
collect2: error: ld returned 1 exit status
How can I increase the partition size for TFM ? 
Thanks
Related