Just verifying to be 110% sure:
The TRACEDATA1-4 pins may be used as ordinary GPIO pins when no trace-functionality is configured for the debugger? So even if a debugger is connected, the pins will remain as GPIO pins and the peripherals connected to the pins may be accessed during a debug session.