D+ and D- signals before power supply of the chip

The device i am currently developing is a battery powered dongle with internal power supply unit for battery charging.
I am using nrf5340 USB pins D+ and D- for communication.

There is a case in which the battery is dead (nrf5340 not powered) and plugging the USB would put voltage on D+ and D- before the battery charger wakes up and charge all capactiors accross VCC/VDDH/VBUS pins. 

Is that situation a potential risk for nrf5340 or the USB module is physicaly switched off unless VBUS is present?

Related