32 MHz External Crystal not working

We have developed a custom board with an external 32 MHz Crystal but I am having trouble initializing everything correctly.  With the Zephyr "Hello World" example code I can only get it to run on the custom board if I set 

CONFIG_CLOCK_CONTROL_NRF_K32SRC_RC=y
in my prj.conf file.  My understanding for all I need to do in order to use the external oscillator is set the following:

CONFIG_CLOCK_CONTROL_NRF_K32SRC_RC=n
CONFIG_CLOCK_CONTROL_NRF_K32SRC_XTAL=y

When I do this not even the "Hello World" executes although everything builds and flashed with no warnings/errors.  Are there other steps I need to follow?  The schematic for this board is extremely simple seen here:
Custom board schematic

The data sheet for the Crystal can be read here:

 SJ56-32003_S2520A-032000-T06-BBC-1AVA.PDF

Software Info:

IDE: NRF CONNECT for VS Code
toolchain: v2.7.0
SDK: v2.7.0

Related