Hello,
On my custom board, on nrf52832, I can can use app_buttons for all usual pins, but not the XL1 (P0.00). I didn't try XL2 (not routed)
Using this pin as input or output works fine with standard functions. I use sdk15.2, with softdevice s132, and didnt't try without it (I'm not sure it would help, and anyway I need the softdevice)
As I'm not using the 32kHz crystal, I set my sdk_config with:
#define CLOCK_CONFIG_LF_SRC 0