Is it possible to advertise in non-connectable mode while scanning/connecting/connected as a Central?
Yes, it is possible.
You can use ble_advdata_set(..) to set the packet data and then start advertising with the SoftDevice call sd_ble_gap_adv_start(..). See the ble_app_beacon example for how to do this in more detail.
Updated ;)
