Unable to install nRF Connect For Desktop, gets Error: EPERM reply

I was working with nRF Connect for Desktop version v4.1.1 for quiet some time and it was working good, Since each time I was prompted to update the software to the latest (v5.0.2) I thought to try it. But unfortunately it failed to install properly and showed "Error: EPERM...." message, Later it was not even opening the application.

Multiple times I uninstalled, reinstalled, installed with admin privileges, restarted etc. tried to install back older versions of the software, but the reply prevails and program does not start, shows the following error message.

Related