Hello @dnpuneeth3,
The main difference between ‘with restart’ and ‘without restart’ plugin installation is that you cannot upgrade or uninstall plugins without restart (because of the architectural choice made in Jenkins).
So, the new plugin can be installed without restart (and when other builds are running as well)