Add an option not to pause after host program execution is completed

Add an option not to pause after host program execution is completed #2838