Why Didn't Saruman Kill Gandalf In Isengard? | Lord of the Rings Lore HD

Gandalf was trapped within Orthanc, but when Gandalf refused to joined Saruman, he did not take his life. Why was this?