but now I'm having clicks and pop on the play back and the only way to get it back right is to adjust the latency eachtime.
I believe that when you hear clicks and pops, you have your latency set too low for your machine to handle (correct me if I'm wrong). These problems can be avoided by increasing the latency.
http://audiomastersforum.net/amforum/viewtopic.php?p=49226&highlight=#49226