Timing goes off?

After matching the beats of both songs, it seems my left deck is going out of time on it's own when the BPM are matched and the beats are lined up. When matching the right deck I have to continually speed up the track to keep it lined up, not a dramatic change but it goes off as if the track is 1 or 2 bpm off, and also when matching the left deck to the right track i have to slow it down, so obviously my left deck is changing its pace and going faster, issue with my i-mix or software setting/issue?