I don't know about where to get a cheap one at but it doesnt matter if you take the belt off or not when you take the tensioner off the belt will most likely fall off. You will also find a belt tensioner tool handy to back off the tensioner when trying to take it off.