In the sense of to be different, the idiom is to differ from. In the sense of to disagree, it is either to differ from or to differ with, which you please.