"You and I seem to have a very different understanding of .."

Although, to be fair, it mostly says that you don't agree without drawing conclusion of who's in the wrong. (Even if you may have done so in your mind.)