No, that's absolutely not normal. Worn bushings somewhere, I'd think. First place I'd check is the Watt's linkage at the rear. Or maybe a blown shock or two? How do the corners feel if you bounce it?
Could also be your alignment is way out of whack.
Could also be your alignment is way out of whack.