The former BEATLE - who's currently touring in his native Britain - is angry that the public perception of Heather, who lost a leg in a car accident, has turned from good to bad since the pair's 2002 nuptials.
He says, "I think the shock for Heather was that she'd been, 'Great model who overcomes accident and now does a lot of work for charity and disabled people.'
"The minute she married me, it was, 'Who does she think she is?' It's really quite unfair, but she's a sitting target. I think it (the marriage) did give her a lot of grief. The worst thing about it was that it actually affected the charities she was working for.
"People actually stopped donating because of what they read in the newspapers, which was largely untrue."