Yup
Of course this will hurt his campaign, even though what he said was true. People hate being reminded that they are bigots. Everyone who hears this story will paste their own idea of what a sweet old nanna is like on top of this woman who might be a total nutbar. Then its like Gordon Brown insulted your grandma. Its entirely possible that these same people, upon meeting said woman, would react identically to Mr. Brown, however no one will take this into consideration when they crucify him come election.