Natalie Oliver claims Lincoln Castle's walls need repairs, but she has been accused of "political opportunism".