A long serving Conservative councillor in Blackpool has quit his party amid allegations of age discrimination.