Self-similar signed growth-fragmentations