Would they always need earth to be habitable?

Because if they somehow managed to terraform and colonise another planet like mars, wouldnt they just make earth so uninhabitable that the rest of us would be forced to go where they are? (Prolly as slaves)