It hasnt been worth being picky about planet size for ages.
Especially not in 2.2 where your empire size is based on number of districts plus systems, so two size 12 planets are the same as one size 24.
Colonise anything yellow or better used to be my rule, though I haven't played much of 2.2 yet because Smash and Path of Exile.