You could just put the words "freestanding" and "unoccupied" somewhere in there, and that would probably solve your dilemma. I mean, the players can construct a log cabin without a foundation and make it a feather token with the spell then, but they can't turn the BBEG's tower into one.