The only real thing I can think of is that D&D generally assumes more powerful characters. d20 Moderners probably wouldn't be as powerful. If the PCs are mostly low-level it could work out, but they'd break things at higher levels. ("Who cares who knows we're from a crazy fantasy world? I can destroy them all with three spells.")