Maybe. Roy does (using the old 2e names) describe the afterlives in a way that makes them sound like the Great Wheel:
http://www.giantitp.com/comics/oots0669.html
Combined with the fact that Arcadia and Tartarus have received namedrops - it makes me think that "Valhalla" is simply Ysgard from the 3.5 DMG.