The backstory is much more a GM tool than it is window dressing for the players. A well developed world has a lot of places to go to and explore, and if the party sets off in a random direction, you can be sure they will encounter something exciting eventually. Even if the players don't remember it at all, it helps the DM run a fun game, and that, IMO generally makes it worth it.