Lots of good stuff in your post. I usually do sandbox and think I understand the core problem you ran into. It's not that a sandbox campaign has no plot, it's that the players get to build the plot they want out of the materials they're presented to work with. In other words, they only work well long term when the players set goals for their characters and pursue them.