I'm going to guess the more experienced D&D players noticed this when they first read the comic, but in #443, Roy probably has Shillelagh Oil because he was using a club while travelling to Azure City. (Assuming that works on greatclubs, anyway.)

There's even a chance he picked it up at the potion shop in #135.