'Grape' refers to the shape of the munition - it looks like a bunch of grapes - not to the size of the shot.
Spoiler: Image
Also, I invite you to peruse the Ordnance Manual for the use of Officers of the United States Army, 1862 edition, if you disbelieve me that the balls used in canister are smaller than the balls used for grape.