using GFB (or BB) will mean you are taking the "Cast a Spell" action, instead of the "attack" action. So if you use GFB, you will make a melee attack... but only one. You don't get any extra attacks with a feature or invocation, or even a bonus action attack with a light, offhand weapon, because you aren't taking the attack action.
Eldritch Knight Fighters can get around this with War Magic, as they can cast a Cantrip then have a bonus action attack - So, GFB, which includes a single melee attack, and then a second attack as a bonus action. Warlocks don't have such a feature.