Ideals for a rouge swashbuckler lore bard build

[Sir cryosin]

The rouge swashbuckler and then add some lore bard were should I cut lvs?

[Arkhios]

The rouge swashbuckler and then add some lore bard were should I cut lvs?

At the very least I'd say Swashbuckler 3/Bard 5, beyond that go as you please.

This way you get your charisma to your initiative, as well as half your proficiency bonus (rounded down) to all ability checks (Initiative is a Dexterity check!). Additionally, you regain all expended bardic inspiration dice at a short rest once you reach 5th level in bard.

However, is there a particular reason as to why Lore bard and not Valor bard instead? Getting Extra Attack could be a nice boost for you (and therefore I'd recommend a minimum of bard 6)
Besides, using a shield doesn't really hinder you from being stealthy or anything. You could even consider using medium armor until you get Dexterity to 20. Only scale mail and half-plate bestow disadvantage on stealth, and you'd still be able to reach equal or greater AC than with light armor alone. And since shields are not specified as being any shape in particular, you could envision your shield as a buckler, to add a buckler in your swash, so to speak :P

Wearing a studded leather, combined with Dexterity 20 (+5) leaves you at a total of AC 17.
Wearing a studded leather and a shield, combined with Dexterity 20 (+5), you'd get a total of AC 19. Which is as good as a plate wearing character can reach (without a shield, though)

EDIT: If you really want to abuse getting a ridiculous initiative bonus, however, you could go as follows: Swashbuckler rogue 3/Bard 2/Champion Fighter 15 and take the Alert feat.
Start with one level of fighter to get the best benefits (all weapon and armor proficiencies, and str and con* saving throw proficiencies).
*This'll prove useful if you cast spells that require a concentration.

In the end, you would have a total bonus in initiative as much as +6+5+Dexterity modifier+Charisma modifier (Provided you get good starting point for Dex and Cha, you may be able to reach 20 in both, landing at a maximum bonus of +21.
As a bonus, you'll get Extra Attack for a total of 3 attacks per round, Critical Range of 18 to 20, Action Surge for an additional Action once per each short rest. Two fighting styles (Go for Defense and Dueling), ability to reroll a failed saving throw, ability to regain hit points equal to 1d10+your fighter level as a bonus action once per each short rest. And you would get five ASI from fighter levels. + feat at first level if you're a human.
Oh, and you'd be an absolute monster with all skills and tools!

To be able to do this, you would need at minimum: Charisma 13 and Dexterity 13. Not at all impossible to achieve, especially with Point Buy.
Before any magical items, your AC would be 20 with studded leather, a buckler, and dexterity 20.
You could take rapier, which is finessable weapon with 1d8 damage, dealing damage equal to 1d8+7 before magical bonuses. +2d6 sneak attack.

Stig the Stinger, human swashbuckler 3/bard 2/Champion 15.
Str 10 ||Final: 10
Dex 15+1 = 16 ||Final: 20
Con 13 ||Final: 14
Int 8 ||Final: 8
Wis 10 ||Final: 10
Cha 15+1 = 16 ||Final: 20
Racial Bonus feat: Alert, for +5 to initiative, and other great benefits.
ASI: Durable for +1 to Constitution and an increased recovery during short rests, 4 x ASI: +4 to Dex, +4 to Cha