Catch-22: rear sway bar installed but also want the 6112/5160 kit for off-roading

I think I'm in a bit of a catch-22 with competing needs. I have a 2018 double cab 4x4 (non-TRD) and added the TRD rear sway bar for pulling dirt bikes and quads 5x/yr, going from north San Diego to Ocotillo Wells...also helps settle into the windy roads around here as it's my daily driver. But...I want to level my truck and give it something to handle occasional off-roading. Got a quote for the 6112/5160 at the Truck Shop in Miramar. Seems like they typically recommend the add-a-leaf and removal of the load spring to increase articulation. But with the sway bar I've already lost some articulation. He suggested maybe I leave the load spring and not do the add-a-leaf to try to compensate for having the sway bard. Granted, I won't off-road much - maybe a weekend campout 2-3 times/yr in Borrego...worst would be the diablo drop off a time or two.

Any thoughts on that rear articulation dilemma? I really like the stability for pulling stuff and hitting the switchbacks...but I don't really pull anything too heavy. I could remove it, but I think the value is higher to keep it since it's my daily driver.