Yes, rolling with stores is much reduced than when clean.
We had a small whoopsie on Jag flight testing in early 70's when the Dep Chief Test Pilot did some full aileron rapid rolls at 0.8M with full 330L underwing tanks. Not his fault the "dolls eye" indicators were faulty so tanks showed empty. He did comment on debrief that it felt a bit ponderous in roll! Some swift checks on alignment and loads showed no real damage - other than to fatigue count.