Hi,
Outriggers, from my experience, affect mostly paddling performance, rather than sailing - making paddling less comfortable and much slower.
They also reduce sailing performance in light winds - lower speed and wider upwind angle.
They don't reduce neither upwind, nor downwind sailing performa