[C++] Optimize output sizes in segmented aggregation

[asfimport]

This is a follow-up task for a currently pending PR.

Reporter: Yaron Gvili / @rtpsw

_{Note: This issue was originally created as ARROW-18312. Please see the migration documentation for further details.}

[thisisnic]

This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.