Squeeze RowData children vectors to safe a bit of memory

When the set the parents, the vectors are considered immutable
afterwards. Thus ensure there that capacity equals size to make
sure we don't waste any space needlessly.