Fix asserts
It's perfectly fine to provide more space in the channels vector than the colorspace has channels, it just shouldn't be too small.