Fix assert with palettize filter and multi-group palettes.

This was not a good use of an assert, especially as there was no
way to check if the swatch is there without having access to the group,
which is also what this function searches for...