Fix prefix-addressed message handling
Messages sent to all channel operators or other mode-prefixed classes of
channel members could use flags that conflict with channel prefix flags.
This tries harder to ensure that the actual channel prefix is found.
BUG:383801