BUG:348940 Don't crash if there isn't a pattern

We still need to figure out why sometimes there isn't a pattern
loaded on start, but that's actually a possibly valid situation,
users can remove or blacklist all patterns. So be extra double
plus careful and don't crash.