Remove assert from the filter model

We can actually have a valid state with no layer selected when
removing the last layer of the document. This state is temporary
but is valid.