Avoid creating a gap if we don't fetch emails for a while

Due to the date filter it was possible that we would create a gap in the
email chain due if the unfetched emails did fall into the the timeframe
of the date filter.
This resulted in emails ending up never getting fetched from the server.