Remove an assert that breaks some code

Some code expects end() to return raw value for saving/loading

CCBUG:395378