Check parent in distructor

We don't care about this anywhere else and its the actual parent at that time that
matters not what ever parent happens to be passed at init time.