Only sort by passenger when we are really looking at the same trip

This previously broke on a two leg and two passenger boarding pass that
is purely extracted from IATA BCBP data and is missing exact departure
times. Now we keep the correct order for those cases too.