AnnotationModel: generate the brush objects per revision only on-demand
No need to pregenerate all of them, as often the user only looks at the annotations for a smaller range.