I see from your recent commits that you've figured most things out here.

I was curious enough to figure out what compiler behavior causes the different type of relocation entries, so here's a test program with extensive comments. I was originally seeing the behavior with libcairo, but this should make testing easy.

I'm not much of a C++ guy, so take it from here, Milian, if this patch still needs work. :)