test: Add plumbing to allow for tracepoints during test.

I had added this while searching for the cxxflags bug. I break it up
into a separate commit because it wasn't actually related to the
cxxflags bug, but I still think it would be useful.