Fix providertest. exec() only once, with the right settings upfront.

I don't see how this could have ever worked...