Add infrastructure for controlling which server we deploy stuff to
(cherry picked from commit 37ba63c8d211547a349bbbabc7eaed512fd12a93)