This is what pavucontrol is doing too.
BUG: 383787 FIXED-IN: 5.11
Works for me (but it worked also before)