Remove x11-xlib dependency
It's not shipped anymore in some distributions. It was used only in xlib event handlers and since those were dropped it's no longer required.