Revert "Fix buffer swap assert"
This reverts commit be01ba0ae7c6c87588cfb612201541ab235a2875.
See: https://mail.kde.org/pipermail/kwin/2020-January/002999.html