I noticed that panels had borders on all sides and it turns out PanelShadows was never actually told which sides should have shadows. To reduce code duplication I expose the enabled borders as property to the Panel.qml which itself does the same calculation from QML again and does it many times.

Moved panels around a bit, didn't notice breakage, but there might be.
I no longer have panel shadows bleeding onto other screens.