I find out that the screen gets darker every time I'm using the scroll control, no matter the direction. It has been mentionned here https://github.com/kotelnik/plasma-applet-redshift-control/issues/55
I fixed that by using the -P option to the redshiftOneTimeCommand.