You could even argue that, if you see your wallpaper close to “all the time”, your monitors are larger than you need most of the time.
Sometimes I'll keep an empty workspace up just to declutter and focus on something on the other monitor.
It's not necessary, I could as well set black wallpaper and no gaps, but I like it so it's good enough excuse ;)