> Is there any reason they should be vertical instead of facing the sun?

Takes up a smaller footprint of land, and PV panels themselves are now so cheap and last so long that it borderline makes sense as a fencing material even if you don't connect them to an inverter and power and anything with them.