In cases like this, I prefer to equate Stallman's idea of freedom to Illich's idea of conviviality--a convivial empowers the user, and gives her the ability to mold it and use it as she sees fit. If you just distribute only a binary, you aren't distributing a convivial tool. When we lose control of the tools we use, ultimately we lose some of our freedom.
But, no one is forcing you to take and use my tools. You can take it or leave it – that's your choice. I grabbed this open source code and made some changes to it. I can give (or sell) you my modifications if you want. If you don't want, then you can reverse-engineer my implementation and use that (just like what GNU/Linux guys did). I'm not taking your freedom away – I'm giving you a choice.
