Doesn't that mean you'll always be loading uncompressed data into memory?

If your database has specialised compression, or keeps most data in main memory compressed (I can think of at least one that does), then this approach won't work.

For almost everything else though, putting compression in the filesystem layer is better.