There's probably a way to do that with fallocate, I see it has a -d option to make "the file sparse in-place, without using extra disk space".