It will be great once we can run the generated model locally. It would save a bunch of latency and bandwidth, not to mention the privacy implications of not having speech saved in the cloud.
I agree with you, but will it ever happen? I would imagine that Google benefits from capturing the audio, so they really have no incentive to allow you to use their voice recognition without them getting the audio.