Any improvement is significant!! I spent a week implementing an optimization for my language (pypy's storage strategies) and ended up significantly slowing it down instead. It's not guaranteed.

I have massive respect for anyone who can pull off steady improvements, no matter how small.