Funny that I just finished initial implementation of the code that uses the techniques from the paper (Vanhoucke et al.) mentioned in the post.

https://github.com/ahmetaa/fast-dnn