Thanks. To be more specific, i'm interested in learning Shannon's information theory from scratch. So far I know just the definition of entropy.

Shannon's book, The Mathematical Theory of Communication, is approachable with the mathematical background of first-year college calculus. I don't think it requires any more math than is essential to understand the topic.