I would guess that the chromecast supports the same set of video formats that the video tag in Chrome does - H264, VP8 etc..

If you download a video encoded differently (e.g. DivX) and then try to play it using localcast, you can get issues.