I think the reason books/courses spend so much time on lexing/parsing is that finite automata, etc, are very broadly applicable concepts, more so than the later material.
The parsing/lexing part is the onyl part I've made direct use of in real projects. Everything else provided very important background knowledge that has occasionally proved useful, but little that applies to anything other than writing a compiler.
