I've found lxml to be more powerful. The lxml library supports xpaths, which I d... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Buttons840 on Aug 10, 2022 \| parent \| context \| favorite \| on: Ask HN: What are the best tools for web scraping i... I've found lxml to be more powerful. The lxml library supports xpaths, which I don't believe Beautiful Soup does? In other words, consider lxml as well.

yifanl on Aug 10, 2022 | [–]

lxml is supported (mostly) out of the box for BeautifulSoup, so you can it as a parser behind BS4's nicer interface, which I believe the OP does in the linked codebases.

traverseda on Aug 10, 2022 | [–]

I reach for selectolax first if I'm doing relatively tame stuff. Also css selectors are nice.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact