Skip to content

Web Scraper Scenario#235

Merged
kennethreitz merged 7 commits into
realpython:masterfrom
sirMackk:master
Dec 31, 2012
Merged

Web Scraper Scenario#235
kennethreitz merged 7 commits into
realpython:masterfrom
sirMackk:master

Conversation

@sirMackk

Copy link
Copy Markdown
Contributor

I wrote a scenario about scraping data from a website using lxml and Requests. I also gave pointers on cool ways to expand on this functionality. One of the reasons why I got around to this was that I couldn't find a good resource for writing a scraper in Python that had everything all in one place.

kennethreitz pushed a commit that referenced this pull request Dec 31, 2012
@kennethreitz kennethreitz merged commit e1b1201 into realpython:master Dec 31, 2012
Comment thread docs/scenarios/scrape.rst

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a typo?

@lyndsysimon

Copy link
Copy Markdown
Contributor

Considering the opinionated nature of this guide, does anyone have thoughts on rewriting this example to use BeatifulSoup? It's much more pythonic, and doesn't require lxml (which can be difficult to install).

@kennethreitz

Copy link
Copy Markdown
Contributor

@lyndsysimon beautifulsoup has a lot of nuances (often times the releases operate very differently), and i'd like to avoid recommending it to people if possible. It deserves a mention though.

@lyndsysimon

Copy link
Copy Markdown
Contributor

Fair enough.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants