Heads up! To view this whole video, sign in with your Courses account or enroll in your free 7-day trial. Sign In Enroll

Scraping Data From the Web

Well done!

You have completed Scraping Data From the Web!

Sign up for Treehouse Back to Library

Crawling Spiders

5:26 with Ken Alger

Let's use the Python Library, Scrapy, to create a spider to crawl the web.

Additional Resources

Related Discussions

Have questions about this video? Start a discussion with the community and Treehouse staff.

Sign up

    Related Discussions

    Have questions about this video? Start a discussion with the community and Treehouse staff.

    Sign up

    So Spiders > File > New File > Python, horse.py. 0:00
    To start with, we need to import scrapy. 0:05
    And then we'll write a class, we'll call it HorseSpider, 0:11
    which we'll inherit from scrapy.Spider. 0:17
    Now, we need to give out HorseSpider a name, let's call it ike, 0:21
    after the horse in Charlotte's Web. 0:25

    You need to sign up for Treehouse in order to download course files.

    Sign up

      You need to sign up for Treehouse in order to set up Workspace

      Sign up