Welcome to the Treehouse Community

Want to collaborate on code errors? Have bugs you need feedback on? Looking for an extra set of eyes on your latest project? Get support with fellow developers, designers, and programmers of all backgrounds and skill levels here with the Treehouse Community! While you're at it, check out some resources Treehouse students have shared here.

Looking to learn something new?

Treehouse offers a seven day free trial for new students. Get access to thousands of hours of content and join thousands of Treehouse students and alumni in the community today.

Start your free trial

Python Scraping Data From the Web Additional Scraping Tasks An Intelligent Spider

Marcus Schumacher
Marcus Schumacher
16,616 Points
Posted by Marcus Schumacher
Marcus Schumacher
16,616 Points

I don't see the contents of after_post printing when I run my spider

from scrapy.http import FormRequest
from scrapy.spiders import Spider


class FormSpider(Spider):

    name = 'horseForm'
    start_urls = ['https://treehouse-projects.github.io/horse-land/form.html']

    def parse(self, response):
        formdata = {'firstname': 'Ken',
                    'lastname': 'Alger',
                    'jobtitle': 'Teacher'}
        return FormRequest.from_response(response, formnumber=0, formdata=formdata, callback=self.after_post)

    def after_post(self, response):
        print('\n\n********\nForm processed.\n')
        print(response)
        print('\n*******\n')

Then I go to the proper directory and run scrapy crawl horseForm. What am I doing wrong?