Treehouse | Community | Using Scrapers for Site Testing

🤑 Join the Treehouse affiliate program and earn 25% commission!

Join our Live Career-Building Workshop: Launch Your Tech-Adjacent Career! ⭐ Register here!

🌟 Dreaming of a bright future? 🎓 Ask about the Treehouse Scholarship program! 🚀

Curious which AI tools Treehouse developers love? ⚙️ Check them out!

🫡 Treehouse for Military offers discounts to Veterans, service members and their families!

Newest
- Newest
- Active
- Unanswered
- Featured
All Topics

Nicole Buckenwolf
8,721 Points
Help with an error

Posted April 15, 2024 5:18pm by Nicole Buckenwolf

Nicole Buckenwolf
8,721 Points
2 Answers
Tom Morgan
8,208 Points
CERTIFICATE_VERIFY_FAILED error when trying to run

Posted May 6, 2023 4:06pm by Tom Morgan

Tom Morgan
8,208 Points
0 Answers
Cody Stephenson
8,361 Points
I think the form is broken (needs updating on Treehouse's side).

Posted June 29, 2021 7:24pm by Cody Stephenson

Cody Stephenson
8,361 Points
2 Answers
Unashe Mutambashora
3,433 Points
No module found error

Posted January 7, 2021 6:29pm by Unashe Mutambashora

Unashe Mutambashora
3,433 Points
1 Answer
PLUS

Nancy Melucci
Courses Plus Student 36,143 Points
The instructor is showing installation on Mac, I can't find how to install Scrapy on a Windows version of PyCharm

Posted August 25, 2020 8:40pm by Nancy Melucci

Nancy Melucci
Courses Plus Student 36,143 Points
2 Answers
ishakahmed
11,359 Points
Ken didn't use pass in html.read() to BeautifulSoup

Posted August 16, 2020 1:48am by ishakahmed

ishakahmed
11,359 Points
0 Answers
ishakahmed
11,359 Points
I'm getting this error 'SSL: CERTIFICATE_VERFIY_FAILED '

Posted August 16, 2020 1:39am by ishakahmed

ishakahmed
11,359 Points
1 Answer
Tyler Pelzer
1,046 Points
I'm not able to scrape other websites with this code.

Posted August 15, 2020 8:58pm by Tyler Pelzer

Tyler Pelzer
1,046 Points
0 Answers
Pratham Mishra
14,191 Points
I am getting an error while running the python script:

Posted July 5, 2020 4:42am by Pratham Mishra

Pratham Mishra
14,191 Points
0 Answers
Josh Gold
12,207 Points
In the previous page it says "Captchas can be worked around w/ various technologies". Can you someone elaborate a bit?

Posted June 18, 2020 5:08am by Josh Gold

Josh Gold
12,207 Points
1 Answer
Evgeny Shilov
21,283 Points
Where is the "Horse Land" file? Can't find it.

Posted April 21, 2020 10:19pm by Evgeny Shilov

Evgeny Shilov
21,283 Points
1 Answer
Michael Strand
10,897 Points
Finding Internal Links Without .html

Posted October 16, 2019 1:23pm by Michael Strand

Michael Strand
10,897 Points
2 Answers
Rutendo Chaurura
6,809 Points
SITE SCRAPING

Posted August 18, 2019 12:01pm by Rutendo Chaurura

Rutendo Chaurura
6,809 Points
1 Answer
Jason Tran
7,393 Points
Spider not found: ike

Posted July 30, 2019 9:13am by Jason Tran

Jason Tran
7,393 Points
3 Answers
Jason Tran
7,393 Points
Unable to find and list all external links

Posted July 30, 2019 7:18am by Jason Tran

Jason Tran
7,393 Points
1 Answer
Josh Keenan
20,315 Points
Form contents not being output

Posted July 24, 2019 6:37pm by Josh Keenan

Josh Keenan
20,315 Points
0 Answers
Marcus Schumacher
16,616 Points
I don't see the contents of after_post printing when I run my spider

Posted July 5, 2019 9:54pm by Marcus Schumacher

Marcus Schumacher
16,616 Points
0 Answers
Jiawei Hu
9,740 Points
bash: scrapy: command not found

Posted June 12, 2019 5:37pm by Jiawei Hu

Jiawei Hu
9,740 Points
2 Answers
Jiawei Hu
9,740 Points
bs4.FreatureNotFound

Posted June 12, 2019 4:02pm by Jiawei Hu

Jiawei Hu
9,740 Points
1 Answer
BRIAN WEBER
21,570 Points
Getting a 401 response when submitting form - Scrapy FormSpider

Posted April 19, 2019 3:19pm by BRIAN WEBER

BRIAN WEBER
21,570 Points
1 Answer
Tatiane Lima
6,738 Points
I getting this error: ImportError: No module named request

Posted April 13, 2019 8:07pm by Tatiane Lima

Tatiane Lima
6,738 Points
1 Answer
Christopher Steitz
29,749 Points
Help wont mark as being done

Posted March 25, 2019 8:58pm by Christopher Steitz

Christopher Steitz
29,749 Points
1 Answer
paul nabende
673 Points
Filtering the 'results' by Class name not working in soup.find_all('div', {'class': 'featured'}).

Posted March 12, 2019 3:47pm by paul nabende

paul nabende
673 Points
1 Answer
Mark Chesney
11,747 Points
parser parameter to BeautifulSoup class

Posted February 26, 2019 4:56am by Mark Chesney

Mark Chesney
11,747 Points
0 Answers
Mark Chesney
11,747 Points
sharing my code: web crawling

Posted February 20, 2019 3:33am by Mark Chesney

Mark Chesney
11,747 Points
1 Answer
Mark Chesney
11,747 Points
robots.txt and web scraping

Posted February 18, 2019 3:08am by Mark Chesney

Mark Chesney
11,747 Points
1 Answer
Anthony Osborn
17,095 Points
Where do I find the teacher's notes on 'saving the information to a csv file or database' (as mentioned in the video)?

Posted February 7, 2019 4:20pm by Anthony Osborn

Anthony Osborn
17,095 Points
4 Answers
Brian Haucke
13,717 Points
KeyError: 'Spider not found: formSpider.py'

Posted January 29, 2019 9:28pm by Brian Haucke

Brian Haucke
13,717 Points
2 Answers
Oskar Lundberg
9,534 Points
[SOLVED] This might help if you have problems installing Scrapy, using PyCharm.

Posted January 20, 2019 9:38am by Oskar Lundberg

Oskar Lundberg
9,534 Points
0 Answers
Nathan English
Front End Web Development Techdegree Student 10,817 Points
How do you create a scrapy project?

Posted December 11, 2018 2:55am by Nathan English

Nathan English
Front End Web Development Techdegree Student 10,817 Points
3 Answers

Prev Page 1 of 2 Next

Posting to the forum is only allowed for members with active accounts.
Please sign in or sign up to post.