Skip to content Skip to sidebar Skip to footer

Parse Callback Is Not Defined - Simple Webscraper (scrapy) Still Not Running

i googled half a day and still can't get it going. Maybe you got some insights? I tryed to start my scraper not from a terminal, but from a script. This works well without rules, j

Solution 1:

Scrapy uses parse callback to parse URLs from start_urls. You didn't provide such callback that's why Scrapy can't process your https://www.bueffeln.net URL.

If you want your code to work you need to add parse callback (even empty). Your rules will be applied after parse callback.

UPDATE To use rules you need scrapy.CrawlSpider:

class MySpider(scrapy.CrawlSpider):

Post a Comment for "Parse Callback Is Not Defined - Simple Webscraper (scrapy) Still Not Running"