Top "Scrapyd" questions

`Scrapyd` is a daemon for managing `Scrapy` projects.

Scrapy get request url in parse

How can I get the request url in Scrapy's parse() function? I have a lot of urls in start_urls …

python-2.7 scrapy scrapyd
error in deploying a project using scrapyd

I had multiple spiders in my project folder and want to run all the spiders at once, so i decided …

python scrapy scrapyd