where's data store after deploy spider scrapyd python?

Question

i deployed and scheduled my spider on http://localhost:6800/ success, but where's data of item store ? How could i get them ?

thanks so much !

Answer 1

You should handle it in process_item() instead of handle by scrapyd.Because scrapyd just logs items, there is no difference in a way to store data except log file. You can find it in documentation of scrapyd.

Answer 2

In scrapyd you have to define item directory in scrapyd.conf file, for more information you can look at scrapyd documentation scrapyd.conf