How to stop Apify from saving handled requests?

940 Views Asked by At

It seems Apify is saving handled requests in 'handled' directory. I want to stop this because apify won't crawl the page I've crawled before. Anyone know how to stop Apify from saving handled request?

2

There are 2 best solutions below

0
On BEST ANSWER

You can work around this by putting the request in queue multiple times with a different uniqueKey so that it is not automatically filtered out by request queue after already having been processed once. Local files only simulate the behavior of RequestQueue exactly as it behaves on the Apify platform.

0
On

I assume you are using the Apify CLI. Just start the run with apify run -p. -p means it purges the old request queue.