I am trying to scrape this
The first page is loading correct but whenever I run the below code, it doesnt give any error and returns data of the first page. I tried several ways but was unable to scrape the other pages data.
this.thenClick('tr[class^="bottomPaginator"] li:nth-child(5)').then(function() {
this.waitFor(function() {
return /\d+ Jobs/.test(this.fetchText('span.jobCount'));
}, processPage, terminate, 4000);
});
Please let me know if this is possible with CasperJS.
I am interested in PY Scrapy as-well if possible.
Thanks