site behaves noramlly when accessed through browser but the redirection issue occurs while accessing the site through scrapy bots.
I use Scrapy-Crawlera proxy services, still site redirects endlessly.
If i use handle_httpstatus_list = [302] or dont_redirect = True, i will get the response as
Object moved here.
I am hoping for any suggestions or answers as to why this behaviour occurs on certain sites? Unfortunatly i can not share the website URL.