Need help with a 407 response? I can't solve this problem. I had a parser for a Korean car site that worked daily for one month until it showed a 407 error. I googled that the problem is solved by proxy substitution, but either I'm doing something wrong, or the proxy does not fix the problem.
Sample code to test:
import requests
proxies = {
'https': 'http://user:[email protected]:xxxx'
}
url = 'https://api.encar.com/search/car/list/mobile?count=true&q=(And.Hidden.N._.(C.CarType.N._.Manufacturer.%EB%A7%88%EC%AF%94%EB%8B%A4.))&sr=%7CModifiedDate%7C0%7C200&inav=%7CMetadata%7CSort'
response = requests.get(url, proxies=proxies)
print(response.status_code)
Found a solution to my problem. In order to not receive a 407 response, it was necessary to receive cookies from the site and send them along with my request, which was in question.
In order not to get an error again, I used the selenium library, which launched the browser in the background and updated cookies every 5 hours.
P.S. Empirically, I came to the conclusion that cookies stop working after 8 hours.