I know the webscraping and I have taken the data from different website and I am using python language and selenium webdriver chrome. But I call a website it is open front page and then I click or go any other page then website restrict me and website know that I am using automated chrome.
How can I scrape a website without getting detected and bypassing reCAPTCHA using selenium webdriver through Python?
7.9k Views Asked by Imran Rafiq At
2
There are 2 best solutions below
1

This may be because the website uses reCAPTCHA v3, which "allows you to verify if an interaction is legitimate without any user interaction". This means that they can identify if you are not a human without asking you to check the famous "I'm not a robot" box. That box is used in the former version of reCAPTCHA, v2.
Read more about reCAPTCHA here: https://developers.google.com/recaptcha/docs/versions
I don't think it's possible to work around this with Selenium. And, as was already mentioned, web scraping is often illegal.
These days, websites can detect your program as a BOT pretty easily. Currently Google have 4(four) reCAPTCHA to choose and implement from when creating a new site.
Solution
However there are some generic approaches to avoid getting detected while web-scraping:
time.sleep(secs)
. Here you can find a detailed discussion on How to sleep webdriver in python for millisecondsOutro
See: