I think part of the problem is the SS bypass function is just not great. Another part might be not having everything whitelisted that needs to be. For example, using the NoScript browser plugin I can see that this webpage right here attempts connections to reddit.com, redditmedia.com, redditstatic.com, datadome.co, google.com and sentry.io. Source: over 1 year ago

We have AWS enterprise support, after weeks of trying to mitigate with WAF under the direction of AWS, they finally recommended DataDome to us (via AWS MarketPlace) and admitted that Shield/WAF isn't as advanced as their solution. Source: about 2 years ago

There are specialized products like https://datadome.co/ (disclaimer: I know them) which are specialized in bot protection, they're probably too expensive for a personal use but maybe you can try reaching their support to see if there'd be a way to get it cheap for personal use. Source: almost 3 years ago

DataDome | NYC / Paris | Full Time | Onsite or Remote https://datadome.co https://docs.datadome.co/ Bot hunters is a full time job! With our SaaS cybersecurity technology, we detect and manage non-human traffic in real-time to protect our clients’ websites and APIs. Named as a Strong Performer by Forrester, DataDome is a growing cybersecurity pioneering in bot detection and protection for content publishers,... - Source: Hacker News / about 3 years ago

Wrapapi.com — Turn any website into a parameterized API. 30k API calls per month. - Source: dev.to / almost 3 years ago

Try wrapapi.com for data scraping. And then you can use something like autocode to schedule a fetch of that wrapapi URL and write a new row in a google sheet. DM me if you need any help. Source: over 3 years ago