Project Description
The small automation that used to pull weekly figures from a password-protected website into my existing Google Sheet stopped working after the site detected my developer’s bot and black-listed his IP. I still have full access to the account by normal browser login (standard username / password, no 2FA), and the sheet structure is already in place; I simply need the data flow restored and hardened against future blocks.
Here’s what I need from you:
• Re-establish a reliable scraping routine that logs in with my credentials, captures the same weekly figures, and appends them to the correct tabs/columns in the sheet.
• Implement whatever anti-blocking measures you feel are appropriate—rotating proxy, human-like delays, headless Chrome, Puppeteer, Apps Script with URL Fetch, or a lightweight Python/Node job that runs on a scheduler—so the site no longer flags the traffic.
• Keep the solution easy for me to maintain: credentials stored securely, clear comments in the code, and instructions on how to update or redeploy if the site layout changes.
• Provide a quick test run to prove the numbers arrive in the sheet without manual intervention, then schedule it to trigger automatically each week.
If you’ve handled login-required scraping into Google Sheets before, especially where blocking is an issue, I’d love to see it working again fast.