[Python] Cloudflare Blocking Playwright Script for Glassdoor Web Scraping

Discussão em 'Python' iniciado por Stack, Março 4, 2025.

  1. Stack

    Stack Membro Participativo

    I am trying to scrape reviews from Glassdoor using Playwright (Python). Initially, I attempted automating the login, but Glassdoor's Cloudflare anti-bot detection flagged and blocked my requests.

    To bypass this, I tried cookie injection by manually exporting session cookies from my authenticated browser and loading them into my Playwright script. This worked temporarily, allowing me to scrape reviews. However, after some time, even when starting my script with valid session cookies, Cloudflare now shows a CAPTCHA before reaching the URL, blocking my access entirely.

    Has anyone encountered this issue, and what possible solutions could help bypass this detection?

    Continue reading...

Compartilhe esta Página