[Python] request_html.render() working on windows, but not on Ubuntu

Discussão em 'Python' iniciado por Stack, Janeiro 31, 2025.

  1. Stack

    Stack Membro Participativo

    I have following code:

    from requests_html import HTMLSession()
    session = HTMLSession()

    response = session.get(url)
    response.html.render() # <- causes error
    page_soup = soup(response.html.html, "html.parser")
    response.close()


    which I'm trying to parse website with JS. Independently of which website I tried to render i get following error on Ubuntu:

    Traceback (most recent call last):
    File "<stdin>", line 1, in <module>
    File "/home/project1/project1_venv/lib/python3.8/site-packages/requests_html.py", line 586, in render
    self.browser = self.session.browser # Automatically create a event loop and browser
    File "/home/project1/project1_venv/lib/python3.8/site-packages/requests_html.py", line 730, in browser
    self._browser = self.loop.run_until_complete(super().browser)
    File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
    File "/home/project1/project1_venv/lib/python3.8/site-packages/requests_html.py", line 714, in browser
    self._browser = await pyppeteer.launch(ignoreHTTPSErrors=not(self.verify), headless=True, args=self.__browser_args)
    File "/home/project1/project1_venv/lib/python3.8/site-packages/pyppeteer/launcher.py", line 306, in launch
    return await Launcher(options, **kwargs).launch()
    File "/home/project1/project1_venv/lib/python3.8/site-packages/pyppeteer/launcher.py", line 167, in launch
    self.browserWSEndpoint = get_ws_endpoint(self.url)
    File "/home/project1/project1_venv/lib/python3.8/site-packages/pyppeteer/launcher.py", line 226, in get_ws_endpoint
    raise BrowserError('Browser closed unexpectedly:\n')
    pyppeteer.errors.BrowserError: Browser closed unexpectedly:


    When I run the same code on my local computer with Windows 10 everything works fine.

    In both environments the same versions of library:

    requests-html==0.10.0


    But on windows I have Python 3.7.2 and on Linux server Python 3.8.6. It's problem? In both environments I using venvs.

    I have installed chromium on Ubuntu.

    Continue reading...

Compartilhe esta Página