[Python] Can't get inside <div id="app"></div> using BeautifulSoup

I'm trying to parse data from "https://www.marinetraffic.com/en/ais/details/ships/shipid:7411173/mmsi:352002090/imo:8593883/vessel:R_LINE" by class.

During parsing i am receiving content only partly which is not looks like full html page via inspector mode:

...
<meta content="MarineTraffic.com" data-react-helmet="true" property="og:site_name"/>
</head>
<body>
<div id="app"></div>
<script>(function(){function c(){var b=a.contentDocument||a.contentWindow.document;if(b){var d=b.createElement('script');d.innerHTML="window.__CF$cv$params={r:'8cac56113e61285a',t:'MTcyNzYxNjcxNC4wMDAwMDA='};var a=document.createElement('script');a.nonce='';a.src='/cdn-cgi/challenge-platform/scripts/jsd/main.js';document.getElementsByTagName('head')[0].appendChild(a);"
...


The data what i need is inside <div id="app"></div> . And at present moment i can't figure it out how to get inside this block.

Here is part of my code:

def get_html(url):
session = tls_client.Session(client_identifier="chrome112", random_tls_extension_order=True)
response = session.get(url, headers=HEADERS)
return response


def get_content(html):
soup = BeautifulSoup(html, 'lxml')
# here will be part of code after getting inside <div id="app"></div>
return print(soup)


def parse():
html = get_html(URL)
if html.status_code == 200:
get_content(html.text)
else:
print('Error detected')
print(html.status_code)


parse()


Should i suspend using beatifulsoup on current stage cause i cant see solution? As i understood part of data which i need is client-side rendered. Any advise? Thank you.

Continue reading...