Is requests-html's render unable to load soundcloud.com?
I'm trying to do the Scraping SoundCloud assigment, and here are the Jupyter cells I'm running:
from bs4 import BeautifulSoup from requests_html import AsyncHTMLSession
r = await session.get("https://soundcloud.com/discover") r.status_code
soup = BeautifulSoup(r.html.html, 'lxml') with open('soundcloud_pretty.html', 'wb') as f: f.write(soup.prettify('utf-8'))
However the webpage doesn't seem to render, since it doesn't recognize the request as performed by a valid browser. I have walk through again every lesson that may cover such issue, but I couldn't find a solution. Here's the part of the webpage that informs the error: