Beautiful Soup Returns Empty List
Solution 1:
you are getting this [] because data you want to scrape is coming from API which loads after you web page load so page you are accessing does not contain that class
you can open you browser console and check in network as given in screenshot there you find data you want to scrape so you have to make request to that URL to get data
you can retrive data in this URL in preview tab you can see all data.
also if you have good knowledge of python you can also use this to scrape data
Solution 2:
Even though you were able to see the 'tbody', class_ = 'TableBody-kSbjpE jGqIxa'
in the element inspector, the request that you make does not contain this class. See for yourself print(soup.prettify())
. This is most likely because you're not requesting the correct url.
This may be not something you're aware of, but as a fyi:
You don't actually need to scrape using BeautifulSoup, you can get a list of all the available datasets from the API. Once you have it installed and configured, you can get the dataset: kaggle datasets download -d
. Here's more info if you wish to proceed with the API instead: https://github.com/Kaggle/kaggle-api
Post a Comment for "Beautiful Soup Returns Empty List"