Back to all Bounties
Earn 18,000 ($180.00)
due 2 years ago
Completed
Website Scraper
AshwinJey
Details
Applications
7
Discussion
This Bounty has been completed!
@AshwinJey's review of @internetexplorer“internetexplorer has been great to work with, he delivers on time and makes sure he meets the clients requirements. I would definitely use internextexplorer for future bounties . ”
4.7
Communication 5/5, Quality 4/5, Timeliness 5/5Bounty Description
Build a python script to scrape the website below:
https://weedmaps.com/
Based on a particular region, we need to scrape the following:
- Dispensaries in that region
- Menu Items offered by the dispensary
- Products
- Brands
- Pricing for their products
- Deals offered by the Dispensary
Desired Data Schema:
https://docs.google.com/spreadsheets/d/1BWY0Ms9eCQ-e9sz1JocmQnn-5oMh0hX3F7MfHty7G-Q/edit?usp=sharing
The website may block incoming GET requests so use the following headers below if it helps:
headers = {
"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3"}
The scraping can be triggered by the user on a ad hoc basis locally on their terminal/machine.
Data scraped can be saved in AirTable or save locally in CSV format.