The Gavagai Explorer Large Tier has a feature for scraping reviews from certain websites. List of supported sites at the bottom.
You need to be on the Large Tier.
You will be able to scrape a maximum of 500,000 texts. If you go over you will be charged for overage so be careful which URLs you choose. You can also use previously scraped data from our repository.
Once the feature is activated you will see a button "Scrape Data" which you can click.
Clicking the button will bring you to this page:
You need to provide one of the two following values.
1: Optional. The URL to scrape from, for example
https://play.google.com/store/apps/details?id=com.joelapenna.foursquared&hl=en&showAllReviews=true
https://www.capterra.com/p/161304/OneDrive/
https://apps.apple.com/gb/app/karma-the-surplus-food-app/id1087490062
etc
2: Optional. A Google search query that when searched results in the Google My Business listing as a search result. You can test your search query in a regular Google search browser tab to make sure that the result you are looking for actually appears as the Google My Business result.
Here is an example screen shot of a result after searching for "Apollo Sverige":
As you can see we have the Google My Business entry on the right hand side of the results list.
hm 111 5th ave - this would result in the google reviews scraped for the HM at 111 5th ave. Y
five guys burgers nyc 253 w - this would result in the google reviews scraped for the Five Guys burger chain.
3: Max number - we recommend to scrape the minimum amount needed. The more reviews the longer the scraping will take. Around 50,000 reviews is a good number to keep as a maximum.
4: use the ISO 639-1 codes for languages to filter out. Here is a list of all of them: https://en.wikipedia.org/wiki/List_of_ISO_639-1_codes
Note this is a beta feature so occasionally some of the features might not work and things might change such as price. The reviews scraped will become a red link that when clicked results in a CSV file you can use for The Explorer. The file will be available for all Scrape users to share and download.
List of Sites as of Jan 2020:
Agoda
Airbnb
AliExpress
AlternativeTo
Amazon (US and FR marketplaces, others coming soon)
Apartmentratings
Apartments
Apple Appstore
Avvo
BBB
Booking.com
Capterra
CarGurus
Cars.com
Citysearch
Classpass
Consumer Affairs
CreditKarma
CustomerLobby
DealerRater
Ebay
Edmunds
Etsy
Expedia (Only hotels reviews)
Facebook* Some are blocked by facebook.
FindLaw
Foursquare
G2Crowd
Gartner
Glassdoor
Google Playstore
Greatschools
Healthgrades
HomeAdvisor
HomeAway
Homestars
Hotels.com
Houzz
Indeed
Insider Pages
IT Central Station
Lawyers.com
Lending Tree
Martindale
Niche
OpenRice
Opentable
ProductHunt
ProductReview.com.au
RateMDs (Only doctors)
ReserveOut
Sitejabber
SoftwareAdvice
Talabat
The Knot
Thumbtack
TripAdvisor
Trulia
TrustedShops
Trustpilot
TrustRadius
Vitals
Walmart
WeddingWire
Yell
YellowPages
Yelp
Zillow
ZocDoc
Zomato
Search Terms: What if I don't have any text data. I don't have text data. Scrape Reviews. Scraping Reviews.