The Gavagai Explorer Large Tier has a feature for scraping reviews from certain websites. List of supported sites at the bottom.


You need to be on the Large Tier.


You will be able to scrape a maximum of 500,000 texts. If you go over you will be charged for overage so be careful which URLs you choose. You can also use previously scraped data from our repository.


Once the feature is activated you will see a button "Scrape Data" which you can click. 



Clicking the button will bring you to this page:


You need to provide one of the two following values.


1: Optional. The URL to scrape from, for example 


https://play.google.com/store/apps/details?id=com.joelapenna.foursquared&hl=en&showAllReviews=true

https://www.capterra.com/p/161304/OneDrive/

https://apps.apple.com/gb/app/karma-the-surplus-food-app/id1087490062


etc


2: Optional. A Google search query that when searched results in the Google My Business listing as a search result. You can test your search query in a regular Google search browser tab to make sure that the result you are looking for actually appears as the Google My Business result.


Here is an example screen shot of a result after searching for "Apollo Sverige":



As you can see we have the Google My Business entry on the right hand side of the results list.


hm 111 5th ave - this would result in the google reviews scraped for the HM at 111 5th ave. Y

five guys burgers nyc 253 w - this would result in the google reviews scraped for the Five Guys burger chain.


3: Max number - we recommend to scrape the minimum amount needed. The more reviews the longer the scraping will take. Around 50,000 reviews is a good number to keep as a maximum.


4: use the ISO 639-1 codes for languages to filter out. Here is a list of all of them: https://en.wikipedia.org/wiki/List_of_ISO_639-1_codes




Note this is a beta feature so occasionally some of the features might not work and things might change such as price. The reviews scraped will become a red link that when clicked results in a CSV file you can use for The Explorer. The file will be available for all Scrape users to share and download. 


List of Sites as of Jan 2020:


Agoda 

Airbnb 

AliExpress 

AlternativeTo 

Amazon  (US and FR marketplaces, others coming soon)

Apartmentratings 

Apartments 

Apple Appstore 

Avvo 

BBB 

Booking.com 

Capterra 

CarGurus 

Cars.com 

Citysearch 

Classpass  

Consumer Affairs 

CreditKarma 

CustomerLobby 

DealerRater 

Ebay 

Edmunds 

Etsy 

Expedia  (Only hotels reviews)

Facebook*  Some are blocked by facebook.

FindLaw 

Foursquare 

G2Crowd 

Gartner 

Glassdoor 

Google 

Google Playstore 

Greatschools  

Healthgrades 

HomeAdvisor 

HomeAway 

Homestars 

Hotels.com 

Houzz 

Indeed 

Insider Pages 

IT Central Station 

Lawyers.com 

Lending Tree 

Martindale 

Niche  

OpenRice 

Opentable 

ProductHunt 

ProductReview.com.au 

RateMDs  (Only doctors)

ReserveOut 

Sitejabber 

SoftwareAdvice 

Talabat 

The Knot 

Thumbtack 

TripAdvisor 

Trulia 

TrustedShops 

Trustpilot 

TrustRadius 

Vitals 

Walmart 

WeddingWire 

Yell 

YellowPages 

Yelp 

Zillow 

ZocDoc 

Zomato 



Search Terms: What if I don't have any text data. I don't have text data. Scrape Reviews. Scraping Reviews.