Skip to content

Overview

Unwrangle's Scraper API is a service that acts as an API wrapper for popular e-commerce and business listing websites. It makes it possible to scrape and collect structured JSON data at scale from HTML webpages in real-time without the need to manually configure parsers, rotate proxies or bypass captchas and other anti-bot software.

The API enables users to scrape search results, product details and customer reviews from the websites listed below simply with a GET request. The objective of this service is to help make public data for accessible for developers, data scientists and analysts, so that you can focus on applying data without having to worry about bypassing anti-bot software.

Run in Postman

Types of Web Scrapers

We have essentially 3 types of parsers or web scrapers. They are categorised according to the type of result they return.

  1. search - these scrapers are designed to help you extract the search results pages of popular e-commerce marketplaces and can be invoked with the query parameter platform=platform_search

  2. detail - these scrapers are used to extract more attributes for a single product using its URL and can be invoked with the query parameter platform=platform_detail

  3. reviews - these scrapers are designed to help you extract the customer reviews for any product also with its URL and can be invoked with the query parameter platform=platform_reviews

Note

The query parameter platform sets the scraper you wish to invoke. Its value is a combination of the platform's name and the type of web data you are looking to collect. The types are listed above and platforms supported are listed below.

As an example, if you are looking to scrape search results from Amazon: the value for the query parameter platform must equal to amazon_search.

Supported Platforms - API Wrappers

Our Scraper API supports scraping from the following platforms. If you don't see the platform you're interested in collecting data from, just shoot us an email at support@unwrangle.com, and we'll try our best to help you in your data grabbing endeavours.

Name Search Product Reviews
Amazon ✅ ✅ ✅
BestBuy ✅ ✅ ✅
Home Depot ✅ ✅ ✅
Costco ✅ ✅ ✅
Sams Club ✅ ✅ ✅
Lowes ✅ ✅ ✅
Target ✅ ✅ ✅
Shopee ✅ ✅
Yelp ✅

To get your API key and purchase credits please sign up with your email here or contact us at support@unwrangle.com.

General Usage

The following API endpoint allows you to scrape data from the platforms listed above. 

https://data.unwrangle.com/api/getter/

Support

If you have any questions regarding our API or documentation, please contact us at support@unwrangle.com