Skip to content

Ecommerce Content Retrieval APIs

One API endpoint, 50+ platforms: Extract structured e-commerce data with a simple platform parameter

Overview

The Unwrangle Ecommerce Content Retrieval APIs provide a revolutionary approach to e-commerce data extraction. Instead of learning different APIs for each platform, you use one unified endpoint with a simple platform parameter to access data from over 50 retailers.

What Makes Our API Unique

🔧 One Endpoint, Multiple Platforms
No need to integrate multiple APIs. Just change the platform parameter to switch between Amazon, Walmart, Target, and dozens more.

🎯 Consistent Data Structure
Receive normalized, structured JSON responses regardless of the source platform.

⚡ Real-Time Data
Always get the latest product information, prices, and availability directly from the source.

🛡️ Built-In Resilience
We handle anti-bot systems, CAPTCHAs, and rate limiting so you don't have to.

What You Can Extract

  • Product Details - Comprehensive product information including specifications, images, variants, and real-time pricing
  • Search Results - Product listings from keyword searches with filters and sorting
  • Category Listings - Browse entire departments and categories with pagination
  • Customer Reviews - Ratings, review text, and verified purchase indicators

How It Works

The Power of One Endpoint

Traditional approach requires different APIs for each platform: 

❌ https://api.example.com/amazon/products
❌ https://api.example.com/walmart/search
❌ https://api.example.com/target/categories

Our unified approach uses just ONE endpoint: 

✅ https://data.unwrangle.com/api/getter/

Simply change the platform parameter to switch between any supported retailer. This means: - 🚀 Faster Integration - Learn once, use everywhere - 🔧 Easier Maintenance - One SDK/library handles all platforms - 📊 Consistent Data - Same response structure across all retailers - 🛡️ Unified Error Handling - One set of error codes and retry logic

Understanding the Platform Parameter

The magic of our unified API lies in the platform parameter. This single parameter controls: - Which retailer to extract data from - What type of data to retrieve

The Simple Formula

platform = {retailer}_{datatype}

Available Data Types

Data Type Suffix What It Does Example URL Parameter
Product Details _detail Extracts complete product information url=https://amazon.com/dp/B001...
Search Results _search Returns product listings from searches search=laptop&page=1
Category Browse _category Lists all products in a category/department url=https://amazon.com/s?rh=n:123...
Customer Reviews _reviews Fetches product reviews and ratings url=https://amazon.com/dp/B001...

Real-World Examples

# Get iPhone details from Amazon
platform=amazon_detail&url=https://amazon.com/dp/B0BCHJB3JH

# Search for "gaming laptop" on BestBuy
platform=bestbuy_search&search=gaming+laptop

# Browse Home Depot's power tools category
platform=homedepot_category&url=https://homedepot.com/b/Tools/N-5yc1v

# Get Walmart product reviews
platform=walmart_reviews&url=https://walmart.com/ip/12345

Pro Tip

The platform parameter is case-sensitive and uses underscores. Always use lowercase for the retailer name (e.g., walmart, not Walmart or WalMart).

Supported Platforms

Currently Active

Amazon
✓ Product Details
✓ Search Results
✓ Categories
✓ Reviews
Walmart
✓ Product Details
✓ Search Results
✓ Categories
✓ Reviews
Target
✓ Product Details
✓ Search Results
✓ Reviews
BestBuy
✓ Product Details
✓ Search Results
✓ Reviews
Costco
✓ Product Details
✓ Search Results
✓ Categories
✓ Reviews
Home Depot
✓ Product Details
✓ Search Results
✓ Reviews
Lowes
✓ Product Details
✓ Search Results
✓ Categories
✓ Reviews
Sam's Club
✓ Product Details
✓ Search Results
✓ Reviews

Additional Platforms

  • Build.com - Product details, search, categories
  • Wayfair - Product details, search, categories
  • Mercado Livre - Product details, search, reviews
  • Yelp - Business details, search, reviews
  • Overstock - Product details
  • Bed Bath & Beyond - Product details
  • Ace Hardware - Search
  • Tesco - Product details, reviews
  • Currys - Reviews
  • MediaMarkt - Reviews

Platforms Under Development

Coming Soon

We're actively working on adding support for:

  • AliExpress - Global marketplace (currently in beta testing)
  • Shopee - Southeast Asian e-commerce (development in progress)
  • eBay - Auction and fixed-price listings
  • Etsy - Handmade and vintage items

These platforms require special handling due to their unique anti-bot measures and regional variations. Contact us for early access or to request priority for a specific platform.

API Usage

Required Parameters

All API calls require: 1. api_key - Your API key from the Unwrangle Console 2. platform - The platform and data type (e.g., amazon_detail) 3. Additional parameters based on the data type: - For product details: url (encoded product URL) - For search: search (search keywords) - For categories: url (encoded category URL)

URL Encoding

Important

Always URL-encode the url parameter when passing product or category URLs. Most programming languages have built-in functions for this: - Python: urllib.parse.quote() - JavaScript: encodeURIComponent() - PHP: urlencode()

Quick Start Examples

1. Get Product Details

Extract comprehensive product information from any supported platform:

curl -L -X GET 'https://data.unwrangle.com/api/getter/?url=https%3A%2F%2Fwww.amazon.com%2FIsopure-Protein-Powder-Isolate-Flavor%2Fdp%2FB000E8ZJGS%2F&platform=amazon_detail&api_key=<API_KEY>'

import requests
from urllib.parse import quote

product_url = "https://www.amazon.com/Isopure-Protein-Powder-Isolate-Flavor/dp/B000E8ZJGS/"
encoded_url = quote(product_url)

response = requests.get(
    "https://data.unwrangle.com/api/getter/",
    params={
        "url": encoded_url,
        "platform": "amazon_detail",
        "api_key": "<API_KEY>"
    }
)

print(response.json())

2. Search Products

Search for products across any supported platform:

curl -L -X GET 'https://data.unwrangle.com/api/getter/?search=laptop&platform=bestbuy_search&api_key=<API_KEY>'

import requests

response = requests.get(
    "https://data.unwrangle.com/api/getter/",
    params={
        "search": "laptop",
        "platform": "bestbuy_search",
        "page": 1,
        "api_key": "<API_KEY>"
    }
)

print(response.json())

3. Browse Categories

Get all products from a specific category:

curl -L -X GET 'https://data.unwrangle.com/api/getter/?url=https%3A%2F%2Fwww.amazon.com%2Fs%3Frh%3Dn%253A23550734011%26fs%3Dtrue&platform=amazon_category&api_key=<API_KEY>'

import requests
from urllib.parse import quote

category_url = "https://www.amazon.com/s?rh=n%3A23550734011&fs=true"
encoded_url = quote(category_url)

response = requests.get(
    "https://data.unwrangle.com/api/getter/",
    params={
        "url": encoded_url,
        "platform": "amazon_category",
        "page": 1,
        "api_key": "<API_KEY>"
    }
)

print(response.json())

Response Format

All successful API responses follow a consistent JSON structure:

{
    "success": true,
    "url": "https://...",           // The URL that was processed
    "result_count": 1,              // Number of results returned
    "detail": {...},                // For product details
    "results": [...],               // For search/category results
    "total_results": 1000,          // Total available results
    "no_of_pages": 20               // Total pages available
}

Credit Usage

API credits are deducted based on the platform and operation:

Operation Type Credit Cost Notes
Product Details Varies by platform See individual platform docs
Search Results 10 credits or 1 per result (whichever is higher) BestBuy: 50 credits flat
Category Browse 1-2.5 credits Depends on platform
Reviews Varies by platform See Reviews API

Best Practices

1. Smart Rate Limiting

Our API handles rate limiting automatically, but for optimal performance: - Concurrent Requests: Up to 10 parallel requests per API key - Burst Capacity: 100 requests per minute - Retry Strategy: Use exponential backoff starting at 1 second

2. Efficient Credit Usage

  • Cache Results: Store product data for at least 24 hours
  • Batch Operations: Use category/search endpoints instead of individual product calls when possible
  • Monitor Usage: Check remaining credits in response headers or via the console

3. URL Best Practices

# ✅ Good: Clean product URL
url = "https://www.amazon.com/dp/B08N5WRWNW"

# ❌ Bad: URL with tracking parameters
url = "https://www.amazon.com/Echo-4th-Gen/dp/B08N5WRWNW?ref=abc&tag=xyz"

# Always encode URLs
encoded_url = urllib.parse.quote(url)

4. Error Handling

if response.status_code == 429:
    # Rate limited - wait and retry
    time.sleep(retry_delay)
elif response.status_code == 402:
    # Insufficient credits
    log.error("Please add more credits")
elif response.status_code == 400:
    # Invalid parameters
    log.error("Check platform parameter and URL")

Detailed API Documentation

For platform-specific details, parameters, and response schemas:

Product Details APIs

Search APIs

Category APIs

Review APIs

  • Online Reviews API - Unified reviews endpoint
  • Platform-specific review APIs available for most retailers

Need Help?

Don't see your platform? We're constantly adding new integrations. Contact us to request support for additional platforms.