Ecommerce Content Retrieval APIs
One API endpoint, 50+ platforms: Extract structured e-commerce data with a simple platform parameter
Overview
The Unwrangle Ecommerce Content Retrieval APIs provide a revolutionary approach to e-commerce data extraction. Instead of learning different APIs for each platform, you use one unified endpoint with a simple platform
parameter to access data from over 50 retailers.
What Makes Our API Unique
🔧 One Endpoint, Multiple Platforms
No need to integrate multiple APIs. Just change the platform
parameter to switch between Amazon, Walmart, Target, and dozens more.
🎯 Consistent Data Structure
Receive normalized, structured JSON responses regardless of the source platform.
⚡ Real-Time Data
Always get the latest product information, prices, and availability directly from the source.
🛡️ Built-In Resilience
We handle anti-bot systems, CAPTCHAs, and rate limiting so you don't have to.
What You Can Extract
- Product Details - Comprehensive product information including specifications, images, variants, and real-time pricing
- Search Results - Product listings from keyword searches with filters and sorting
- Category Listings - Browse entire departments and categories with pagination
- Customer Reviews - Ratings, review text, and verified purchase indicators
How It Works
The Power of One Endpoint
Traditional approach requires different APIs for each platform:
❌ https://api.example.com/amazon/products
❌ https://api.example.com/walmart/search
❌ https://api.example.com/target/categories
Our unified approach uses just ONE endpoint:
✅ https://data.unwrangle.com/api/getter/
Simply change the platform
parameter to switch between any supported retailer. This means:
- 🚀 Faster Integration - Learn once, use everywhere
- 🔧 Easier Maintenance - One SDK/library handles all platforms
- 📊 Consistent Data - Same response structure across all retailers
- 🛡️ Unified Error Handling - One set of error codes and retry logic
Understanding the Platform Parameter
The magic of our unified API lies in the platform
parameter. This single parameter controls:
- Which retailer to extract data from
- What type of data to retrieve
The Simple Formula
platform = {retailer}_{datatype}
Available Data Types
Data Type | Suffix | What It Does | Example URL Parameter |
---|---|---|---|
Product Details | _detail |
Extracts complete product information | url=https://amazon.com/dp/B001... |
Search Results | _search |
Returns product listings from searches | search=laptop&page=1 |
Category Browse | _category |
Lists all products in a category/department | url=https://amazon.com/s?rh=n:123... |
Customer Reviews | _reviews |
Fetches product reviews and ratings | url=https://amazon.com/dp/B001... |
Real-World Examples
# Get iPhone details from Amazon
platform=amazon_detail&url=https://amazon.com/dp/B0BCHJB3JH
# Search for "gaming laptop" on BestBuy
platform=bestbuy_search&search=gaming+laptop
# Browse Home Depot's power tools category
platform=homedepot_category&url=https://homedepot.com/b/Tools/N-5yc1v
# Get Walmart product reviews
platform=walmart_reviews&url=https://walmart.com/ip/12345
Pro Tip
The platform parameter is case-sensitive and uses underscores. Always use lowercase for the retailer name (e.g., walmart
, not Walmart
or WalMart
).
Supported Platforms
Currently Active
✓ Product Details
✓ Search Results
✓ Categories
✓ Reviews
✓ Product Details
✓ Search Results
✓ Categories
✓ Reviews
✓ Product Details
✓ Search Results
✓ Reviews
✓ Product Details
✓ Search Results
✓ Reviews
✓ Product Details
✓ Search Results
✓ Categories
✓ Reviews
✓ Product Details
✓ Search Results
✓ Reviews
✓ Product Details
✓ Search Results
✓ Categories
✓ Reviews
✓ Product Details
✓ Search Results
✓ Reviews
Additional Platforms
- Build.com - Product details, search, categories
- Wayfair - Product details, search, categories
- Mercado Livre - Product details, search, reviews
- Yelp - Business details, search, reviews
- Overstock - Product details
- Bed Bath & Beyond - Product details
- Ace Hardware - Search
- Tesco - Product details, reviews
- Currys - Reviews
- MediaMarkt - Reviews
Platforms Under Development
Coming Soon
We're actively working on adding support for:
- AliExpress - Global marketplace (currently in beta testing)
- Shopee - Southeast Asian e-commerce (development in progress)
- eBay - Auction and fixed-price listings
- Etsy - Handmade and vintage items
These platforms require special handling due to their unique anti-bot measures and regional variations. Contact us for early access or to request priority for a specific platform.
API Usage
Required Parameters
All API calls require:
1. api_key
- Your API key from the Unwrangle Console
2. platform
- The platform and data type (e.g., amazon_detail
)
3. Additional parameters based on the data type:
- For product details: url
(encoded product URL)
- For search: search
(search keywords)
- For categories: url
(encoded category URL)
URL Encoding
Important
Always URL-encode the url
parameter when passing product or category URLs. Most programming languages have built-in functions for this:
- Python: urllib.parse.quote()
- JavaScript: encodeURIComponent()
- PHP: urlencode()
Quick Start Examples
1. Get Product Details
Extract comprehensive product information from any supported platform:
curl -L -X GET 'https://data.unwrangle.com/api/getter/?url=https%3A%2F%2Fwww.amazon.com%2FIsopure-Protein-Powder-Isolate-Flavor%2Fdp%2FB000E8ZJGS%2F&platform=amazon_detail&api_key=<API_KEY>'
import requests
from urllib.parse import quote
product_url = "https://www.amazon.com/Isopure-Protein-Powder-Isolate-Flavor/dp/B000E8ZJGS/"
encoded_url = quote(product_url)
response = requests.get(
"https://data.unwrangle.com/api/getter/",
params={
"url": encoded_url,
"platform": "amazon_detail",
"api_key": "<API_KEY>"
}
)
print(response.json())
2. Search Products
Search for products across any supported platform:
curl -L -X GET 'https://data.unwrangle.com/api/getter/?search=laptop&platform=bestbuy_search&api_key=<API_KEY>'
import requests
response = requests.get(
"https://data.unwrangle.com/api/getter/",
params={
"search": "laptop",
"platform": "bestbuy_search",
"page": 1,
"api_key": "<API_KEY>"
}
)
print(response.json())
3. Browse Categories
Get all products from a specific category:
curl -L -X GET 'https://data.unwrangle.com/api/getter/?url=https%3A%2F%2Fwww.amazon.com%2Fs%3Frh%3Dn%253A23550734011%26fs%3Dtrue&platform=amazon_category&api_key=<API_KEY>'
import requests
from urllib.parse import quote
category_url = "https://www.amazon.com/s?rh=n%3A23550734011&fs=true"
encoded_url = quote(category_url)
response = requests.get(
"https://data.unwrangle.com/api/getter/",
params={
"url": encoded_url,
"platform": "amazon_category",
"page": 1,
"api_key": "<API_KEY>"
}
)
print(response.json())
Response Format
All successful API responses follow a consistent JSON structure:
{
"success": true,
"url": "https://...", // The URL that was processed
"result_count": 1, // Number of results returned
"detail": {...}, // For product details
"results": [...], // For search/category results
"total_results": 1000, // Total available results
"no_of_pages": 20 // Total pages available
}
Credit Usage
API credits are deducted based on the platform and operation:
Operation Type | Credit Cost | Notes |
---|---|---|
Product Details | Varies by platform | See individual platform docs |
Search Results | 10 credits or 1 per result (whichever is higher) | BestBuy: 50 credits flat |
Category Browse | 1-2.5 credits | Depends on platform |
Reviews | Varies by platform | See Reviews API |
Best Practices
1. Smart Rate Limiting
Our API handles rate limiting automatically, but for optimal performance: - Concurrent Requests: Up to 10 parallel requests per API key - Burst Capacity: 100 requests per minute - Retry Strategy: Use exponential backoff starting at 1 second
2. Efficient Credit Usage
- Cache Results: Store product data for at least 24 hours
- Batch Operations: Use category/search endpoints instead of individual product calls when possible
- Monitor Usage: Check remaining credits in response headers or via the console
3. URL Best Practices
# ✅ Good: Clean product URL
url = "https://www.amazon.com/dp/B08N5WRWNW"
# ❌ Bad: URL with tracking parameters
url = "https://www.amazon.com/Echo-4th-Gen/dp/B08N5WRWNW?ref=abc&tag=xyz"
# Always encode URLs
encoded_url = urllib.parse.quote(url)
4. Error Handling
if response.status_code == 429:
# Rate limited - wait and retry
time.sleep(retry_delay)
elif response.status_code == 402:
# Insufficient credits
log.error("Please add more credits")
elif response.status_code == 400:
# Invalid parameters
log.error("Check platform parameter and URL")
Detailed API Documentation
For platform-specific details, parameters, and response schemas:
Product Details APIs
- Amazon Product Data API
- Walmart Product Data API
- Target Product Data API
- BestBuy Product Data API
- Costco Product Data API
- Home Depot Product Data API
- Lowes Product Data API
- Sam's Club Product Data API
Search APIs
- Amazon Product Search API
- Walmart Product Search API
- Target Product Search API
- BestBuy Search Results API
- Costco Search Results API
- Home Depot Search Results API
- Lowes Product Search API
- Sam's Club Product Search API
Category APIs
- Amazon Category Search API
- Costco Category Search API
- Lowes Category Search API
- Wayfair Category Search API
Review APIs
- Online Reviews API - Unified reviews endpoint
- Platform-specific review APIs available for most retailers
Need Help?
- Email: support@unwrangle.com
- Documentation: Full API reference for each platform
- Console: Monitor usage and manage API keys
Don't see your platform? We're constantly adding new integrations. Contact us to request support for additional platforms.