Unlock full-dimensional e-commerce data collection now!

Leverage Scrape API for data collection and Amazon Data Pilot for smart reporting to cover the full e-commerce data flow, helping sellers track trends, optimize products/ads, enhance efficiency, and drive growth.

Amazon Walmart Shopify Shopee ebay data_scraper.py import requests, pandas from bs4 import BeautifulSoup def scrape_data (url, selector): response = requests.get(url) soup = BeautifulSoup(response.text, 'html.parser') data = soup.select(selector) return [item.text for item in data] # Extract data from platforms amazon_data = scrape_data( 'https://www.amazon.com/gp/bestsellers/books/' , '.zg-item-immersion') walmart_data = scrape_data( 'https://www.walmart.com/browse/books' , '.shelf-item-tile')

Data Scraping Examples

数据抓取演示
Walmart
Amazon
Shopify
Shopee
eBay
Example URL:
https://www.walmart.com/search?q=samsung+galaxy
JSON result
{
  "products": [
    {
      "position": 1,
      "title": "AT&T Samsung Galaxy A14 5G, 64GB Black - Prepaid Smartphone",
      "image": "https://i5.walmartimages.com/seo/AT-T-Samsung-Galaxy-A14-5G-jpeg",
      "link": "https://wrd.walmart.com/track?bt=1&event=T-click&plmt=sp-search-middle-desktop",
      "price": {
        "currentPrice": "$79.88",
        "rawPrice": "79.88",
        "currency": "$"
      },
      "reviewsCount": "274",
      "ratings": "3.7",
      "shippingMessage": "Free pickup todayDelivery todayFree shipping, arrives in 2 days",
      "isBestSeller": false,
      "outOfStock": false
    },
    {
      "position": 2,
      "title": "AT&T Samsung Galaxy A15 5G 128GB Prepaid Smartphone",
      "image": "https://i5.walmartimages.com/seo/AT-T-Samsung-Galaxy-A15-5G-jpeg",
      "link": "https://wrd.walmart.com/track?bt=1&event=T-click&plmt=sp-search-middle-desktop",
      "price": {
        "currentPrice": "$89.88",
        "rawPrice": "89.88",
        "currency": "$"
      },
      "reviewsCount": "118",
      "ratings": "4.1",
      "shippingMessage": "Free pickup todayFree shipping, arrives in 2 days",
      "isBestSeller": false,
      "outOfStock": false
    }
  ]
}
示例URL:
https://www.amazon.com/s?k=desk
JSON结果
{
  "products": [
    {
      "position": 1,
      "title": "EUREKA ERGONOMIC Small Computer Desk, 40 inch Home Office Writing Desk, Modern Simple Study PC Laptop Table Workstation for Small Spaces, Black",
      "image": "https://m.media-amazon.com/images/I/71Xk56MJYzL._AC_UL320_.jpg",
      "link": "https://www.amazon.com/EUREKA-ERGONOMIC-Computer-Writing-Workstation/dp/B08PWZCGHN",
      "price": {
        "currentPrice": "$89.99",
        "originalPrice": "$119.99",
        "currency": "$",
        "discountPercentage": "25%"
      },
      "reviewsCount": "2,324",
      "ratings": "4.7",
      "isPrime": true,
      "delivery": "Get it by Tomorrow, Mar 22",
      "isBestSeller": true
    },
    {
      "position": 2,
      "title": "FLEXISPOT EC1 Electric Standing Desk, 48 x 24 Inches Height Adjustable Desk, Electric Sit Stand Desk Home Office Desks Whole-Piece Desk Board (Black Frame + 48 x 24 Mahogany Top)",
      "image": "https://m.media-amazon.com/images/I/71iBHR8pTdL._AC_UL320_.jpg",
      "link": "https://www.amazon.com/FLEXISPOT-Standing-Adjustable-Electric-Mahogany/dp/B09SHBD3KV",
      "price": {
        "currentPrice": "$179.99",
        "originalPrice": "$249.99",
        "currency": "$",
        "discountPercentage": "28%"
      },
      "reviewsCount": "6,117",
      "ratings": "4.5",
      "isPrime": true,
      "delivery": "Get it by Tuesday, Mar 26",
      "isBestSeller": false
    }
  ],
  "pagination": {
    "currentPage": 1,
    "totalPages": 20,
    "totalResults": "10,000+ results"
  }
}
示例URL:
https://store-example.myshopify.com/collections/all
JSON结果
{
  "products": [
    {
      "position": 1,
      "title": "Minimalist Cotton T-Shirt",
      "image": "https://cdn.shopify.com/s/files/1/0123/4567/products/tshirt-white.jpg",
      "link": "https://store-example.myshopify.com/products/minimalist-cotton-tshirt",
      "price": {
        "currentPrice": "$24.99",
        "originalPrice": "$29.99",
        "currency": "$",
        "discountPercentage": "17%"
      },
      "reviewsCount": "142",
      "ratings": "4.8",
      "shippingMessage": "Free shipping on orders over $50",
      "isBestSeller": true,
      "outOfStock": false
    },
    {
      "position": 2,
      "title": "Artisan Ceramic Coffee Mug",
      "image": "https://cdn.shopify.com/s/files/1/0123/4567/products/ceramic-mug.jpg",
      "link": "https://store-example.myshopify.com/products/artisan-ceramic-coffee-mug",
      "price": {
        "currentPrice": "$18.50",
        "currency": "$"
      },
      "reviewsCount": "89",
      "ratings": "4.6",
      "shippingMessage": "Free shipping on orders over $50",
      "isBestSeller": false,
      "outOfStock": false
    }
  ],
  "pagination": {
    "currentPage": 1,
    "totalPages": 4,
    "totalResults": "36 products"
  }
}
示例URL:
https://shopee.com/search?keyword=smartphone
JSON结果
{
  "products": [
    {
      "position": 1,
      "title": "Xiaomi Redmi Note 12 Pro 5G (8GB+256GB) Smartphone",
      "image": "https://cf.shopee.com/file/sg-11134201-23020-1xvpzw53aanve5",
      "link": "https://shopee.com/Xiaomi-Redmi-Note-12-Pro-i.123456789.12345678",
      "price": {
        "currentPrice": "$199.00",
        "originalPrice": "$249.00",
        "currency": "$",
        "discountPercentage": "20%"
      },
      "reviewsCount": "4.5k",
      "ratings": "4.9",
      "shippingMessage": "Free Shipping",
      "isBestSeller": true,
      "outOfStock": false,
      "soldCount": "8.2k sold"
    },
    {
      "position": 2,
      "title": "OPPO A78 (8GB+128GB) 5G Smartphone",
      "image": "https://cf.shopee.com/file/sg-11134201-23010-6pslxojzj9mvaa",
      "link": "https://shopee.com/OPPO-A78-8GB-128GB-i.987654321.87654321",
      "price": {
        "currentPrice": "$169.00",
        "originalPrice": "$219.00",
        "currency": "$",
        "discountPercentage": "23%"
      },
      "reviewsCount": "3.2k",
      "ratings": "4.7",
      "shippingMessage": "Free Shipping",
      "isBestSeller": false,
      "outOfStock": false,
      "soldCount": "5.6k sold"
    }
  ],
  "pagination": {
    "currentPage": 1,
    "totalPages": 50,
    "totalResults": "1,000+ results"
  }
}
示例URL:
https://www.ebay.com/sch/i.html?_nkw=laptop
JSON结果
{
  "products": [
    {
      "position": 1,
      "title": "HP 14 Laptop, Intel Pentium Silver N6000, 8GB RAM, 128GB SSD, Windows 11 Home",
      "image": "https://i.ebayimg.com/thumbs/images/g/gUUAAOSwgmxkeVXp/s-l225.webp",
      "link": "https://www.ebay.com/itm/285271537127",
      "price": {
        "price": {
        "currentPrice": "$219.99",
        "originalPrice": "$379.99",
        "currency": "$",
        "discountPercentage": "42%"
      },
      "condition": "New",
      "shippingCost": "Free shipping",
      "topRated": true,
      "itemsSold": "1,238 sold"
    },
    {
      "position": 2,
      "title": "Dell Latitude 5420 14\" FHD Laptop i5-1135G7 2.4GHz 16GB 256GB SSD Windows 10 Pro",
      "image": "https://i.ebayimg.com/thumbs/images/g/JxQAAOSwh9hkQ2Hx/s-l225.webp",
      "link": "https://www.ebay.com/itm/314153288742",
      "price": {
        "currentPrice": "$289.00",
        "currency": "$"
      },
      "condition": "Refurbished",
      "shippingCost": "Free shipping",
      "topRated": true,
      "itemsSold": "850 sold"
    }
  ],
  "pagination": {
    "currentPage": 1,
    "totalPages": 100,
    "totalResults": "94,237 results"
  },
  "filters": {
    "condition": [
      "New",
      "Refurbished",
      "Used"
    ],
    "price": [
      "Under $150.00",
      "$150.00 to $300.00",
      "Over $300.00"
    ]
  }
}

Want to track platform data in real time? Unlock complete data dimensions now:

Smart Data Solutions Driving E-commerce Success

Through comprehensive data collection, real-time insights, and custom reporting, Pangolin empowers e-commerce sellers to make precise decisions, boost efficiency, and stay competitive in dynamic markets.

Comprehensive Data Coverage

Full data support from product selection through listing to after-sales, providing scientific backing for every business decision.

Real-time and Near Real-time Data

Track Amazon’s front-end data by postal zones with hourly updates, enabling swift market responses and maintaining your competitive edge.

Massive-Scale Data Scraping

Processing billions of pages monthly with high-concurrency real-time crawling to deliver required data.

Custom Report Generation

Auto-generate operation reports from cross-page data crawling with zero coding, reducing workload and streamlining decision-making.

Comprehensively improve data scraping efficiency

With Data Pilot and Scrape API, you can achieve a one-stop solution for scraping and parsing e-commerce data from platforms like Amazon, all the way to generating cross-page operational reports. 

Scrape API (Raw)

Efficiently scrape e-commerce data

Real-time scraping of data from any website via synchronous/asynchronous APIs, supporting structured collection and parsing of 20+ platforms including Amazon and Walmart, processing over 1 billion requests daily.

Scrape API

The Scrape API offers a flexible and efficient way to access data, eliminating the need for parsing, and helps you quickly integrate and apply it to your system.

Core Features

Flexible data retrieval interfaces for single-page data extraction without parsing, ready to use, solving data integration challenges and enabling efficient data flow.
Learn More

Amazon Data Pliot

With Data Pilot, easily access cross-page, end-to-end data, solving data fragmentation and complexity, empowering quick, informed business decisions.

Core Features

Real-time data collection and analysis across pages. Personalized dashboard generation. Suitable for small to medium e-commerce sellers and operations teams.
Learn More

Render the web pages you scrape just like a real browser.

We manage tens of thousands of headless instances running the latest Chrome browser. You can focus on sending data collection requests without worrying about inefficient headless browser issues.

Wang Siyuan
Wang Siyuan
CTO @ Yunxi Technology
"Scrape API has completely solved our data collection challenges! Our marketing team can track competitors in real time, and our engineers are no longer stuck dealing with headless browser upgrades and maintenance."

Bypass access restrictions with distributed intelligent proxy rotation.

Leverage a global edge node network with an integrated headless browser cluster and dynamic fingerprint obfuscation. Achieve precise real-time scraping of complex web pages through millisecond-level IP switching and adaptive anti-detection algorithms, overcoming traditional crawler geo-restrictions and anti-scraping defenses.

Li Mingyang
Li Mingyang
Co-Founder @ Gima Technology
"Compared to the hundreds of thousands spent annually on maintaining self-built crawlers and proxy pools, using the Scraping API has enabled us to achieve: - A stable data flow with zero ban risk; - Intelligent IP scheduling strategies tailored to business scenarios; - A standardized API integration that shortens development cycles by 40%. Now, our team can focus on extracting data value instead of battling anti-scraping measures."

Easily collect and extract all types of data from the entire web.

Say goodbye to IP bans and CAPTCHA challenges. The Universal Scrape API’s intelligent managed solution makes business intelligence gathering as easy as browsing the web while strictly adhering to GDPR and other data compliance standards.

Face challenges head-on and embrace data-driven decision-making.

Facing challenges in the fast-paced e-commerce market like limited data collection, lack of personalization, and tough integration? Pangolin provides complete solutions for data-driven decisions and seizing new opportunities!

Weak data scraping capabilities

Unable to scrape Amazon pages in a timely or large-scale manner.

User Pain Points:

Users face challenges in obtaining Amazon data comprehensively and on time.

Raw Data Unparsed

The scraped raw pages are unprocessed and cannot be used directly.

User Pain Points:

Users lack data cleaning capabilities when obtaining Amazon market data.

Scattered Data

Existing data solutions cannot meet users' personalized needs.

User Pain Points:

Switching between data sources is time-consuming and prone to errors.

Amazon Scrape API

Scrape API can extract all data from Amazon's front-end pages, processing billions of page views each month.

— Data Service Provider

“Scrape API enables precise data extraction, significantly enhancing our decision-making ability.”
Learn More

Scrape API Plus

The Scrape API Plus provides parsed data, no cleaning required, making data management and analysis easy.

— Data Analyst

“With Scrape API Plus, we've saved significant time by eliminating data parsing, making it extremely convenient.”
Learn More

Amazon Data Pilot

Data Pilot offers cross-page data customization and real-time updates.

— E-commerce Seller

"One table with all the data I need—fantastic!"
Learn More

Some of Our Outstanding Clients

Sif 关键词

Sif is a platform that provides precise insights into ads and traffic secrets.
Visit Website

Apollo

Provide the Apollo E-commerce Growth Platform.
Visit Website

Ping Pong

PingPong | The Leading Cross-Border Payments Platform
Visit Website

紫鸟浏览器

Cross-border E-commerce Account Security Management System
Visit Website

ZIBUYU

Zibuyu is one of the largest cross-border e-commerce companies in China.
Visit Website

Worried about the results? Just fill out the form to get a free trial!

Provides extensive documentation and software development kit (SDK) support:

Start Scraping Web Data Now!

Scroll to Top

Unlock website data now!

Submit request → Get a custom solution + Free API test.

We use TLS/SSL encryption, and your submitted information is only used for solution communication.

This website uses cookies to ensure you get the best experience.

联系我们,您的问题,我们随时倾听

无论您在使用 Pangolin 产品的过程中遇到任何问题,或有任何需求与建议,我们都在这里为您提供支持。请填写以下信息,我们的团队将尽快与您联系,确保您获得最佳的产品体验。

Talk to our team

If you encounter any issues while using Pangolin products, please fill out the following information, and our team will contact you as soon as possible to ensure you have the best product experience.