Walmart Scraper

Scrapes product information such as title, price, availability, images, descriptions, and other related data based on the provided product ID.

Endpoint

POST https://api.crawlbyte.ai/api/tasks

Basic Configuration (Required)

{
  "type": "walmart",
  "input": [
    "14091452016",
    "7778210362",
    "11653805194"
  ],
  "multithread": false
}

Parameters

Field	Type	Description
type	string	Always "walmart"
input	array	Array of Walmart product IDs
multithread	boolean	Use true for faster processing with multiple threads

Advanced Configuration (Optional)

{
  "type": "walmart",
  "input": [
    "14091452016",
    "7778210362",
    "11653805194"
  ],
  "fields": [
    "title",
    "price",
    "availability",
    "url",
    "image",
    "description",
    "rating",
    "upc",
    "model"
  ],
  "user_agent_preset": "chrome",
  "user_agent_custom": "",
  "proxy": "username:password@ip:port"
}

Optional Parameters

Field	Type	Description
fields	array	List of fields to scrape. Available options: title, price, availability, url, image, description, rating, upc, model. Leave empty to scrape all.
user_agent_preset	string	Preset user-agent. Options: chrome, firefox, edge, opera, safari, ios-safari, android-chrome, custom
user_agent_custom	string	Used if user_agent_preset is custom.
proxy	string	username:password@ip:port

Pricing

• $0.01 per successful task This is a pay-as-you-go pricing model — you're only charged when a Walmart task successfully returns product data.

You can view your current credit balance and usage history in the Crawlbyte Dashboard.

Response

The response contains metadata about the task. For walmart type, the most important fields are status and result.

{
  "id": "bd3e89ed-815e-4395-98a3-521ede71cc4d",
  "status": "completed",
  "result": {
    // product data
  }
}

• result is a JSON object, that's the final scraped product data — no further polling is needed.

Status Types

Status	Meaning
queued	Task was accepted and added to the processing queue.
processing	Task is currently running.
completed	Task finished and product data was successfully collected.
failed	Task encountered an error (e.g., invalid product ID, access denied, etc.).

Polling

If status is queued or processing, continue polling the task until it's completed or failed.

GET https://api.crawlbyte.ai/api/tasks/:id

• You’ll receive the same structure with an updated status.

• Only poll until you receive completed or failed.

• Recommended interval: every 3–5 seconds.

SDK Usage

You can run this task using any official Crawlbyte SDK:

• Go SDK

• TypeScript SDK

• Python SDK

Each SDK provides a simple way to:

• Create the task

• Poll for status

• Handle the final result

Refer to the SDKs section for installation, examples, and setup instructions.

Notes

• Only valid Walmart product IDs will return results.

• Crawlbyte handles retries, fingerprinting, and anti-bot logic internally — no need to configure anything manually.

• Use multithread: true in advanced settings when processing large volumes.

• If a specific field is missing in the result, it means the data wasn’t available or couldn’t be parsed — usually all supported fields are returned.

• Need more fields? Just contact our support and we’ll add them.

• Average task duration is ~2–3 seconds per product, depending on Walmart’s site response time.