With our Asos Product Data Scraper, you can quickly gather important product information, such as their descriptions, images, feedback, questions, prices, and shipping details. You can customize your search by selecting your preferred country, language, and region for shipping. Our options include popular countries like Australia, Canada, Germany, France, Singapore, the USA, the UK, UAE, and India.
Since Asos doesn't offer an official scraper, this API must help you scrape data from Asos.
This Asos data scraping API helps with the following features:
Asos data scraper is under development. You can mail us your feedback if you have suggestions or feature requests.
It would help if you fed JSON input to Asos Scraper containing page lists according to the following required fields.
| Field | Type | Description |
|---|---|---|
| search | String | Search keywords you wish to explore on Asos. |
| startUrls | Array | List of Asos links. You must provide search, product details, or listing links. |
| endPage | Integer | Final page count, you wish to scrape with infinite default. You can apply this to all startUrls and search requests separately. |
| maxItems | Integer | You can restrict scraped items. It will be helpful while searching extensive Asos subcategories. |
| proxy | Object | Proxy configuration |
| extendOutputFunction | String | This function takes the JQuery handle as an argument and reflects data objects. |
| customMapFunction | String | This function takes every object handle as an argument and reflects objects during the run. |
You must use proxy servers like Real Data API or your proxy server to help use this solution.
When you want to scrape over a particular item URL, copy it from the source and paste it as a startUrl.
If you plan to extract only the beginning page from the list, place the URL for that page and keep endPage as 1.
Using the above approach, you can retrieve any page intervals. If you give the 7th page from the list and nominate the 8th page as the endPage factor, you will get only the seventh and eighth pages.
We've optimized this scraper to run fast and extract more possible pages. Hence, it forefronts each item detail request. If the source doesn't block this API frequently, it will scrape a hundred items in 60 seconds with 0.04 to 0.08 compute units.
{
"startUrls":[
"https://www.asos.com/search/?q=women%27s+dress",
"https://www.asos.com/asos-design/asos-design-barbie-necklace-in-gold-tone/prd/202940265?clr=gold&colourWayId=202940268&cid=27869",
"https://www.asos.com/women/a-to-z-of-brands/aldo/cat/?cid=11476&refine=attribute_10992:61388&nlid=ww|shoes|shop+by+brand|aldo"
],
"search": "women dress",
"proxy":{
"useRealdataAPIProxy": true
},
"maxItems": 50,
"endPage": 2
}
While executing, the scraper will send messages to notify you about what is happening. Every message always includes a short label mentioning which page from the list it is scraping. After loading items, you must see a message about the event with all pages' total and loaded item count.
If you give the wrong input to the scraper, it will stop running and display the reason behind the failure.
While executing, the API saves outputs into datasets. Each item is unique in the dataset.
You can expect results in any programming language like PHP, NPM, Python, Node.js, etc. Check out our API reference to know more about getting outputs from this API.
Check the below structure of every Asos product data item.
{
"productCode": "114609010",
"name": "Topshop shirring seersucker check puff sleeve mini dress in blue",
"gender": "Women",
"id": 201693957,
"isNoSize": false,
"isOneSize": false,
"isInStock": true,
"isDeadProduct": false,
"pdpLayout": "Core",
"hasVariantsWithProp65Risk": false,
"productType": {
"id": 8416,
"name": "Dresses"
},
"brandName": "Topshop",
"brandId": 16305,
"variants": [
{
"variantId": 201693961,
"size": "UK 4",
"isInStock": true,
"sizeId": 387375,
"colour": "BLUE",
"colourWayId": 201693958,
"isPrimary": true,
"sizeOrder": 10,
"seller": null,
"sku": "114609054",
"hasIngredients": false,
"pricing": {
"id": 201693961,
"variantId": 201693961,
"sku": "114609054",
"isInStock": true,
"isLowInStock": false,
"stockLastUpdatedDate": "2022-05-08T15:41:23.062Z",
"warehouse": null,
"source": null,
"seller": null,
"price": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
},
"discountPercentage": 61.43
}
},
{
"variantId": 201693964,
"size": "UK 6",
"isInStock": true,
"sizeId": 387376,
"colour": "BLUE",
"colourWayId": 201693958,
"isPrimary": true,
"sizeOrder": 20,
"seller": null,
"sku": "114609052",
"hasIngredients": false,
"pricing": {
"id": 201693964,
"variantId": 201693964,
"sku": "114609052",
"isInStock": true,
"isLowInStock": false,
"stockLastUpdatedDate": "2022-03-15T12:18:33.416Z",
"warehouse": null,
"source": null,
"seller": null,
"price": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
},
"discountPercentage": 61.43
}
},
{
"variantId": 201693966,
"size": "UK 8",
"isInStock": true,
"sizeId": 387377,
"colour": "BLUE",
"colourWayId": 201693958,
"isPrimary": true,
"sizeOrder": 30,
"seller": null,
"sku": "114609053",
"hasIngredients": false,
"pricing": {
"id": 201693966,
"variantId": 201693966,
"sku": "114609053",
"isInStock": true,
"isLowInStock": false,
"stockLastUpdatedDate": "2022-03-15T12:18:33.423Z",
"warehouse": null,
"source": null,
"seller": null,
"price": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
},
"discountPercentage": 61.43
}
},
{
"variantId": 201693960,
"size": "UK 10",
"isInStock": true,
"sizeId": 387370,
"colour": "BLUE",
"colourWayId": 201693958,
"isPrimary": true,
"sizeOrder": 40,
"seller": null,
"sku": "114609047",
"hasIngredients": false,
"pricing": {
"id": 201693960,
"variantId": 201693960,
"sku": "114609047",
"isInStock": true,
"isLowInStock": false,
"stockLastUpdatedDate": "2022-03-15T12:18:33.418Z",
"warehouse": null,
"source": null,
"seller": null,
"price": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
},
"discountPercentage": 61.43
}
},
{
"variantId": 201693962,
"size": "UK 12",
"isInStock": true,
"sizeId": 387371,
"colour": "BLUE",
"colourWayId": 201693958,
"isPrimary": true,
"sizeOrder": 50,
"seller": null,
"sku": "114609048",
"hasIngredients": false,
"pricing": {
"id": 201693962,
"variantId": 201693962,
"sku": "114609048",
"isInStock": true,
"isLowInStock": false,
"stockLastUpdatedDate": "2022-03-15T12:18:33.422Z",
"warehouse": null,
"source": null,
"seller": null,
"price": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
},
"discountPercentage": 61.43
}
},
{
"variantId": 201693965,
"size": "UK 14",
"isInStock": true,
"sizeId": 387372,
"colour": "BLUE",
"colourWayId": 201693958,
"isPrimary": true,
"sizeOrder": 60,
"seller": null,
"sku": "114609049",
"hasIngredients": false,
"pricing": {
"id": 201693965,
"variantId": 201693965,
"sku": "114609049",
"isInStock": true,
"isLowInStock": false,
"stockLastUpdatedDate": "2022-06-18T15:45:34.945Z",
"warehouse": null,
"source": null,
"seller": null,
"price": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
},
"discountPercentage": 61.43
}
},
{
"variantId": 201693959,
"size": "UK 16",
"isInStock": false,
"sizeId": 387373,
"colour": "BLUE",
"colourWayId": 201693958,
"isPrimary": true,
"sizeOrder": 70,
"seller": null,
"sku": "114609050",
"hasIngredients": false,
"pricing": {
"id": 201693959,
"variantId": 201693959,
"sku": "114609050",
"isInStock": false,
"isLowInStock": false,
"stockLastUpdatedDate": "2022-06-20T16:20:43.705Z",
"warehouse": "FC06",
"source": {
"id": "ASOSUK2",
"description": "ASOS UK (Lichfield)"
},
"seller": null,
"price": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
},
"discountPercentage": 61.43
}
},
{
"variantId": 201693963,
"size": "UK 18",
"isInStock": false,
"sizeId": 387374,
"colour": "BLUE",
"colourWayId": 201693958,
"isPrimary": true,
"sizeOrder": 80,
"seller": null,
"sku": "114609051",
"hasIngredients": false,
"pricing": {
"id": 201693963,
"variantId": 201693963,
"sku": "114609051",
"isInStock": false,
"isLowInStock": false,
"stockLastUpdatedDate": "2022-06-21T13:33:23.784Z",
"warehouse": null,
"source": null,
"seller": null,
"price": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
},
"discountPercentage": 61.43
}
}
],
"images": [
{
"isPrimary": true,
"colour": "BLUE",
"colourWayId": 201693958,
"imageType": "Standard1",
"url": "https://images.asos-media.com/products/topshop-shirring-seersucker-check-puff-sleeve-mini-dress-in-blue/201693957-1-blue",
"productId": 201693957,
"alternateText": "Thumbnail 1 of 4",
"isVisible": true
},
{
"isPrimary": false,
"colour": "",
"colourWayId": null,
"imageType": "Standard2",
"url": "https://images.asos-media.com/products/topshop-shirring-seersucker-check-puff-sleeve-mini-dress-in-blue/201693957-2",
"productId": 201693957,
"alternateText": "Thumbnail 2 of 4",
"isVisible": true
},
{
"isPrimary": false,
"colour": "",
"colourWayId": null,
"imageType": "Standard3",
"url": "https://images.asos-media.com/products/topshop-shirring-seersucker-check-puff-sleeve-mini-dress-in-blue/201693957-3",
"productId": 201693957,
"alternateText": "Thumbnail 3 of 4",
"isVisible": true
},
{
"isPrimary": false,
"colour": "",
"colourWayId": null,
"imageType": "Standard4",
"url": "https://images.asos-media.com/products/topshop-shirring-seersucker-check-puff-sleeve-mini-dress-in-blue/201693957-4",
"productId": 201693957,
"alternateText": "Thumbnail 4 of 4",
"isVisible": true
}
],
"totalNumberOfColours": 1,
"media": {
"catwalkUrl": "",
"threeSixtyUrl": ""
},
"buyTheLookId": null,
"sizeGuideVisible": true,
"sizeGuide": "https://www.asos.com/web/pages/size-guides/index.html?sizeSchema=UK&data=https://www.asos.com/api/sizing/sizeapi/v1/SizeGuide/394%3flanguage%3den-GB",
"shippingRestrictions": {
"shippingRestrictionsForSellers": false,
"shippingRestrictionsLabel": "This product has shipping restrictions.",
"shippingRestrictionsVisible": true,
"shippingRestrictionsIncludedCountries": [
"AD",
"AE",
"AI",
"AL",
"AM",
"AO",
"AR",
"AT",
"AU",
"AX",
"AZ",
"BA",
"BB",
"BD",
"BE",
"BF",
"BG",
"BH",
"BJ",
"BL",
"BM",
"BN",
"BO",
"BQ",
"BR",
"BT",
"BW",
"CA",
"CC",
"CD",
"CF",
"CG",
"CH",
"CI",
"CK",
"CL",
"CM",
"CN",
"CO",
"CR",
"CW",
"CX",
"CY",
"CZ",
"DE",
"DK",
"DM",
"DO",
"DZ",
"EE",
"EG",
"EH",
"ER",
"ES",
"ET",
"FI",
"FK",
"FM",
"FO",
"FR",
"GB",
"GE",
"GH",
"GI",
"GL",
"GM",
"GN",
"GQ",
"GR",
"GU",
"GW",
"GY",
"HK",
"HR",
"HU",
"ID",
"IE",
"IN",
"IQ",
"IS",
"IT",
"JO",
"JP",
"KE",
"KG",
"KH",
"KR",
"KW",
"KZ",
"LA",
"LB",
"LI",
"LK",
"LS",
"LT",
"LU",
"LV",
"MA",
"MC",
"MD",
"ME",
"MF",
"MG",
"MH",
"MK",
"MN",
"MO",
"MP",
"MR",
"MS",
"MT",
"MV",
"MW",
"MX",
"MY",
"MZ",
"NA",
"NE",
"NF",
"NG",
"NL",
"NO",
"NP",
"NR",
"NU",
"NZ",
"OM",
"PE",
"PH",
"PK",
"PL",
"PM",
"PN",
"PR",
"PS",
"PT",
"PW",
"PY",
"QA",
"RO",
"RS",
"RU",
"RW",
"SA",
"SB",
"SE",
"SG",
"SH",
"SI",
"SJ",
"SK",
"SL",
"SM",
"SN",
"SS",
"ST",
"SV",
"SX",
"SZ",
"TF",
"TG",
"TH",
"TJ",
"TK",
"TL",
"TN",
"TR",
"TT",
"TV",
"TW",
"TZ",
"UG",
"US",
"UY",
"UZ",
"VA",
"VC",
"VG",
"VI",
"VN",
"YT",
"ZA",
"ZM",
"ZW"
]
},
"plpIds": [
{
"id": 5235,
"type": "Standard"
},
{
"id": 7046,
"type": "Standard"
},
{
"id": 8799,
"type": "SEO"
},
{
"id": 8834,
"type": "Standard"
},
{
"id": 13489,
"type": "Standard"
},
{
"id": 13597,
"type": "Standard"
},
{
"id": 13929,
"type": "Standard"
},
{
"id": 15346,
"type": "Standard"
},
{
"id": 15623,
"type": "Standard"
},
{
"id": 15627,
"type": "Standard"
},
{
"id": 15944,
"type": "Standard"
},
{
"id": 15945,
"type": "Standard"
},
{
"id": 16396,
"type": "Standard"
},
{
"id": 16646,
"type": "Standard"
},
{
"id": 16654,
"type": "Standard"
},
{
"id": 16824,
"type": "Standard"
},
{
"id": 19680,
"type": "Standard"
},
{
"id": 20246,
"type": "Standard"
},
{
"id": 28023,
"type": "Standard"
},
{
"id": 28041,
"type": "Standard"
},
{
"id": 28179,
"type": "Standard"
},
{
"id": 28249,
"type": "Standard"
},
{
"id": 28254,
"type": "Standard"
},
{
"id": 28605,
"type": "Standard"
},
{
"id": 28609,
"type": "Standard"
},
{
"id": 28611,
"type": "Standard"
},
{
"id": 29298,
"type": "Brand"
},
{
"id": 30227,
"type": "Standard"
},
{
"id": 50047,
"type": "Standard"
},
{
"id": 50050,
"type": "Standard"
},
{
"id": 50053,
"type": "Standard"
},
{
"id": 50054,
"type": "Standard"
}
],
"sellingFast": true,
"paymentPromotions": {
"clearpay": {
"gb": {
"gbp": {
"minimumTransactionAmount": 25,
"maximumTransactionAmount": 800
}
}
},
"payPalPayIn3": {
"gb": {
"gbp": {
"minimumTransactionAmount": 30,
"maximumTransactionAmount": 2000
}
}
},
"klarnaPI3": {
"gb": {
"gbp": {
"minimumTransactionAmount": 25,
"maximumTransactionAmount": 800
}
}
}
},
"hasPaymentPromotionAvailable": true,
"hasVariantsWithIngredients": false,
"url": "https://www.asos.com/topshop/topshop-shirring-seersucker-check-puff-sleeve-mini-dress-in-blue/prd/201693957?clr=blue&colourWayId=201693958&SearchQuery=women+dress",
"pricing": {
"current": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"previous": {
"value": 35,
"text": "£35.00",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"rrp": {
"value": null,
"text": null,
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"xrp": {
"value": 13.5,
"text": "£13.50",
"versionId": "PRMP000002000200000005247768520220615020000",
"conversionId": "0"
},
"currency": "GBP",
"isMarkedDown": true,
"isOutletPrice": false,
"startDateTime": "2022-06-15T01:00:00Z",
"wasPriceStartDate": "2022-03-15T12:18:37.025Z"
}
}
Check out how industries use Asos Scraper worldwide.
eCommerce & Retail
Manufacturing
Marketing and Media
You should have a Real Data API account to execute the program examples. Replace < YOUR_API_TOKEN > in the program using the token of your actor. Read about the live APIs with Real Data API docs for more explanation.
import { RealdataAPIClient } from 'RealdataAPI-Client';
// Initialize the RealdataAPIClient with API token
const client = new RealdataAPIClient({
token: '<YOUR_API_TOKEN>',
});
// Prepare actor input
const input = {
"search": "women dress",
"startUrls": [
"https://www.asos.com/search/?q=women%27s+dress",
"https://www.asos.com/asos-design/asos-design-barbie-necklace-in-gold-tone/prd/202940265?clr=gold&colourWayId=202940268&cid=27869",
"https://www.asos.com/women/a-to-z-of-brands/aldo/cat/?cid=11476&refine=attribute_10992:61388&nlid=ww|shoes|shop+by+brand|aldo"
],
"maxItems": 20,
"endPage": 1,
"extendOutputFunction": ($) => { return {} },
"customMapFunction": (object) => { return {...object} },
"proxy": {
"useRealdataAPIProxy": true
}
};
(async () => {
// Run the actor and wait for it to finish
const run = await client.actor("epctex/asos-scraper").call(input);
// Fetch and print actor results from the run's dataset (if any)
console.log('Results from dataset');
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
})();
from realdataapi_client import RealdataAPIClient
# Initialize the RealdataAPIClient with your API token
client = RealdataAPIClient("<YOUR_API_TOKEN>")
# Prepare the actor input
run_input = {
"search": "women dress",
"startUrls": [
"https://www.asos.com/search/?q=women%27s+dress",
"https://www.asos.com/asos-design/asos-design-barbie-necklace-in-gold-tone/prd/202940265?clr=gold&colourWayId=202940268&cid=27869",
"https://www.asos.com/women/a-to-z-of-brands/aldo/cat/?cid=11476&refine=attribute_10992:61388&nlid=ww|shoes|shop+by+brand|aldo",
],
"maxItems": 20,
"endPage": 1,
"extendOutputFunction": "($) => { return {} }",
"customMapFunction": "(object) => { return {...object} }",
"proxy": { "useRealdataAPIProxy": True },
}
# Run the actor and wait for it to finish
run = client.actor("epctex/asos-scraper").call(run_input=run_input)
# Fetch and print actor results from the run's dataset (if there are any)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# Set API token
API_TOKEN=<YOUR_API_TOKEN>
# Prepare actor input
cat > input.json <<'EOF'
{
"search": "women dress",
"startUrls": [
"https://www.asos.com/search/?q=women%27s+dress",
"https://www.asos.com/asos-design/asos-design-barbie-necklace-in-gold-tone/prd/202940265?clr=gold&colourWayId=202940268&cid=27869",
"https://www.asos.com/women/a-to-z-of-brands/aldo/cat/?cid=11476&refine=attribute_10992:61388&nlid=ww|shoes|shop+by+brand|aldo"
],
"maxItems": 20,
"endPage": 1,
"extendOutputFunction": "($) => { return {} }",
"customMapFunction": "(object) => { return {...object} }",
"proxy": {
"useRealdataAPIProxy": true
}
}
EOF
# Run the actor
curl "https://api.realdataapi.com/v2/acts/epctex~asos-scraper/runs?token=$API_TOKEN" /
-X POST /
-d @input.json /
-H 'Content-Type: application/json'
search
Optional String
The search keyword you explore on Asos search engine.
startUrls
Optional Array
Links to begin with. You should feed category URLs.
maxItems
Optional Integer
Maximum item count you expect to get as a result with default as ALL.
endPage
Optional Integer
The page serial number you want to finish the execution with no by default end page. You can apply this with all startUrls and search requests separately.
extendOutputFunction
Optional String
This function takes a JQuery handle as an argument and reflects data to merge it with the default result.
customMapFunction
Optional String
This function takes every object as an argument and reflects data to map.
proxy
Required Object
Choose proxy servers to help your scraper.
{
"search": "women dress",
"startUrls": [
"https://www.asos.com/search/?q=women%27s+dress",
"https://www.asos.com/asos-design/asos-design-barbie-necklace-in-gold-tone/prd/202940265?clr=gold&colourWayId=202940268&cid=27869",
"https://www.asos.com/women/a-to-z-of-brands/aldo/cat/?cid=11476&refine=attribute_10992:61388&nlid=ww|shoes|shop+by+brand|aldo"
],
"maxItems": 20,
"endPage": 1,
"extendOutputFunction": "($) => { return {} }",
"customMapFunction": "(object) => { return {...object} }",
"proxy": {
"useRealdataAPIProxy": true
}
}
Disclaimer : Real Data API only extracts publicly available data while maintaining a strict policy against collecting any personal or identity-related information.
