PlayStation Store Scraper - Scrape Gaming Product & Accessory Data
RealdataAPI / playstation-store-scraper
Crawls arbitrary websites using the Chrome browser and extracts data from pages using a provided JavaScript code. The actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is RealdataAPI's basic tool for web crawling and scraping.
It is a data scraping tool to scrape gaming product data with accessory data from PlayStation Store. Since the PlayStation platform has no official data API, our gaming accessory data scraper should help you collect the required data.
Our PlayStation Store data scraper has the following features:
Discover any keyword: The scraper lets you discover any search term for the required output.
Scrape product: You can scrape PlayStation Store data of every product for detailed information.
Scrape category: Extract any product category and get the latest updates with detailed information.
Scrape lists: Extract required data lists from PlayStation Store.
Scrape concept: You can scrape concept descriptions for any product from the platform. Enter the URL to get the data.
Updates, Bugs, Fixed, and Changelog
Our team is actively developing this scraper. If you want to suggest any feature or fix any bug, please create an issue from the issue tab of your console account.
Input Parameters of PlayStation Store Scraper
It would be helpful if you needed the JSON formatted input to the PlayStation Store Data Scraper. Here are the possible input parameters:
startUrls: It is an optional input array for the start URL list. You can only enter the search, concept, product detail, and collection links.
search: It is an optional input string for keywords you wish to search on the platform.
maxItems: You can restrict output for scraping using this optional field. If you scrape significant search results or lists, it will help you.
country: it is an optional string to search for a specific country in the store.
endPage: It is an optional field to set the last page number you want to extract with infinite default. You can apply it to every startUrls or search request separately.
proxy: Set up the proxy server to support the successful scraper run.
customMapFunction: It is an optional function to take each Object Handle Argument and reflect the output object after executing the function.
extendOutputFunction: The function takes arguments based on the JQuery handle ($) to return the data-based object.
You have to use proxies from multiple options, like your proxy or that from our server.
Tip
To scrape the PlayStation gaming accessory and hardware data from a particular listing URL, copy the link and paste it as the starting URL.
Enter the URL for the first page and keep endPage as one to scrape only the first page from the list.
Further, you can retrieve any page intervals using the above approach. For example, if you provide the 7th page and keep endPage as 8, you will get only the 7th and 8th-page data.
Compute Unit Consumption
We have optimized the scraper to run fast and extract the maximum possible data. Hence, the scraper forefronts every request for listing details. If the source blocks the scraper infrequently, it will give you a hundred listings in 120 seconds. It will cost you around 0.07 to 0.09 compute units.
While executing, the scraper will send alerts to inform what it is scraping. The scraper will mention which page it is currently scraping from the list. After loading items from the list, you will see the event message with the total and loaded item counts for every page.
The scraper will only work if you give the correct input and display the failure reason with an explanation.
PlayStation Store Data Export
The scraper saves its output in a dataset. Every item has a unique location and value in the dataset.
You can get the output in any programming, like Node.js, Python, NPM, PHP, etc.
Properties of Scraped Data From the PlayStation Store
You will see the scraped PlayStation Store data in the following format:
You should have a Real Data API account to execute the program examples. Replace
< YOUR_API_TOKEN>
in the program using the token of your actor. Read about the live APIs with Real Data API docs for more explanation.
import{ RealdataAPIClient }from'RealdataAPI-Client';// Initialize the RealdataAPIClient with API tokenconst client =newRealdataAPIClient({token:'<YOUR_API_TOKEN>',});// Prepare actor inputconst input ={"search":"food game","startUrls":["https://store.playstation.com/en-tr/product/EP4389-CUSA17440_00-DCLGAMEEU0000000","https://store.playstation.com/en-tr/search/game","https://store.playstation.com/en-tr/concept/10000886","https://store.playstation.com/en-tr/category/d42c9dc6-5516-4a34-a511-c09894266d98/1"],"maxItems":20,"endPage":1,"extendOutputFunction":($)=>{return{}},"customMapFunction":(object)=>{return{...object}},"proxy":{"useRealdataAPIProxy":true}};(async()=>{// Run the actor and wait for it to finishconst run =await client.actor("epctex/playstation-store-scraper").call(input);// Fetch and print actor results from the run's dataset (if any)
console.log('Results from dataset');const{ items }=await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item)=>{
console.dir(item);});})();
from RealdataAPI_client import RealdataAPIClient
# Initialize the RealdataAPIClient with your API token
client = RealdataAPIClient("<YOUR_API_TOKEN>")# Prepare the actor input
run_input ={"search":"food game","startUrls":["https://store.playstation.com/en-tr/product/EP4389-CUSA17440_00-DCLGAMEEU0000000","https://store.playstation.com/en-tr/search/game","https://store.playstation.com/en-tr/concept/10000886","https://store.playstation.com/en-tr/category/d42c9dc6-5516-4a34-a511-c09894266d98/1",],"maxItems":20,"endPage":1,"extendOutputFunction":"($) => { return {} }","customMapFunction":"(object) => { return {...object} }","proxy":{"useRealdataAPIProxy":True},}# Run the actor and wait for it to finish
run = client.actor("epctex/playstation-store-scraper").call(run_input=run_input)# Fetch and print actor results from the run's dataset (if there are any)for item in client.dataset(run["defaultDatasetId"]).iterate_items():print(item)
# Set API tokenAPI_TOKEN=<YOUR_API_TOKEN># Prepare actor inputcat> input.json <<'EOF'
{
"search": "food game",
"startUrls": [
"https://store.playstation.com/en-tr/product/EP4389-CUSA17440_00-DCLGAMEEU0000000",
"https://store.playstation.com/en-tr/search/game",
"https://store.playstation.com/en-tr/concept/10000886",
"https://store.playstation.com/en-tr/category/d42c9dc6-5516-4a34-a511-c09894266d98/1"
],
"maxItems": 20,
"endPage": 1,
"extendOutputFunction": "($) => { return {} }",
"customMapFunction": "(object) => { return {...object} }",
"proxy": {
"useRealdataAPIProxy": true
}
}
EOF# Run the actorcurl"https://api.RealdataAPI.com/v2/acts/epctex~playstation-store-scraper/runs?token=$API_TOKEN"/-X POST /-d @input.json /-H'Content-Type: application/json'
It is an input field to enter the keyword you want to search on the PlayStation Store.
Start URLs
startUrlsOptional Array
Adding the starting URLs for lists or page details is an input parameter.
Maximum Listing Item Count
maxItemsOptional Integer
Enter the maximum listing item count with all as a default value to get the required output.
List End Page
endPageOptional Integer
It is an input field to add the last page number to end the list with no, by default, end page. You can apply it to every start URL and search request separately.
Extend Output Function
extendOutputFunctionOptional String
It takes an argument based on the JQuery handle ($), reflects the output data, and merges it with the default result.
Custom Map Function
customMapFunctionOptional String
It takes every object as an argument, reflects the output data, and maps it.
Proxy configuration
proxyOptional Object
Choose a proxy server to support the successful scraper execution.
Disclaimer : Real Data API only extracts publicly available data while maintaining a strict policy against collecting any personal or identity-related information.
