Black-Friday Black-Friday
logo

Indeed Scraper - Scrape Indeed Job Postings Data

RealdataAPI / indeed-scraper

Scrape job posting data from the leading job website Indeed using Indeed Scraper. Get detailed data from this portal about any saved or sponsored job. Mention the search based on location, with result attributes location, position, description, and salary details. Our Indeed Job Data collection tool is available in the USA, UK, UAE, France, Spain, Germany, Canada, Singapore, Mexico, Australia, Italy, and other countries worldwide.

What is Indeed Scraper and How Does It Work?

It is a data scraping tool to extract job listing data, including company name, job title, location, description, salary, employment type, ratings, and other fields. To gather data using this Job data scraper, only type the job location and title in the input field, and click the Save and Start option.

What Type of Data Can I Scrape From the Indeed Job Listing Site?

Using this Indeed job listing data scraper, you can scrape the following data from the leading job posting site:

  • Job Title
  • Location
  • Description
  • Ratings and Reviews
  • URL
  • Company Name
  • Type of Employment
  • Posting Time
  • Salary

Why Scrape Job Posting Data From Indeed?

  • Track hiring trends for technology and skill gaps
  • Perform market research for jobs by analyzing newness, rating, and salary
  • Simplify and speed up the job search process with automation
  • Gather customized data for available job roles in the market
  • Competition monitoring
  • Salary compensation benchmarking

How to Use Indeed Job Scraper?

We have developed an Indeed scraper so you can use it quickly, even though you are a newbie in data scraping. Here is a process with a few steps to scrape job posting data from Indeed:

  • Sign Up on the Real Data API platform with the necessary credentials.
  • Discover Indeed Scraper and open it.
  • Fill in the necessary input fields according to your data scraping requirements.
  • Click the start button and allow some time for the scraper to extract data for you.
  • Save and download the collected data in multiple formats like HTML, XML, JSON, Excel, or CSV.

Explore our stepwise tutorial to learn the Indeed data scraper execution process.

Input Parameters of Indeed API

While submitting the input fields, you should fill in job positions, result count, and job location. For more details, check out the Input tab of this scraper with JSON examples.

{ "country": "US", "location": "San Francisco", "maxConcurrency": 5, "maxItems": 100, "position": "data analyst", "proxyConfiguration": { "useRealdataAPIProxy": true }, "saveOnlyUniqueItems": true }

Output Sample of Indeed Scraper

You can discover the storage tab to find the output of the collected data in usable dataset format. Here is an example of JSON output using the above input parameters.

Also, find the output in JSON format below. Depending on your choice, you can download the scraped Indeed data in Excel, CSV, HTML, JSONL, XML, or any other format.

[{ "positionName": "Power BI Report Analyst with Finance Oracle ERP (OTC/PTP/RTR)", "salary": null, "jobType": [ "Fulltime" ], "company": "Purple Drive Technologies", "companyLogo": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/256x256/e01ca5b3407aa673eb3e185ba14064b1", "location": "500 Almanor Avenue, Sunnyvale, CA 94085", "rating": 3.8, "reviewsCount": 4, "url": "https://www.indeed.com/company/Purple-Drive-Technologies/jobs/Power-Bi-Report-Analyst-Finance-Oracle-Erp-cd84b0a277f6128d?fccid=b50885016c495d25&vjs=3", "id": "cd84b0a277f6128d", "postedAt": "Today", "scrapedAt": "2023-03-18T19:39:01.111Z", "description": "Key words to search in resume:/n/n Finance (Revenue, FP&A, QTC/OTC, P2P, R2R, Sales Compensation) functional knowledge, Oracle EBS or any other Finance ERP knowledge to understand finance data and create visuals within PowerBI./n/n/n Microsoft Power BI/n/nRequired Skill:/n/n Analyze data in Excel, compare data in different excels using VLOOKUP, upload data from excel to Power BI/n/n/n Create visualizations for data in Power BI, work on reports/dashboards based upon defined request and requirements from stakeholders and maintain a catalog of reports’ use and purpose./n/n/n Report Analyst is responsible for data analysis, data visualization solutions on Power BI to support our various business stakeholders. Backend/Coding knowledge is not needed, it is only good to have/n/n/n Maintain queue of report requests from initiation through to completion, including their detailed requirements./n/n/n Participate in business analysis activities to maintain reports and enhancements requests as needed./n/n/n Enforce rules and procedures for cleaning, integrating, and reconciling information/data from various sources./n/n/n Assist end users with troubleshooting reports, Work with stakeholders to define and understand their data/reporting needs./n/n/n Create report standards and best practices or guidelines for repeatable processes./n/n/n Develop testing plan along with performing tests to deliver high quality solutions./n/n/n Analyze report / data issues and provide recommended approaches to solve./n/n/n Accountability for meeting commitments as scheduled and achieving high customer satisfaction./n/n/n Keep other team members and management fully informed of progress, emerging issues, corrective actions, and escalating appropriately as the situation demands/n/nGood to Have skill:/n/n Bachelor’s degree in information systems or related field preferred/n/n/n 7+ years expertise with PowerBI dashboards, analyzing data and visualization using Finance data – MUST TO HAVE/n/n/n Prior experience with Tableau, Oracle BI tool-OBIEE – NICE TO HAVE/n/n/n Backend coding, query writing with PL/SQL, MS SQL/MySQL Server- NICE TO HAVE/n/n/n Familiarity with BI and Data Warehousing concepts./n/n/n Candidate will be responsible for analyzing business problems to determine the best way to apply BI capabilities to deliver solutions. Should maintain and grow working knowledge of enterprise data assets and data-centric business processes within Finance Org/n/n/n Strong analytical, conceptual, and problem-solving abilities. Ability to work independently with minimal guidance from management, Ability to learn and apply new concepts quickly, Ability to meet tight deadlines./n/n/n Analyze business requirements, visualize, and analyze data for reporting./n/n/n Evaluate business requests for new or modified capabilities to determine feasibility, cost and time required, compatibility with current systems, and computer capabilities./n/n/n Create and review/approve functional design documents and specifications on change requests and assignments within a project while maintaining documentation and abstracts in conformance with standards./n/n/n Analyze reporting needs for business consumption using BI tools./n/n/n Provide detailed source analysis and data mappings/transformations to BI developers to implement new data sources and integrations./n/n/n Devise and deliver testing plans and testing data to validate BI solutions, Coordinate user testing/n/n/n Facilitate BI solutions ensuring changes follow appropriate Change and Release Management processes./n/n/n Provide consultancy to business units for detailed information on data availability, location, lineage, and quality./n/n/n Perform data analysis, profiling, and quality assessment to ensure the integrity of business data to necessary levels./n/nJob Type: Full-time/nSchedule:/n/n 8 hour shift/n/nWork Location: One location", "descriptionHTML": "<p>Key words to search in resume:</p>/n<ul>/n <li>Finance (Revenue, FP&amp;A, QTC/OTC, P2P, R2R, Sales Compensation) functional knowledge, Oracle EBS or any other Finance ERP knowledge to understand finance data and create visuals within PowerBI.</li>/n</ul>/n<ul>/n <li>Microsoft Power BI</li>/n</ul>/n<p>Required Skill:</p>/n<ul>/n <li>Analyze data in Excel, compare data in different excels using VLOOKUP, upload data from excel to Power BI</li>/n</ul>/n<ul>/n <li>Create visualizations for data in Power BI, work on reports/dashboards based upon defined request and requirements from stakeholders and maintain a catalog of reports&#x2019; use and purpose.</li>/n</ul>/n<ul>/n <li>Report Analyst is responsible for data analysis, data visualization solutions on Power BI to support our various business stakeholders. Backend/Coding knowledge is not needed, it is only good to have</li>/n</ul>/n<ul>/n <li>Maintain queue of report requests from initiation through to completion, including their detailed requirements.</li>/n</ul>/n<ul>/n <li>Participate in business analysis activities to maintain reports and enhancements requests as needed.</li>/n</ul>/n<ul>/n <li>Enforce rules and procedures for cleaning, integrating, and reconciling information/data from various sources.</li>/n</ul>/n<ul>/n <li>Assist end users with troubleshooting reports, Work with stakeholders to define and understand their data/reporting needs.</li>/n</ul>/n<ul>/n <li>Create report standards and best practices or guidelines for repeatable processes.</li>/n</ul>/n<ul>/n <li>Develop testing plan along with performing tests to deliver high quality solutions.</li>/n</ul>/n<ul>/n <li>Analyze report / data issues and provide recommended approaches to solve.</li>/n</ul>/n<ul>/n <li>Accountability for meeting commitments as scheduled and achieving high customer satisfaction.</li>/n</ul>/n<ul>/n <li>Keep other team members and management fully informed of progress, emerging issues, corrective actions, and escalating appropriately as the situation demands</li>/n</ul>/n<p>Good to Have skill:</p>/n<ul>/n <li>Bachelor&#x2019;s degree in information systems or related field preferred</li>/n</ul>/n<ul>/n <li>7+ years expertise with PowerBI dashboards, analyzing data and visualization using Finance data &#x2013; MUST TO HAVE</li>/n</ul>/n<ul>/n <li>Prior experience with Tableau, Oracle BI tool-OBIEE &#x2013; NICE TO HAVE</li>/n</ul>/n<ul>/n <li>Backend coding, query writing with PL/SQL, MS SQL/MySQL Server- NICE TO HAVE</li>/n</ul>/n<ul>/n <li>Familiarity with BI and Data Warehousing concepts.</li>/n</ul>/n<ul>/n <li>Candidate will be responsible for analyzing business problems to determine the best way to apply BI capabilities to deliver solutions. Should maintain and grow working knowledge of enterprise data assets and data-centric business processes within Finance Org</li>/n</ul>/n<ul>/n <li>Strong analytical, conceptual, and problem-solving abilities. Ability to work independently with minimal guidance from management, Ability to learn and apply new concepts quickly, Ability to meet tight deadlines.</li>/n</ul>/n<ul>/n <li>Analyze business requirements, visualize, and analyze data for reporting.</li>/n</ul>/n<ul>/n <li>Evaluate business requests for new or modified capabilities to determine feasibility, cost and time required, compatibility with current systems, and computer capabilities.</li>/n</ul>/n<ul>/n <li>Create and review/approve functional design documents and specifications on change requests and assignments within a project while maintaining documentation and abstracts in conformance with standards.</li>/n</ul>/n<ul>/n <li>Analyze reporting needs for business consumption using BI tools.</li>/n</ul>/n<ul>/n <li>Provide detailed source analysis and data mappings/transformations to BI developers to implement new data sources and integrations.</li>/n</ul>/n<ul>/n <li>Devise and deliver testing plans and testing data to validate BI solutions, Coordinate user testing</li>/n</ul>/n<ul>/n <li>Facilitate BI solutions ensuring changes follow appropriate Change and Release Management processes.</li>/n</ul>/n<ul>/n <li>Provide consultancy to business units for detailed information on data availability, location, lineage, and quality.</li>/n</ul>/n<ul>/n <li>Perform data analysis, profiling, and quality assessment to ensure the integrity of business data to necessary levels.</li>/n</ul>/n<p>Job Type: Full-time</p>/n<p>Schedule:</p>/n<ul>/n <li>8 hour shift</li>/n</ul>/n<p>Work Location: One location</p>", "externalApplyLink": null }, { "positionName": "Business Systems Analyst (Analytics & Insights)", "salary": null, "jobType": null, "company": "Saama Technologies Inc", "companyLogo": "https://d2q79iu7y748jz.cloudfront.net/s/_logo/a0051cbc87d486301c5fc005abaa7c88", "location": "San Francisco, CA", "rating": 3.6, "reviewsCount": 43, "url": "https://www.indeed.com/rc/clk?jk=24e1fe226a1412b8&fccid=f7cbfaf9ddc3fe8a&vjs=3", "id": "24e1fe226a1412b8", "postedAt": "1 day ago", "scrapedAt": "2023-03-18T19:39:01.328Z", "description": "/n Title – Business Systems Analyst (Analytics & Insights) Location - South SFO, CA (3-4 days onsite)/n Does solving complex business problems and real-world challenges interest you? Do you enjoy seeing the impact your contributions make on a daily basis? Are you passionate about using data analytics to provide game changing solutions to the Global 2000 clients? Do you thrive in a dynamic work environment that constantly pushes you to be the best you can be and more? Are you ready to work with smart colleagues who drive for excellence in everything they do?/n If you possess a solutions mindset, strong architecting skills, and commitment to be part of a tremendous journey, come join our growing, global team. See what Saama can do for your career and for your journey./n Key relationships:/n /n All project team members at onsite & offshore/n Enterprise Architecture Teams/n Data Modelers/n Business Teams/n Upstream & Downstream Application teams/n PMO Teams - Internal & Client/n Operations support teams at Onsite and Offshore/n /n What We Value/n /n Integrity: doing the right thing /n Solutions: solving core, complex business challenges/n Collaboration: working as one team/n Innovation: changing the game/n Transparency: communicating openly/n Enjoy & Celebrate: having fun/n /n Competencies:/n /n Results-oriented and a self-starter who enjoys a challenge and needs minimal support and direction./n Works well in structured environment handling multiple threads/n Takes initiative; challenges status quo/n Learns quickly; takes smart risks & experiments./n Consulting skills; identifies key requirements in dynamic environments./n Positive Attitude, Communication & Influence skills. Able to communicate effectively and credibly with clients, and other team members. Effective in both written and spoken communication./n Stays the course despite challenges & setbacks/n /n What you will do/n /n Partner with internal stakeholders to identify and analyze requirements to define scope, objectives, and feasibility analysis. Create a comprehensive Product Requirement Document and detailed Product Roadmap for Genentech’s NLP Platform/n Prepare robust technical reports and create diagrams, workflow maps, or other visuals to facilitate enhanced system understanding/n Produce detailed wireframes and mockups using visualization tools for prototyping/n Work closely with Data Management & Architecture teams to maintain awareness of accessibility, compliance, and security policies and guidelines/n Lead portions of large tasks or projects; build and maintain project management skills/n Participate in the implementation of system patches, updates, and maintenance/n Collaborate with Product Managers, Project Managers/Scrum Masters, Architects, Engineers, Developers, Quality Assurance, and User Experience Designers on scope, solutions, constraints, and risks/n Collaborate with cross-functional IT organization to streamline solution implementations to maintain records of system integrations, changes, and incidents/n Develop and execute test plans, as well as other quality assurance measures; lead testing such as user acceptance, performance, security, usability, etc./n Provide timely dissemination of communications for system changes; determine support and resource requirements associated with each change/n /n Must Have/n /n Experience of working in end-to-end software development lifecycle/n [Non-negotiables] Hands-on expertise with Jira, Confluence, Trello, Lucid Chart and Google Suite/n [Non-negotiables] Be on-site 3-4 days a week and/or as required by product team/n [Non-negotiables] Excellent communication (written and oral) and presentation skills; solid business acumen of US Commercial Market in Pharma industry; well-honed influencing skills are essential/n Demonstrated success in handling initiatives of high complexity, high profile, and large-scale programs/n Self-motivated and team-oriented; able to work both autonomously and effectively as part of a geographically dispersed team/n Must have for data and hands on experience with data related initiatives/n Understanding and experience in ML and data science concepts is preferred/n /n Education and Work Experience/n /n Masters or Bachelor’s degree in Computer, IT, Software or related field required/n /n Work Environment/n This job operates in a professional office environment. This role routinely uses standard office equipment, including but not limited to, computers, phones, and photocopiers./n Physical Demands/n This position requires the frequent and repetitive use of a computer, keyboard, and mouse. Hand and finger dexterity is required./n Other Duties/n Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice./n EEO/n Saama Technologies, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws./n This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training./n/n", "descriptionHTML": "<div>/n <p><b>Title &#x2013; Business Systems Analyst (Analytics &amp; Insights)</b><br> <b>Location - South SFO, CA (3-4 days onsite)</b></p>/n <p> Does solving complex business problems and real-world challenges interest you? Do you enjoy seeing the impact your contributions make on a daily basis? Are you passionate about using data analytics to provide game changing solutions to the Global 2000 clients? Do you thrive in a dynamic work environment that constantly pushes you to be the best you can be and more? Are you ready to work with smart colleagues who drive for excellence in everything they do?</p>/n <p> If you possess a solutions mindset, strong architecting skills, and commitment to be part of a tremendous journey, come join our growing, global team. See what Saama can do for your career and for your journey.</p>/n <p><b> Key relationships:</b></p>/n <ul>/n <li> All project team members at onsite &amp; offshore</li>/n <li> Enterprise Architecture Teams</li>/n <li> Data Modelers</li>/n <li> Business Teams</li>/n <li> Upstream &amp; Downstream Application teams</li>/n <li> PMO Teams - Internal &amp; Client</li>/n <li> Operations support teams at Onsite and Offshore</li>/n </ul>/n <p><b> What We Value</b></p>/n <ul>/n <li> Integrity: doing the right thing </li>/n <li>Solutions: solving core, complex business challenges</li>/n <li> Collaboration: working as one team</li>/n <li> Innovation: changing the game</li>/n <li> Transparency: communicating openly</li>/n <li> Enjoy &amp; Celebrate: having fun</li>/n </ul>/n <p><b> Competencies:</b></p>/n <ul>/n <li> Results-oriented and a self-starter who enjoys a challenge and needs minimal support and direction.</li>/n <li> Works well in structured environment handling multiple threads</li>/n <li> Takes initiative; challenges status quo</li>/n <li> Learns quickly; takes smart risks &amp; experiments.</li>/n <li> Consulting skills; identifies key requirements in dynamic environments.</li>/n <li> Positive Attitude, Communication &amp; Influence skills. Able to communicate effectively and credibly with clients, and other team members. Effective in both written and spoken communication.</li>/n <li> Stays the course despite challenges &amp; setbacks</li>/n </ul>/n <p><b> What you will do</b></p>/n <ul>/n <li> Partner with internal stakeholders to identify and analyze requirements to define scope, objectives, and feasibility analysis. Create a comprehensive Product Requirement Document and detailed Product Roadmap for Genentech&#x2019;s NLP Platform</li>/n <li> Prepare robust technical reports and create diagrams, workflow maps, or other visuals to facilitate enhanced system understanding</li>/n <li> Produce detailed wireframes and mockups using visualization tools for prototyping</li>/n <li> Work closely with Data Management &amp; Architecture teams to maintain awareness of accessibility, compliance, and security policies and guidelines</li>/n <li> Lead portions of large tasks or projects; build and maintain project management skills</li>/n <li> Participate in the implementation of system patches, updates, and maintenance</li>/n <li> Collaborate with Product Managers, Project Managers/Scrum Masters, Architects, Engineers, Developers, Quality Assurance, and User Experience Designers on scope, solutions, constraints, and risks</li>/n <li> Collaborate with cross-functional IT organization to streamline solution implementations to maintain records of system integrations, changes, and incidents</li>/n <li> Develop and execute test plans, as well as other quality assurance measures; lead testing such as user acceptance, performance, security, usability, etc.</li>/n <li> Provide timely dissemination of communications for system changes; determine support and resource requirements associated with each change</li>/n </ul>/n <p><b> Must Have</b></p>/n <ul>/n <li> Experience of working in end-to-end software development lifecycle</li>/n <li> [Non-negotiables] Hands-on expertise with Jira, Confluence, Trello, Lucid Chart and Google Suite</li>/n <li> [Non-negotiables] Be on-site 3-4 days a week and/or as required by product team</li>/n <li> [Non-negotiables] Excellent communication (written and oral) and presentation skills; solid business acumen of US Commercial Market in Pharma industry; well-honed influencing skills are essential</li>/n <li> Demonstrated success in handling initiatives of high complexity, high profile, and large-scale programs</li>/n <li> Self-motivated and team-oriented; able to work both autonomously and effectively as part of a geographically dispersed team</li>/n <li> Must have for data and hands on experience with data related initiatives</li>/n <li> Understanding and experience in ML and data science concepts is preferred</li>/n </ul>/n <p><b> Education and Work Experience</b></p>/n <ul>/n <li> Masters or Bachelor&#x2019;s degree in Computer, IT, Software or related field required</li>/n </ul>/n <p> <b>Work Environment</b></p>/n <p> This job operates in a professional office environment. This role routinely uses standard office equipment, including but not limited to, computers, phones, and photocopiers.</p>/n <p><b> Physical Demands</b></p>/n <p> This position requires the frequent and repetitive use of a computer, keyboard, and mouse. Hand and finger dexterity is required.</p>/n <p><b> Other Duties</b></p>/n <p> Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.</p>/n <p><b> EEO</b></p>/n <p> Saama Technologies, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.</p>/n <p> This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.</p>/n</div>/n<p></p>", "externalApplyLink": "https://www.indeed.com/applystart?jk=24e1fe226a1412b8&from=vj&pos=bottom&mvj=0&spon=0&sjdu=YmZE5d5THV8u75cuc0H6Y26AwfY51UOGmh3Z9h4OvXjkZm6RCuBOjvJ-BgzO1TnPl8EZNoFLzyHkpvcd7-Y9bg&vjfrom=serp&astse=337c23049493ec1c&assa=644" }] ...

How Many Outputs Can I Extract Using the Indeed Data Scraper?

The scraper gives you over one thousand results per day on average.

Remember that the Indeed data crawler extracts data dynamically, with frequent changes. You may find variations in maximum result count depending on complications in location and other input parameters.

Hence, we often experiment with trial runs of the scraper to maintain benchmark scraping, keeping output variations in mind. You can also perform a trial run of the scraper to ensure it works for all use cases.

What is the Cost of Using Indeed Scraper?

Estimating the required resources for data scraping is tedious due to variable use cases. Due to this, you should perform a trial run of the scraper and gauge its cost. You can multiply the price you consumed in the test run with your actual data scraping requirements.

You can visit our pricing page to learn more about pricing. We recommend you choose a higher plan and save your cost in the long term.

Do You Want to Scrape Other Job Postings Sites like Upwork or Glassdoor?

If you wish to scrape particular job posting data from other platforms, you can try dedicated job posting data scrapers from the following list.

  • Google Jobs Scraper
  • Upwork Scraper
  • Crunchbase Scraper
  • LinkedIn Scraper
  • Glassdoor Scraper
  • Indeed Resume Scraper

Indeed Data Scraper with Integrations

You can connect Indeed Scraper with almost any web application or cloud service using integrations available on our platform. Zapier, Google Sheets, Slack, Make, Google Drive, Airbyte, and GitHub are some options for integrating Indeed Job Data Scraper.

To conduct any action, like getting a notification for a successful run of Indeed API, you can use Webhooks.

Using Indeed Job Data Scraper with Real Data API Actor

Our actor gives you programmatic permission to access the platform. We have organized the actor around RESTful HTTP endpoints, allowing you to schedule, execute and manage scrapers. The actor also allows you to track scraper performances, update and create scraper versions, access datasets, retrieve outputs, and more.

You can try our client PyPl and client NPM packages to access the scrapers using Python and Node.js, respectively.

Can I Scrape Indeed Job Data Legally Using Indeed Data Scraper?

We have developed our scrapers for ethical uses that don't scrape any personal data. But, you must remember that you unknowingly may get some personal data in your results. You should consult your lawyer before scraping the personal data if you are unsure whether your reason is genuine.

Need help getting the required data from Indeed Scraper? Develop your own job data scraper!

You can develop your Indeed Job Data Collection tool if this scraper can't fulfill your requirement. Multiple templates are available on our platform in Python, TypeScript, JavaScript, etc. Besides templates, you can always write your code from zero with the help of Crawlee, an open-source library. It is your choice to publish the tool on our platform.

Contact us for a custom scraper solution to avoid developing your crawler.

Your Feedback for Indeed Scraper

Our team constantly works to improve the performance of our Indeed Scraper. Therefore if you find any bug or have any technical feedback, you can raise the issue from your console account.

Industries

Check out how industries are using Amazon data scraper around the world.

saas-btn.webp

E-commerce & Retail

You should have a Real Data API account to execute the program examples. Replace < YOUR_API_TOKEN > in the program using the token of your actor. Read about the live APIs with Real Data API docs for more explanation.

import { RealdataAPIClient } from 'RealdataAPI-Client';

// Initialize the RealdataAPIClient with API token
const client = new RealdataAPIClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare actor input
const input = {
    "position": "web developer",
    "country": "US",
    "location": "San Francisco",
    "maxItems": 100,
    "maxConcurrency": 5,
    "proxyConfiguration": {
        "useRealdataAPIProxy": true
    }
};

(async () => {
    // Run the actor and wait for it to finish
    const run = await client.actor("misceres/indeed-scraper").call(input);

    // Fetch and print actor results from the run's dataset (if any)
    console.log('Results from dataset');
    const { items } = await client.dataset(run.defaultDatasetId).listItems();
    items.forEach((item) => {
        console.dir(item);
    });
})();
from RealdataAPI_client import RealdataAPIClient

# Initialize the RealdataAPIClient with your API token
client = RealdataAPIClient("<YOUR_API_TOKEN>")

# Prepare the actor input
run_input = {
    "position": "web developer",
    "country": "US",
    "location": "San Francisco",
    "maxItems": 100,
    "maxConcurrency": 5,
    "proxyConfiguration": { "useRealdataAPIProxy": True },
}

# Run the actor and wait for it to finish
run = client.actor("misceres/indeed-scraper").call(run_input=run_input)

# Fetch and print actor results from the run's dataset (if there are any)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)
# Set API token
API_TOKEN=<YOUR_API_TOKEN>

# Prepare actor input
cat > input.json <<'EOF'
{
  "position": "web developer",
  "country": "US",
  "location": "San Francisco",
  "maxItems": 100,
  "maxConcurrency": 5,
  "proxyConfiguration": {
    "useRealdataAPIProxy": true
  }
}
EOF

# Run the actor
curl "https://api.RealdataAPI.com/v2/acts/misceres~indeed-scraper/runs?token=$API_TOKEN" /
  -X POST /
  -d @input.json /
  -H 'Content-Type: application/json'

Search Keywords or Positions

position Optional String

It is for the combination of search keywords or positions. If you use start URLs, turn off this option.

Discover Jobs Using Country Search

country Optional Enum

It is an input field to put a country option to search for a job.

Options:

AU string, US string, UK string, CA string, IN string, UAE string, FR string, DE String, SP string , MQ string, NZ string

Note: These are example country options.

Search Location

location Optional String

Enter any combination of search location, city, pin code, or zip code.

Maximum Items

maxItems Optional Integer

It is the limit of maximum pages to scrape from the platform.

Scrape Company Information

parseCompanyDetails Optional Boolean

If you don't find company details on the job page, you can scrape the company page using relevant navigation and data scraping.

Save Unique Items

saveOnlyUniqueItems Optional Boolean

The scrape will store unique job detail items.

Maximum Concurrency

maxConcurrency Optional Integer

Stay within ten; behave well with the Indeed website.

Start URLs

startUrls Optional Array

It is the list of Indeed links that the scraper will crawl to collect data. Links may include category, search, products, details, or website URLs.

Proxy Configuration

proxyConfiguration Optional Object

Choose a relevant proxy server to support the scraper.

{
  "position": "web developer",
  "country": "US",
  "location": "San Francisco",
  "maxItems": 100,
  "parseCompanyDetails": false,
  "saveOnlyUniqueItems": true,
  "maxConcurrency": 5,
  "proxyConfiguration": {
    "useRealdataAPIProxy": true
  }
}