Experience
3 - 8 yrs
Job Location
Hyderabad, India
Vacancy
1
Designation
Software Engineer
Job Type
ONSITE
Job Description
Position Overview: We are looking for a Scraper Developer to join our Online Brand Protection team. In this role, you will be responsible for maintaining the performance of our web scraping systems and expanding our data collection capabilities across marketplaces, websites and webshops, domain registries, and social media platforms. The data you gather will directly support the analysis and enforcement efforts that safeguard our clients' brands online.
This is a hands-on engineering role where you will primarily focus on building, maintaining, and enhancing scrapers, including handling challenges related to anti-bot defenses, proxies, and browser fingerprinting. You will collaborate closely with developers, data scientists, and analysts who depend on the data you deliver. You will work within a modern tech stack that includes Python, Playwright, Selenium, Google Cloud, Firebase, BigQuery, SQL, and a growing set of anti-detection libraries, as part of a small, focused team reporting to the Technical Lead and working closely with cross-functional stakeholders.
You'll love this job if you enjoy:
- Maintaining and enhancing existing scrapers across marketplaces (Amazon, Alibaba, and similar), websites and webshops, domain and WHOIS sources, and social media platforms.
- Building new scrapers for uncovered sources from initial site analysis to full production deployment.
- Ensuring scraper reliability against anti-bot defenses using techniques such as rotating proxies, browser fingerprinting, request pacing, and header/cookie management.
- Monitoring scraper health, diagnosing failures, and quickly resolving breakages due to site changes.
- Structuring and storing collected data effectively to ensure downstream pipelines receive clean, complete, and well-organized data.
- Running scrapers at scale using scheduling and orchestration tools, with proper retry mechanisms and queue management.
- Packaging and deploying scrapers in a containerized, version-controlled environment.
- Writing clean, maintainable code and actively participating in code reviews whether giving and receiving.
- Documenting scrapers to ensure they are easy to run, debug, and extend by other team members.
What you'll need to be successful:
- Experience with Selenium alongside Playwright.
- Experience with CAPTCHA-solving approaches.
- Experience working with Google Cloud and virtual machines.
- Experience scraping marketplaces or social media platforms.
- Experience reverse-engineering mobile or web APIs.
- Familiarity with browser fingerprinting libraries (e.g., undetected-chromedriver, playwright-stealth, or similar).
- Exposure to Java or TypeScript is beneficial as the platform evolves.
Qualifications Required:
- 3+ years of relevant experience in web scraping or a similar domain.
- Strong Python experience, including real-world application of Playwright.
- Hands-on experience with scraping at scale against sites with active anti-scraping mechanisms (beyond static HTML).
- Solid understanding of HTTP, HTML, DOM, browser developer tools, and modern data-loading techniques (XHR, fetch, dynamic rendering).
- Experience managing proxies, request headers, cookies, and maintaining scraper performance against anti-bot defenses.
- Proficiency with Git and experience working in containerized environments such as Docker.
- Fluent in written and verbal English.
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.