Responsibilities

BOT Development
- Design, develop, test, and deploy robust web scraping/RPA solutions for payer policy ingestion
- Crawl/query payer sites to identify:
  - Clinical/medical policies
  - Prior authorization requirements
  - Reimbursement and supporting documentation
- Extract and transform data from:
  - HTML (static and dynamic content)
  - PDFs (structured and unstructured)
  - Excel, CSV, Word documents
- Apply data transformation techniques based on understanding of data structures to normalize outputs across payers
- Build reusable, scalable parsing frameworks and templates across multiple payer domains
- Design solutions that:
  - Integrate across multiple systems and data domains
  - Utilize appropriate tools/technologies for each use case
  - Support automation and future scalability
- Identify opportunities to leverage AI/ML or advanced parsing techniques where applicable
BOT Maintenance Change Detection
- Independently monitor payer sources to:
  - Detect new policies
  - Identify updates/changes to existing policies
- Maintain and enhance bots for:
  - Structural website changes
  - New document types
  - Updated policy formats
- Perform data validation and quality assurance:
  - Detect extraction inconsistencies
  - Tune parsing logic
- Serve as escalation point for complex extraction or parsing challenges (within scope)
Data Engineering Pipeline Development
- Design and implement end-to-end data pipelines:
  - Data ingestion transformation normalization delivery
- Build and maintain scalable ETL/ELT processes for structured and unstructured data
- Develop standardized schemas and models for:
  - Policy metadata
  - Authorization rules
  - Code-level requirements (CPT, HCPCS, ICD)
- Deliver structured outputs (JSON/CSV/API payloads) to:
  - AWS S3
  - Dataverse / enterprise systems
- Enable multi-domain data modeling and normalization across heterogeneous payer sources
- Implement logging, monitoring, and instrumentation to detect pipeline failures and data quality issues early
Solution Engineering Automation
- Design solutions considering:
  - Scalability
  - Reliability
  - Security
  - Performance
- Build automatable services and reusable components rather than one-off scripts
- Evaluate and recommend tools/frameworks for:
  - Web scraping
  - Document parsing
  - Workflow orchestration
- Collaborate with stakeholders to ensure solutions maximize business value
Data Quality, Governance Documentation
- Maintain high-quality data outputs aligned to enterprise standards
- Create and maintain:
  - Data definitions
  - Transformation logic
  - Mapping documentation
  - Proactively identify:
    - Data quality issues
    - Root causes of extraction inconsistencies
- Continuously improve solution quality through pattern detection and optimization
Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications

Technical Skills
- Advanced experience with:
  - XPath / CSS selectors
  - Regular expressions (regex)
- Experience with:
  - Web scraping frameworks (Selenium, Playwright, Scrapy, etc.)
  - PDF parsing / OCR tools
- Programming:
  - Python (preferred) or C#
- Solid knowledge of:
  - HTML, DOM structure, JavaScript rendering
  - XML/JSON data modeling and schema design
- Familiarity with:
  - ETL/ELT pipeline design
  - Cloud storage (AWS S3 or Azure equivalents)
  - API integrations

Senior Software Engineering Lead - BOT Developer, RPA

Job Description

No Referrers Available