{"id":4159307,"url":"https://alion.io/job/weekday-data-engineer-11","title":"Data Engineer","company":{"id":7097,"name":"Weekday","domain":"weekday.works","url":"https://alion.io/company/weekday","size_band":"51-200","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"B","score":80,"open_postings":117,"ghost_share":0,"stale_share":0.983,"repost_share":0,"time_to_fill_p50_days":5,"computed_at":"2026-11-12T10:38:37Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India","Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":1000000,"max":1500000,"currency":"INR","period":"year","gross":null,"usd_annual":16178},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"HIPAA","optional":false},{"name":"Node JS","optional":false},{"name":"Pandas","optional":false},{"name":"Playwright","optional":false},{"name":"Puppeteer","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Selenium","optional":false},{"name":"SQL","optional":false},{"name":"TypeScript","optional":false},{"name":"AWS","optional":true},{"name":"Docker","optional":true},{"name":"FHIR","optional":true},{"name":"HL7","optional":true},{"name":"JavaScript","optional":true},{"name":"Prefect","optional":true}],"status":"live","first_seen_at":"2026-11-12T11:42:12Z","employer_posted_date":"2026-11-12","last_verified_at":"2026-11-12T11:42:12Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"This role is for one of Weekday’s clients\nSalary range: Rs 1000000 - Rs 1500000 (ie INR 10 - 15 LPA)\nMin Experience: 4+ years\nLocation: Pune, Bangalore\nJobType: full-time\nWe are looking for a skilled Data Engineer with hands-on experience in data engineering, web scraping, system integrations, and data migration. The role involves building automated data extraction solutions to retrieve information from healthcare vendor portals, transforming and validating the extracted data, and migrating it into target systems through REST APIs.\nThe ideal candidate should have strong Python or Node.js/TypeScript programming skills, practical experience with browser automation tools, and the ability to build reusable, scalable data connectors. The candidate must also be comfortable interacting with US-based customers, managing multiple migrations under tight deadlines, and handling sensitive patient information in compliance with HIPAA requirements.\nRequirements\nKey Responsibilities\n1. Data Extraction and Web Scraping\nDesign, develop, and maintain automated crawlers to access healthcare vendor portals such as WebPT, Prompt, Raintree, Clinicient, and Jane.\nExtract and retrieve structured information, including patient records, insurance details, appointments, provider information, documents, and account balances.\nHandle portal-specific challenges such as multi-factor authentication (MFA), session timeouts, pagination, rate limits, and frequent UI or layout changes.\nBuild reliable browser automation workflows using Playwright, Puppeteer, Selenium, or equivalent tools.\n2. Data Transformation and Validation\nMap vendor-specific fields to the target data model and ensure accurate data transformation.\nClean, deduplicate, validate, and normalise extracted datasets.\nIdentify unmapped fields, inconsistencies, and missing information, and flag them for resolution.\nUse SQL and data-processing libraries such as Pandas to perform data wrangling and validation.\n3. Data Migration and API Integration\nLoad extracted and transformed data into target systems through REST APIs.\nEnsure data is migrated in the correct sequence with appropriate authentication, batching, pagination, and retry mechanisms.\nImplement structured logging, error handling, reconciliation, and rollback processes to maintain data integrity.\nPerform test migrations, production go-live cutovers, and post-migration validation.\n4. Reusable Connector Development\nConvert one-time scripts into reusable, configurable, and scalable data connectors.\nDevelop standardised frameworks that reduce the time and effort required to onboard new healthcare vendors.\nImprove automation, reliability, and maintainability across data extraction and migration workflows.\n5. Customer Coordination and Migration Execution\nWork closely with customers and Onboarding Managers to obtain portal credentials, understand migration requirements, and finalise data scope.\nCoordinate customer sign-offs before production go-live.\nManage test data loads, migration cutovers, and reconciliation activities.\nTroubleshoot and resolve post-go-live data issues promptly.\nManage multiple migration projects simultaneously while meeting fixed delivery timelines.\nCommunicate effectively with non-technical US-based customers in English.\n6. Data Security and Compliance\nHandle sensitive patient information securely throughout extraction, processing, storage, and migration.\nFollow HIPAA requirements and applicable data protection practices.\nEnsure appropriate access controls and secure handling of customer credentials and healthcare data.\nMust-Have Skills\nPython\nAgentic AI\nWeb Scraping\nData Engineering and Data Migration\nBrowser Automation\nREST API Integration\nSQL and Data Processing\nGood-to-Have Skills\nPandas\nPlaywright\nPuppeteer\nSelenium\nNode.js/TypeScript\nWorkflow Orchestration: Airflow, Prefect, or Temporal\nAWS and Docker\nLarge Language Models (LLMs) for automated field mapping and document parsing\nQualifications and Experience\n4-7 years of experience in data engineering, system integrations, or data migration.\nStrong programming skills in Python or Node.js/TypeScript, with experience developing production-ready scripts and pipelines.\nHands-on experience with browser automation tools such as Playwright, Puppeteer, or Selenium, including login workflows, MFA, and dynamic web pages.\nStrong understanding of SQL, data transformation, and data-wrangling techniques.\nExperience integrating with REST APIs at scale, including authentication, pagination, batching, and retry handling.\nProven ability to develop reusable automation frameworks and configurable connectors rather than relying solely on one-off scripts.\nStrong problem-solving skills and the ability to manage multiple data migration projects under tight deadlines.\nExcellent English communication skills and confidence interacting with non-technical customers in the US.\nPreferred Experience\nExposure to US healthcare data and Electronic Health Record (EHR) or Practice Management (PM) systems, preferably in Physical Therapy (PT), Occupational Therapy (OT), or Speech-Language Pathology (SLP).\nFamiliarity with healthcare data standards and terminology, including HL7, FHIR, X12 (837/835), CPT, and ICD-10 codes.","description_format":"text","description_chars":5231,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-12T11:42:12Z"}],"visa":[],"liveness":{"score":52,"band":"ok","label":"Likely open","p_open":1,"p_active":0.516,"p_room":1,"age_days":0,"expected_fill_days":5,"reasons":["conf:1","agency","win:early","comp:brand"],"computed_at":"2026-11-12T13:01:55Z"},"pay":{"stated_usd_annual":16178,"is_top_pay":false},"html_url":"https://alion.io/job/weekday-data-engineer-11","json_url":"https://alion.io/job/weekday-data-engineer-11.json","meta":{"generated_at":"2026-11-12T13:01:55Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27005,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7097},"rest":"https://alion.io/mcp/rest/get_company?id=7097"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fweekday-data-engineer-11"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fweekday-data-engineer-11"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fweekday-data-engineer-11"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/weekday-data-engineer-11\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fweekday-data-engineer-11"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4159307}},{"tool":"search_jobs","arguments":{"company":"weekday.works","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4159307},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}