{"id":3627711,"url":"https://alion.io/job/hireflex-data-engineer","title":"Data Engineer","company":{"id":4442813,"name":"HireFlex","domain":"hireflex.in","url":"https://alion.io/company/hireflex","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":true,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure SQL Database","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"AWS","optional":true},{"name":"CI/CD","optional":true},{"name":"GCP","optional":true}],"status":"live","first_seen_at":"2026-11-02T17:19:14Z","employer_posted_date":null,"last_verified_at":"2026-11-02T17:19:14Z","board_verified":false,"closed_at":null,"days_open":4,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":4},"description":"We are looking for an experienced Data Engineer with a deep understanding of Azure and Databricks platforms. The ideal candidate will have at least 7+years of experience in data engineering, with expertise in designing, developing, and maintaining data pipelines, optimizing data processing workflows, and ensuring the reliability and scalability of our data infrastructure.\n\nKey Responsibilities \nData Pipeline Development: Design, develop, and maintain scalable data pipelines and ETL processes using Azure Data Factory and Databricks. Implement automation and orchestration to streamline data processing.\nDynamic OpCo Deployments: Refactor existing code and RESTful services to support dynamic OpCo (Operating Company) deployments, enabling multitenant scalability across the platform.\nCollaboration: Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and translate them into technical specifications that drive analytics and machine learning initiatives.\nOptimization & Scalability: Optimize and manage data processing workflows for performance, scalability, and reliability. Implement best practices for efficient data storage and retrieval.\nData Quality & Validation: Implement robust data quality checks and validation processes to ensure the accuracy, consistency, and integrity of data across pipelines. Update and refine code testing strategies to continually improve data quality and reliability.\nMonitoring & Troubleshooting: Monitor, troubleshoot, and optimize data pipelines to ensure timely and accurate data delivery, proactively identifying and addressing potential issues.\nData Handling: Work with large-scale datasets structured, semi-structured, and unstructured to support various analytics, machine learning, and business intelligence initiatives. Integrate new data pipeline executions with the HDP Upload Portal to streamline data ingestion and ensure seamless pipeline execution.\nSecurity & Compliance: Ensure data security and compliance with industry standards and best practices. Implement data governance frameworks and manage data access controls.\nContinuous Improvement: Continuously improve and evolve data engineering practices, tools, and processes. Stay up to date with the latest developments in Azure, Databricks, and data engineering technologies.\n\nRequired Qualifications \nEducation: Bachelor's degree in computer science, Engineering, Information Technology, or a related field.\nExperience: Minimum of 7 years of experience in data engineering, including hands-on work with Azure Data Factory, Azure Databricks, and other Azure data services.\nTechnical Proficiency: Strong SQL skills and experience with database technologies such as Azure SQL Database or SQL Server, and familiarity with big data processing frameworks like Apache Spark.\nProgramming Skills: Proficiency in one or more programming languages (such as Python, Scala, etc.,), with an emphasis on writing clean, efficient, and scalable code.\nData Modelling: Strong understanding of data warehousing concepts and data modelling, with experience in creating and managing enterprise data warehouses.\nProblem-Solving: Excellent problem-solving skills with the ability to work independently as well as in a collaborative team environment.\nCommunication: Strong communication skills with the ability to effectively collaborate with both technical and non-technical stakeholders to drive project success.\n\nPreferred Qualifications\nAzure Synapse Analytics: Experience with data integration, warehousing, and analytics using Azure Synapse.\nData Governance & Security: Knowledge of data governance, data security, and compliance best practices, and experience implementing these in a data engineering context.\nDevOps & CI/CD: Familiarity with CI/CD pipelines and DevOps practices for data engineering, including version control, automated testing, and continuous deployment.\nMulti-Cloud Experience: Experience with other cloud platforms such as Azure, AWS or GCP is a plus, bringing additional versatility to the role.\n\nWhat We Offer \nInnovative Environment: Work in a dynamic environment where cutting-edge technology and innovation are at the heart of everything we do.\nProfessional Growth: Opportunities for continuous learning, professional development, and career advancement within a rapidly growing company.\nCollaborative Culture: Be part of a diverse, creative team that values initiative and collaboration.\nComprehensive Benefits: Competitive salary, comprehensive health benefits, retirement plans, and other perks to support your work-life balance.\nJoin Our Team\nIf you are passionate about data engineering and excited to work with Azure and Databricks to build scalable data solutions, we invite you to apply. Join us and contribute to our mission of leveraging data to drive business transformation.","description_format":"text","description_chars":4864,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Professional development","Retirement plans"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Recruiting & Staffing","Freelance & Talent Marketplaces"],"lifecycle":[{"event":"open","at":"2026-11-02T20:10:00Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":29,"reasons":["seen:3","velocity","win:early"],"computed_at":"2026-11-06T05:58:05Z"},"pay":null,"html_url":"https://alion.io/job/hireflex-data-engineer","json_url":"https://alion.io/job/hireflex-data-engineer.json","meta":{"generated_at":"2026-11-06T21:50:31Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2826,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4442813},"rest":"https://alion.io/mcp/rest/get_company?id=4442813"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhireflex-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhireflex-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhireflex-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hireflex-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhireflex-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3627711}},{"tool":"search_jobs","arguments":{"company":"hireflex.in","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3627711},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}