{"id":3218056,"url":"https://alion.io/job/the-phoenix-group-lead-data-engineer-2","title":"Lead Data Engineer","company":{"id":4382006,"name":"The Phoenix Group","domain":"phoenix.tech","url":"https://alion.io/company/the-phoenix-group","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":135000,"max_usd":266000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":415},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon EC2","optional":false},{"name":"Amazon ECS","optional":false},{"name":"Amazon EKS","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Fargate","optional":false},{"name":"AWS Lambda","optional":false},{"name":"CI/CD","optional":false},{"name":"dbt","optional":false},{"name":"Git","optional":false},{"name":"IAM","optional":false},{"name":"Incident Management","optional":false},{"name":"Kubernetes","optional":false},{"name":"OCR","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false}],"status":"closed","first_seen_at":"2026-10-24T19:51:46Z","employer_posted_date":null,"last_verified_at":"2026-10-25T09:30:05Z","board_verified":false,"closed_at":"2026-10-25T09:30:05Z","days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"The Phoenix Group is hiring a Lead Data Engineer to own the design, development, and maintenance of enterprise data architecture and pipelines. The role supports analytics, AI/ML, and data governance initiatives while ensuring secure, high-quality, and performant data solutions.\n\nResponsibilities\nDesign, build, test, deploy, and support scalable data pipelines utilizing orchestration tools (Airflow, Astronomer), data transformation frameworks (dbt), cloud data platforms (Snowflake), SQL, and Python\nDevelop and optimize cloud-based data architecture, including database schemas, data warehouses, security roles, workload isolation, cost management, and performance tuning within Snowflake\nImplement medallion data architecture principles—raw/bronze, silver, and gold layers—for structured and semi-structured data management\nLead migration and modernization of legacy workflows to cloud orchestration platforms, establishing reusable patterns for dependency management, retries, backfills, alerting, recovery, and ensuring idempotency\nTroubleshoot and maintain the full runtime environment of orchestration platforms, including schedulers, workers, executors, metadata stores, queues, and autoscaling components\nCollaborate with cloud infrastructure teams to manage AWS services such as S3, IAM, EKS, ECS, Fargate, EC2, Lambda, Secrets Manager, KMS, CloudWatch, and networking components\nBuild secure, resilient integrations across APIs, SFTP, databases, cloud storage, vendor APIs, flat files, Excel files, and event-driven systems\nDevelop ingestion and processing pipelines for structured, semi-structured, and unstructured data, including OCR/image-based document extraction\nEmbed data quality testing, monitoring, lineage, reconciliation, and observability into data workflows to ensure reliability and compliance\nPartner with Data Governance, Security, and Business teams to enforce data ownership, classification, access policies, retention, and auditing standards\nBuild and maintain CI/CD pipelines for orchestration workflows, transformations, and infrastructure code, ensuring automated testing, environment promotion, deployment, and rollback capabilities\nSupport production environments through on-call and incident management processes, conducting root cause analysis, stakeholder communication, and corrective actions\nEstablish reusable frameworks, engineering standards, and best practices to improve platform reliability, consistency, and delivery velocity\nLead technical workstreams, mentoring engineering team members through design reviews, code reviews, documentation, and troubleshooting\n\nSkills\nMinimum of 5+ years in data engineering or software engineering roles with progressive responsibilities\nProven experience with cloud-based data platforms, including Snowflake, AWS cloud infrastructure, and data orchestration tools such as Airflow/Astronomer\nStrong expertise in designing and implementing data architectures, including dimensional and medallion models\nHands-on experience migrating and maintaining production workflows in orchestration platforms\nDeep understanding of cloud compute environments, including Kubernetes, containers, schedulers, workers, and autoscaling architectures\nProficiency in AWS services such as S3, IAM, EKS/ECS, Lambda, Secrets Manager, KMS, and CloudWatch for security, storage, and monitoring\nSkilled in integrating complex data sources and systems, including APIs, SFTP, relational and NoSQL databases, cloud storage, and file-based workflows\nExperience processing semi-structured and unstructured data, including OCR, document extraction, and image processing\nStrong background in implementing data quality controls, automated testing, data lineage, and observability tools\nKnowledge of data governance principles, access controls, data classification, retention policies, and audit requirements\nExperience with CI/CD pipelines, Git workflows, and automated deployment practices for data solutions and infrastructure\nExcellent troubleshooting skills across cloud infrastructure, data pipelines, application code, and security permissions\nAbility to lead technical initiatives and communicate effectively with both technical teams and business stakeholders\n\nCompany Overview\nFounded by Mr. Amit Mahajan in 2016, Phoenix group is a global organization headquartered in the United States, comprising four companies. It was founded in 2008, and is headquartered in Alpharetta, Georgia, US, with a workforce of 201-500 employees. Its website is https://phoenix.tech/.","description_format":"text","description_chars":4526,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Asset Management & Funds"],"lifecycle":[{"event":"open","at":"2026-10-25T00:20:45Z"},{"event":"close","at":"2026-10-25T09:30:05Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/the-phoenix-group-lead-data-engineer-2","json_url":"https://alion.io/job/the-phoenix-group-lead-data-engineer-2.json","meta":{"generated_at":"2026-10-26T23:44:21Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32506,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4382006},"rest":"https://alion.io/mcp/rest/get_company?id=4382006"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fthe-phoenix-group-lead-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fthe-phoenix-group-lead-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fthe-phoenix-group-lead-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/the-phoenix-group-lead-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fthe-phoenix-group-lead-data-engineer-2"}]}