{"id":2617711,"url":"https://alion.io/job/kaleidoscope-innovation-data-engineer-2","title":"Data Engineer","company":{"id":4382008,"name":"Kaleidoscope Innovation","domain":"kascope.com","url":"https://alion.io/company/kaleidoscope-innovation","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"ADP","truth_index":{"grade":"B","score":75,"open_postings":37,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Detroit, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":80000,"max":110000,"currency":"USD","period":"year","gross":null,"usd_annual":110000},"salary_estimate":null,"experience_years_min":9,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon EC2","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"Data Vault","optional":false},{"name":"DataStage","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"IAM","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Scrum","optional":true}],"status":"live","first_seen_at":"2026-09-30T16:42:00Z","employer_posted_date":"2026-09-30","last_verified_at":"2026-10-17T16:33:21Z","board_verified":true,"closed_at":null,"days_open":17,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":17},"description":"We are unable to sponsor or take over sponsorship of an employment visa at this time.\nJob Title: Senior Data Engineer\nRole Summary\nWe are looking for a Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms supporting analytics, reporting, and AI/ML use cases. The ideal candidate has strong hands-on experience with Snowflake on AWS, Python-based ETL/ELT development, and enterprise scheduling/orchestration tools like Control-M, along with legacy/enterprise ETL experience in IBM DataStage. You will collaborate across engineering, analytics, and business teams in an Agile delivery model.\nKey Responsibilities\nDesign, develop, and maintain end-to-end data pipelines (batch and near real-time) using Snowflake, AWS services, and Python.\nBuild and optimize data models in Snowflake (e.g., dimensional modeling, data vault, or curated data marts) for analytics and downstream consumption.\nDevelop and maintain ETL/ELT workflows using Python and IBM DataStage; migrate/modernize workloads where applicable.\nImplement job scheduling, monitoring, and operational support using Control-M (alerting, retries, SLAs, and dependency management).\nEnsure data quality, governance, lineage, and documentation standards are met across pipelines.\nPerform performance tuning and cost optimization across Snowflake and AWS (query optimization, clustering, warehouse sizing, storage management).\nPartner with stakeholders (Data Science/AI, BI, Product, and Platform teams) to enable data products and AI-ready datasets.\nParticipate in Agile ceremonies, contribute to estimation, planning, and sprint execution; follow SDLC and change management processes.\nTroubleshoot production issues, perform root-cause analysis, and drive preventative improvements.\nRequired Technical Skills\nSnowflake: Strong expertise in Snowflake architecture, SQL development, performance tuning, security/roles, data loading/unloading, and best practices.\n AWS: Hands-on experience with AWS data ecosystem (commonly S3, IAM, CloudWatch; plus services such as Glue, Lambda, EC2, Step Functions, EMR, or Kinesis as applicable).\n Python: Strong Python programming for data engineering (ETL/ELT frameworks, API ingestion, automation, unit testing, logging).\nControl-M: Experience designing and managing enterprise job scheduling, dependencies, calendars, SLAs, monitoring, and incident handling.\nIBM DataStage: Solid experience building and maintaining DataStage jobs, handling complex transformations, and supporting production workloads.\nSQL: Advanced SQL skills for transformations, optimization, and data validation across large datasets.\n CI/CD & Version Control: Experience with Git and CI/CD practices for data pipelines (tools may vary).\nOperational Excellence: Monitoring, alerting, and production support experience in a 24x7 or business-critical environment.\nGood to Have\nAI/ML exposure: Experience enabling AI/ML pipelines or feature datasets; familiarity with ML lifecycle concepts, feature engineering, or MLOps tools/processes.\nExperience with data governance/metadata tools and practices (catalog, lineage, data quality frameworks).\nExposure to streaming or event-driven architectures.\nRequired Soft Skills\nStrong experience working in Agile/Scrum teams and delivering within structured SDLC processes.\nExcellent communication skills (technical and non-technical) with the ability to explain complex data concepts clearly.\nProven ability to coordinate across multiple teams (Data Engineering, Data Science, DevOps, Security, BI, and business stakeholders).\nStrong ownership mindset, problem-solving ability, and attention to detail.\nQualifications (Typical)\nBachelor’s degree in Computer Science, Engineering, or related field (or equivalent practical experience).\n9+ years of data engineering experience, including enterprise-grade data platform delivery and production support.\nKaleidoscope, an Infosys Company, is an equal opportunity employer, and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.","description_format":"text","description_chars":4185,"description_truncated":false,"requirements":{"experience_years_min":9,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Design & Creative","Software","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-15T12:37:35Z"}],"visa":[],"liveness":{"score":51,"band":"ok","label":"Likely open","p_open":1,"p_active":0.565,"p_room":0.9,"age_days":16,"expected_fill_days":28,"reasons":["conf:1","stale_co","velocity","win:mid"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":110000,"is_top_pay":false},"html_url":"https://alion.io/job/kaleidoscope-innovation-data-engineer-2","json_url":"https://alion.io/job/kaleidoscope-innovation-data-engineer-2.json","meta":{"generated_at":"2026-10-17T20:19:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4049,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4382008},"rest":"https://alion.io/mcp/rest/get_company?id=4382008"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fkaleidoscope-innovation-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fkaleidoscope-innovation-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fkaleidoscope-innovation-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/kaleidoscope-innovation-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fkaleidoscope-innovation-data-engineer-2"}]}