{"id":1912078,"url":"https://alion.io/job/comcast-corporation-data-engineer-4","title":"Data Engineer 4","company":{"id":9377,"name":"Comcast","domain":"comcast.com","url":"https://alion.io/company/comcast-corporation","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chennai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":17000,"max_usd":35000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":56},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Aerospike","optional":false},{"name":"Amazon S3","optional":false},{"name":"Anomaly Detection","optional":false},{"name":"AWS","optional":false},{"name":"Python","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Amazon EKS","optional":true},{"name":"Apache Kafka","optional":true},{"name":"Databricks","optional":true},{"name":"Datadog","optional":true},{"name":"Kubernetes","optional":true}],"status":"closed","first_seen_at":"2026-10-05T15:02:38Z","employer_posted_date":"2026-10-05","last_verified_at":"2026-10-11T11:38:31Z","board_verified":false,"closed_at":"2026-10-11T11:38:31Z","days_open":5,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":5},"description":"Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast.Job Summary\nThis role concentrates on advanced data structures and pipelines development and maintenance, upholding quality and integrity in diverse storage solutions. It involves optimizing data flows, mentoring junior engineers, and contributing to internal tool development. The role serves as a key expert, providing strategic guidance and innovative solutions in data engineering.Job Description\nFreewheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.\nWe are looking for Data Engineer 4 to help shape the next phase of FreeWheel’s Audience Ingestion platform. This role is focused on evolving today’s multi-stage ingestion landscape into a more unified, observable, scalable, and migration-friendly pipeline for audience membership and taxonomy processing across Audience Manager and Buyer Cloud use cases.\nThe engineer in this role will work across the full ingestion lifecycle: partner file receipt, validation, normalization, raw and curated data processing, Snowflake-based transformation layers, Aerospike serving paths, migration controls, and operational observability. The role is expected to influence both current delivery and future-state platform design, especially around workload isolation, partner onboarding, migration stages, and automation.\nKey Responsibilities\nDesign and enhance audience data pipelines that ingest partner files from cloud storage, validate schema and business rules, and load data into raw, foundation, and master data layers for downstream processing.\nBuild and maintain scalable ingestion patterns for multiple file formats and ingestion modes, while ensuring deterministic processing, replicability, and strong operational reliability.\nImplement and optimize Snowflake-based data processing using external tables, CDC streams, tasks, dynamic tables, and merge patterns for incremental refresh and historical tracking.\nDevelop high-quality data models and storage patterns for raw ingest, append-only history, snapshot/master tables, and feature-serving layers that support both analytics and low-latency downstream use cases.\nPartner with application and platform teams to support Aerospike-serving workflows, migration compatibility modes, and future cutover to more efficient replace-based update patterns.\nDrive data quality across the pipeline through schema validation, reject handling, ingest status logging, file-level metadata capture, anomaly detection, and freshness/SLA monitoring.\nImprove platform observability by exposing processing, freshness, backlog, and operational metrics through standardized monitoring and alerting patterns.\nContribute to workload isolation and partner-level scalability strategies so that volume, SLA, and priority can be managed independently by audience partner, client type, or pipeline category.\nSupport migration from legacy and parallel pipelines into the unified membership pipeline, including routing logic, partner configuration, staged cutover, and reconciliation.\nHelp build future-ready onboarding and provisioning capabilities for new audience partners, including configuration-driven setup of storage, processing, and data platform resources.\nCollaborate with architects, product, and downstream consumers to simplify fragmented workflows, reduce operational overhead, and improve self-service visibility into data movement and pipeline health.\nMentor junior engineers and raise the bar on design quality, coding standards, testing discipline, and data platform best practices across the team.\nMust-Have Skills\nAdvanced SQL, including strong experience with incremental processing, merge logic, CDC-driven transformations, and performance-aware data modeling.\nStrong Python proficiency for data engineering, automation, and platform tooling.\nDeep hands-on experience with Snowflake in production, including Streams, Tasks, Dynamic Tables, external tables, and warehouse/workload management.\nStrong experience with AWS-based ingestion patterns, especially S3-centric file pipelines and cloud-native event-driven processing.\nExperience designing ingestion frameworks for structured and semi-structured file formats such as CSV, TSV, and PSV, with robust schema validation and reject handling.\nExperience building reliable batch and near-real-time data pipelines with a strong focus on replay, idempotency, lineage, and operational supportability.\nStrong understanding of data quality, observability, SLA management, and file/job-level operational metrics.\nExperience with data modeling for both historical and serving-oriented datasets, including snapshot, append-only, and feature-serving patterns.\nExperience working on cloud infrastructure and deployment automation, with exposure to Terraform, schema change, or similar infrastructure/database change management tooling.\nAbility to work across current-state systems and future-state platform transitions, balancing delivery, migration safety, and long-term simplification.\nGood to Have\nExperience with Aerospike-backed serving systems or other low-latency key-value serving layers.\nExperience with Kafka, EKS/Kubernetes workers, autoscaling consumer patterns, or queue-driven distributed processing.\nFamiliarity with ingestion patterns or file-to-serving architectures.\nExperience with Datadog or similar monitoring platforms for data pipeline alerting and operational dashboards.\nExposure to Databricks/Delta-based ingestion design, especially in environments evaluating multiple implementation paths for unified ingestion.\nExperience with partner onboarding automation, region-aware data processing, and privacy/compliance-aware storage design.\nExperience Profile\n8+ years of experience in data engineering, with strong ownership of production data pipelines and platform-scale systems.\nProven experience leading complex technical initiatives that span ingestion, transformation, storage, and serving layers.\nDemonstrated ability to shape engineering direction, not just execute tasks especially in migration-heavy, multi-system environments.\nExperience mentoring engineers and influencing architecture, operational excellence, and engineering standards across teams.\nEmployees at all levels are expected to:\nUnderstand our Operating Principles; make them the guidelines for how you do your job.\nOwn the customer experience think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.\nKnow your stuff be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.\nWin as a team make big things happen by working together and being open to new ideas.\nBe an active part of the Net Promoter System a way of working that brings more employee and customer feedback into the company by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.\nDrive results and growth.\nSupport a culture of inclusion in how you work and lead.\nDo what's right for each other, our customers, investors and our communities.\nDisclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.\nWe believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality-to help support you physically, financially and emotionally through the big milestones and in your everyday life.\nPlease visit the benefits summary on our careers site for more details.\nEducation\nBachelor's DegreeWhile possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.Certifications (if applicable)\nRelevant Work Experience\n7-10 YearsComcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.","description_format":"text","description_chars":9436,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Media & Entertainment","Telecommunications","Broadcasting","Broadband"],"lifecycle":[{"event":"open","at":"2026-10-05T15:02:38Z"},{"event":"close","at":"2026-10-11T11:38:31Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/comcast-corporation-data-engineer-4","json_url":"https://alion.io/job/comcast-corporation-data-engineer-4.json","meta":{"generated_at":"2026-10-11T23:14:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13999,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":9377},"rest":"https://alion.io/mcp/rest/get_company?id=9377"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcomcast-corporation-data-engineer-4"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcomcast-corporation-data-engineer-4"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcomcast-corporation-data-engineer-4"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/comcast-corporation-data-engineer-4\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcomcast-corporation-data-engineer-4"}]}