{"id":1492010,"url":"https://alion.io/job/castandcrewnews-senior-data-engineer","title":"Senior Data Engineer","company":{"id":1908178,"name":"CastAndCrewNews","domain":"castandcrew.com","url":"https://alion.io/company/castandcrew","size_band":"1-10","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":135000,"max":165000,"currency":"USD","period":"year","gross":null,"usd_annual":165000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Aurora","optional":false},{"name":"Amazon ECS","optional":false},{"name":"Amazon EKS","optional":false},{"name":"Amazon EventBridge","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Dagster","optional":false},{"name":"DynamoDB","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Google BigQuery","optional":false},{"name":"IAM","optional":false},{"name":"MySQL","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Prefect","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Apache Iceberg","optional":true},{"name":"Azure","optional":true},{"name":"Claude Code","optional":true},{"name":"Copilot","optional":true},{"name":"Delta Lake","optional":true},{"name":"ElasticSearch","optional":true},{"name":"Feature Store","optional":true},{"name":"Kubernetes","optional":true},{"name":"Machine Learning","optional":true},{"name":"OCR","optional":true},{"name":"OpenSearch","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-09-08T00:00:00Z","employer_posted_date":"2026-09-08","last_verified_at":"2026-10-21T06:59:20Z","board_verified":true,"closed_at":null,"days_open":43,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":43},"description":"About Us\nAt Cast & Crew, we’ve empowered creativity and supported the global entertainment industry for decades. Together with our family of brands - Backstage, CAPS, Checks & Balances, Final Draft, Media Services, Sargent-Disc, and The TEAM Companies - we operate as a combined entertainment technology and services provider offering industry standard screenwriting accounting software, digital payroll products, data & reporting, and a host of creative tools. The industry continues to move faster than ever, and the need for our expertise, our technology, and our people has never been greater. We are a production’s best ally every step of the way. #OneCastOneCrew\nAt Cast & Crew, engineers own the systems they build and operate. Our platforms support mission-critical workflows across the entertainment industry, where reliability, scalability, and accountability matter. We hire engineers who take ownership, solve problems end-to-end, automate wherever possible, and continuously raise the bar for engineering excellence.\nSummary\nCast & Crew is seeking an experienced Senior Data Engineer to design, build, and operate scalable data platforms that power mission-critical applications, analytics, reporting, and AI-driven solutions across the entertainment production ecosystem.\nThis role focuses on building reliable, cloud-native data pipelines that ingest, transform, secure, and serve operational data for internal engineering teams, business intelligence, and customer-facing applications. You will work across structured and semi-structured data, enabling modern analytics, AI workloads, and real-time event processing.\nYou will collaborate closely with software engineers, platform engineers, product teams, and data consumers while leveraging AI-assisted development tools to accelerate delivery and improve engineering productivity.\nRequired Qualifications\nBachelor's degree in Computer Science, Software Engineering, Information Systems, or related field\n\n5+ years of experience building production data platforms and pipelines\n\nStrong Python development experience\n\nStrong SQL development and query optimization skills\n\nExperience designing and maintaining ETL/ELT pipelines\n\nExperience working with relational databases (PostgreSQL, MySQL, Aurora)\n\nExperience working with NoSQL databases (DynamoDB, MongoDB, document databases)\n\nExperience building data lakes and cloud-native data architectures\n\nExperience with Snowflake, BigQuery, Redshift, or similar cloud data warehouses\n\nExperience with AWS cloud services including S3, Lambda, EventBridge, DynamoDB, ECS/EKS, and IAM\n\nExperience building event-driven and streaming data solutions\n\nExperience working with Kafka, SNS/SQS, Kinesis, or similar messaging technologies\n\nExperience with data orchestration tools such as Airflow, Prefect, or Dagster\n\nExperience with Git and modern CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)\n\nExperience building highly available, scalable production systems\n\nStrong understanding of data modeling, partitioning, indexing, and performance optimization\n\nExperience monitoring and operating production data platforms\n\nNice to Have\nExperience with Apache Spark or distributed processing frameworks\n\nExperience with Debezium, CDC, or change data capture architectures\n\nExperience with Iceberg, Delta Lake, or modern lakehouse technologies\n\nExperience with OpenSearch or Elasticsearch\n\nExperience supporting AI and machine learning data platforms\n\nExperience building feature stores or vector databases\n\nExperience with document processing (OCR, Textract, PDF extraction)\n\nExperience in media, payroll, financial systems, or enterprise SaaS platforms\n\nExperience using AI-assisted development tools such as Claude Code or GitHub Copilot\n\nWhat You Will Build\nEnterprise-scale data ingestion and transformation pipelines\n\nCloud-native data platforms supporting analytics and operational workloads\n\nReal-time event-driven data processing solutions\n\nData models supporting reporting, AI, and customer-facing applications\n\nSecure, scalable integrations between enterprise systems\n\nAutomated monitoring, testing, and deployment pipelines for data infrastructure\n\nWhat Success Looks Like\nHighly reliable and scalable production data pipelines\n\nHigh-quality, trusted data powering operational and analytical systems\n\nLow-latency, automated data movement across enterprise platforms\n\nEngineering best practices including automation, observability, and testing\n\nStrong collaboration with software engineering and platform teams\n\nContinuous improvement through AI-assisted development and automation\n\nSpecial Work Conditions\nSedentary - Involves sitting most of the time but may involve walking or standing for brief periods of time. Some positions may entail exerting up to 15 lbs. of force occasionally and/or a negligible amount of force to lift, carry, push, or pull.\n\nWhat We Offer\nCast & Crew provides a comprehensive package of employee benefits including: Medical, Dental, Vision, PTO, health and wellness programs, employee discounts, and more! Note: Cast & Crew benefits are subject to eligibility requirements.\nCast & Crew is an equal opportunity employer committed to hiring a diverse workforce and sustaining an inclusive culture. It is our policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.\nCA residents\nYour personal information may be collected in connection with certain services provided by Cast & Crew or its affiliated companies. A summary of your California privacy rights can be found at: https://www.castandcrew.com/privacy-policy/\nCompensation is commensurate with various factors including, but not limited to, relevant experience, qualifications, skills, training, licensure, certifications, geographic cost of labor, and other business and organizational needs. Compensation range for candidates in other locations may differ based on the cost of labor in that location. The compensation range for this position is: $135,000.00 - $165,000.00 per year.","description_format":"text","description_chars":6378,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Wellness"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Media & Entertainment","Professional Services","Corporate Events","Human Resources"],"lifecycle":[{"event":"open","at":"2026-09-30T00:54:51Z"}],"visa":[],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":1,"p_active":0.315,"p_room":0.35,"age_days":43,"expected_fill_days":12,"reasons":["conf:7","win:tail"],"computed_at":"2026-10-21T05:46:15Z"},"pay":{"stated_usd_annual":165000,"is_top_pay":true},"html_url":"https://alion.io/job/castandcrewnews-senior-data-engineer","json_url":"https://alion.io/job/castandcrewnews-senior-data-engineer.json","meta":{"generated_at":"2026-10-21T10:24:52Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14759,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1908178},"rest":"https://alion.io/mcp/rest/get_company?id=1908178"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcastandcrewnews-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcastandcrewnews-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcastandcrewnews-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/castandcrewnews-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcastandcrewnews-senior-data-engineer"}]}