{"id":196833,"url":"https://alion.io/job/proximity-senior-data-engineer-adtech","title":"Senior Data Engineer","company":{"id":6179,"name":"Proximity","domain":"proximity.tech","url":"https://alion.io/company/proximity-labs","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":47000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Apache Kafka","optional":true},{"name":"Databricks","optional":true}],"status":"live","first_seen_at":"2026-10-06T04:36:43Z","employer_posted_date":"2026-10-06","last_verified_at":"2026-10-22T14:03:39Z","board_verified":true,"closed_at":null,"days_open":16,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":16},"description":"We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.\nThe ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.\nYou will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.\nKey Responsibilities\nDesign, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.\nBuild and optimize distributed data applications using Apache Spark and Python Scala.\nDevelop reliable, high-performance data pipelines for batch and streaming workloads.\nDesign and manage data workflows using Apache Airflow.\nBuild and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.\nWork with large datasets to ensure data quality, consistency, reliability, and performance.\nCollaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.\nOptimize data workflows for scalability, reliability, performance, and cost efficiency.\nTroubleshoot production issues, identify bottlenecks, and continuously improve platform performance.\nRequirements\nCandidates who demonstrate:\n5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.\nStrong hands-on experience with Apache Spark and Scala.\nExperience designing, building, and maintaining large-scale ETL pipelines.\nStrong hands-on experience with AWS, particularly Amazon S3.\nHands-on experience with Apache Airflow for workflow orchestration and scheduling.\nStrong SQL skills and a solid understanding of distributed data processing concepts.\nExperience working with batch and/or streaming data pipelines.\nExcellent debugging, problem-solving, and performance optimization skills.\nStrong communication and collaboration skills.\nGood to Have\nExperience with Databricks and the broader Databricks data platform.\n\nFamiliarity with streaming technologies such as Apache Kafka.\n\nExperience working on large-scale data platforms handling high-volume data workloads.\n\nExposure to additional AWS data services and cloud-native data architectures.\n\nBenefits\nBest-in-class salary: We hire strong talent and compensate accordingly.\nProximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.\nContinuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.\nHigh-impact work: Build AI-first systems and products used at scale by global clients.\nAbout Us\nProximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.\nSince 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.","description_format":"text","description_chars":3306,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Machine Learning","Custom Software Development","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-09-03T14:09:05Z"}],"visa":[],"liveness":{"score":60,"band":"ok","label":"Likely open","p_open":1,"p_active":0.757,"p_room":0.788,"age_days":16,"expected_fill_days":17,"reasons":["conf:0","velocity","win:late"],"computed_at":"2026-10-22T06:10:10Z"},"pay":null,"html_url":"https://alion.io/job/proximity-senior-data-engineer-adtech","json_url":"https://alion.io/job/proximity-senior-data-engineer-adtech.json","meta":{"generated_at":"2026-10-22T18:45:02Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1619,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-23T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6179},"rest":"https://alion.io/mcp/rest/get_company?id=6179"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fproximity-senior-data-engineer-adtech"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fproximity-senior-data-engineer-adtech"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fproximity-senior-data-engineer-adtech"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/proximity-senior-data-engineer-adtech\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fproximity-senior-data-engineer-adtech"}]}