{"id":3204474,"url":"https://alion.io/job/epsilon-staff-engineer","title":"Staff Engineer","company":{"id":410,"name":"Epsilon","domain":"epsilon.com","url":"https://alion.io/company/epsilon","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Industrial Engineering","role_family":"Industrial Engineering","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":21000,"max_usd":49000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":1625},"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AWS","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Docker","optional":false},{"name":"ElasticSearch","optional":false},{"name":"GCP","optional":false},{"name":"Grafana","optional":false},{"name":"Hadoop","optional":false},{"name":"Kibana","optional":false},{"name":"Kubernetes","optional":false},{"name":"Logstash","optional":false},{"name":"Machine Learning","optional":false},{"name":"Power BI","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Scrum","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Tableau","optional":false}],"status":"live","first_seen_at":"2026-10-24T11:36:30Z","employer_posted_date":null,"last_verified_at":"2026-10-24T11:36:30Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and builds products that position Epsilon as a differentiator, encouraging an open and balanced marketplace built on respect for individuals, where every brand interaction holds value. Our full-cycle product engineering and data teams chart the future and set new benchmarks for our products by using industry-standard methodologies and sophisticated capabilities in data, machine learning, and artificial intelligence. Driven by a passion for delivering smart end-to-end solutions, this team plays a key role in Epsilon's success story.\n\nWe seek Staff Software Engineers with experience building and scaling services in on-premises and cloud environments. As a Lead/Principal Engineer in the Epsilon Attribution/Forecasting Product Development team, you will design, implement, and optimise data processing solutions using Scala, Spark, and Hadoop. Collaborate with cross-functional teams to deploy big data solutions on our on-premises and cloud infrastructure, along with building, scheduling and maintaining workflows. Perform data integration and transformation, troubleshoot issues, Document processes, communicate technical concepts clearly, and continuously enhance our attribution engine/forecasting engine. Strong written and verbal communication skills (in English) are required to facilitate work across multiple countries and time zones. Good understanding of Agile Methodologies - SCRUM.\n\nRequirements: \nStrong experience (12+ years) in Python/Scala programming language and extensive experience with Apache Spark for big data processing for developing and supporting both on-prem and cloud operations, especially on AWS and as needed with GCP cloud.\nUsing Python to develop infrastructure modules.\nHence, hands-on experience with Python.\nIn-depth understanding of the Hadoop ecosystem, including HDFS, YARN, and MapReduce.\nSolid grasp of database systems and SQL for writing efficient SQLs(RDBMS/Warehouse) to handle TBS of data.\nExperience in building, scheduling and maintaining DAG workflows.\nFamiliarity with data warehousing concepts and technologies.\nEnd-to-end ownership with definition, development, and documentation of software's objectives, business requirements, deliverables, and specifications in collaboration with partners.\nExperience in working on GIT (or equivalent source control).\nUnderstand Unit and integration test frameworks.\nMust have the ability to collaborate with stakeholders/teams to understand requirements and develop a working solution.\nAbility to work within tight deadlines and effectively prioritise and complete tasks in a high-pressure environment.\nMust be able to mentor junior staff.\n\nAdvantageous to have experience on below: \nHands-on with Databricks for unified data analytics, including Databricks Notebooks, Delta Lake, and Catalogues.\nProficiency in using the ELK (Elasticsearch, Logstash, Kibana) stack for real-time search, log analysis, and visualisation.\nStrong background in analytics, including the ability to derive actionable insights from large datasets and support data-driven decision-making.\nExperience with data visualisation tools like Tableau, Power BI, or Grafana.\nFamiliarity with Docker for containerization and Kubernetes for orchestration.\nSkills\nApache Spark, HDFS, Hadoop, MapReduce, Python, Scala, Spark, YARN","description_format":"text","description_chars":3492,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Marketing Automation","Email Marketing"],"lifecycle":[{"event":"open","at":"2026-10-24T11:36:30Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["seen:0","velocity","win:early"],"computed_at":"2026-10-25T05:49:26Z"},"pay":null,"html_url":"https://alion.io/job/epsilon-staff-engineer","json_url":"https://alion.io/job/epsilon-staff-engineer.json","meta":{"generated_at":"2026-10-26T00:46:16Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":839,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":410},"rest":"https://alion.io/mcp/rest/get_company?id=410"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fepsilon-staff-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fepsilon-staff-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fepsilon-staff-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/epsilon-staff-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fepsilon-staff-engineer"}]}