{"id":1315967,"url":"https://alion.io/job/digit88-senior-big-data-engineer","title":"Senior Big Data Engineer","company":{"id":3813178,"name":"Digit88","domain":"digit88.com","url":"https://alion.io/company/digit88","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Keka","truth_index":{"grade":"B","score":70,"open_postings":14,"ghost_share":0.5,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-09-28T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":19500,"max_usd":40000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":51},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Akka","optional":false},{"name":"Apache NiFi","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Gradle","optional":false},{"name":"Hadoop","optional":false},{"name":"Java","optional":false},{"name":"Maven","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-08-07T07:49:15Z","employer_posted_date":"2026-08-07","last_verified_at":"2026-09-28T13:34:38Z","board_verified":true,"closed_at":null,"days_open":52,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":51},"description":"Role : Lead Big Data Engineer\nExperience: 6 - 9 Years\nLocation: Pune\nType: Full-time\nAbout Digit88\nDigit88 empowers digital transformation for innovative and high growth B2B and B2C SaaS companies as their trusted offshore software product engineering partner!\nWe are a lean mid-stage software company, with a team of 75+ fantastic technologists, backed by executives with deep understanding of and extensive experience in consumer and enterprise product development across large corporations and startups. We build highly efficient and effective engineering teams that solve real and complex problems for our partners.\nWith more than 50+ years of collective experience in areas ranging from B2B and B2C SaaS, web and mobile apps, e-commerce platforms and solutions, custom enterprise SaaS platforms and domains spread across Conversational AI, Chatbots, IoT, Health-tech, ESG/Energy Analytics, Data Engineering, the founding team thrives in a fast paced and challenging environment that allows us to showcase our best.\nThe Vision: To be the most trusted technology partner to innovative software product companies world-wide\nThe Opportunity\nDigit88 development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate would be joining an existing team of outstanding data engineers in the US and help us expand the data engineering team and work on different products and on different layers of the infrastructure.\nJob Profile\nDigit88 is looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. Applicants must have a passion for engineering with accuracy and efficiency, be highly motivated andorganized, able to work as part of a team, and also possess the ability to work independently with minimalsupervision.\nTo be successful in this role, you should possess\nCollaborate closely with Product Management and Engineering leadership to devise and build the right solution.\nParticipate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.\nDesign and implement systems to cleanse, process, and analyze large data sets using distributed processing tools like Akka and Spark.\nUnderstanding and critically reviewing existing data pipelines, and coming up with ideas in collaboration with Technical Leaders and Architects to improve upon current bottlenecks\nTake initiatives, and show the drive to pick up new stuff proactively, and work as a Senior Individual contributor on the multiple products and features we have.\nEducation: Bachelor's degree in Engineering, Computer Science, or a related field.\n8+ years of experience in developing highly scalable Big Data pipelines.\nHands on exp in team leading and leading product or module development experience\nIn-depth understanding of the Big Data ecosystem including processing frameworks like Spark, Akka, Storm, and Hadoop, and the file types they deal with.\nExperience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.\nExcellent coding skills in Java or Scala, including the understanding to apply appropriate Design Patterns when required.\nExperience with Git and build tools like Gradle/Maven/SBT.\nStrong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.\nHave elegant, readable, maintainable and extensible code style.\nYou are someone who would easily be able to\nWork closely with the US and India engineering teams to help build the Java/Scala based data pipelines\nLead the India engineering team in technical excellence and ownership of critical modules; own the development of new modules and features \nTroubleshoot live production server issues. \nHandle client coordination and be able to work as a part of a team, be able to contribute independently and drive the team to exceptional contributions with minimal team supervision\nFollow Agile methodology, JIRA for work planning, issue management/tracking \nAdditional Project/Soft Skills:\nShould be able to work independently with India & US based team members.\nStrong verbal and written communication with ability to articulate problems and solutions over phone and emails.\nStrong sense of urgency, with a passion for accuracy and timeliness.\nAbility to work calmly in high pressure situations and manage multiple projects/tasks.\nAbility to work independently and possess superior skills in issue resolution.\nShould have the passion to learn and implement, analyse and troubleshoot issues\nBenefits/Culture @ Digit88:\nComprehensive Insurance (Life, Health, Accident)\nFlexible Work Model\nAccelerated learning & non-linear growth\nFlat organization structure driven by ownership and accountability.\nGlobal Peers - Working with some of the best engineers/professionals globally from the likes of Apple, Amazon, IBM Research, Adobe and other innovative product companies\nAbility to make a global impact with your work, leading innovations in Conversational AI, Tele-Medicine, Healthcare and more.\nYou will work with a founding team of serial entrepreneurs with multiple successful exits to their credit. The learning will be immense just as will the challenges.\nThis is the right time to join us and partner in our growth!","description_format":"text","description_chars":5808,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","LLM & Generative AI","Influencers"],"lifecycle":[{"event":"open","at":"2026-09-26T18:35:42Z"}],"liveness":{"score":27,"band":"fade","label":"Fading","p_open":1,"p_active":0.483,"p_room":0.55,"age_days":51,"expected_fill_days":40,"reasons":["conf:7","stale_co","win:tail"],"computed_at":"2026-09-28T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/digit88-senior-big-data-engineer","json_url":"https://alion.io/job/digit88-senior-big-data-engineer.json","meta":{"generated_at":"2026-09-29T00:45:07Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":659,"day_limit":5000,"remaining_today":4341,"minute_limit":60,"resets_at":"2026-09-30T00:00:00Z"}}}