{"id":2459033,"url":"https://alion.io/job/hitachi-solutions-databricks-data-engineer","title":"Databricks Data Engineer","company":{"id":5069,"name":"Hitachi Solutions","domain":"hitachi-solutions.com","url":"https://alion.io/company/hitachi-solutions","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":81,"open_postings":4,"ghost_share":0,"stale_share":0.75,"repost_share":0,"time_to_fill_p50_days":47,"computed_at":"2026-10-14T06:34:16Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":18500,"max_usd":37000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":55},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"GCP","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"Apache Kafka","optional":true},{"name":"Azure Data Factory","optional":true},{"name":"Delta Lake","optional":true},{"name":"Django","optional":true},{"name":"FastAPI","optional":true},{"name":"Flask","optional":true},{"name":"Microsoft Fabric","optional":true},{"name":"Scala","optional":true},{"name":"SQL","optional":true}],"status":"live","first_seen_at":"2026-10-13T12:28:41Z","employer_posted_date":"2026-10-13","last_verified_at":"2026-10-14T10:08:59Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Hitachi Solutions India Pvt Ltd:\nHitachi Solutions, Ltd., headquartered in Tokyo, Japan, is a core member of Information & Telecommunication Systems Company of Hitachi Group and a recognized leader in delivering proven business and IT strategies and solutions to companies across many industries. The company provides value-driven services throughout the IT life cycle from systems planning to systems integration, operation and maintenance. Hitachi Solutions delivers products and services of superior value to customers worldwide through key subsidiaries in the United States, Europe, China and India. The flagship company in the Hitachi Group's information and communication system solutions business, Hitachi Solutions also offers solutions for social innovation such as smart cities.\nOur Competitive Edge\nWe work together in a dynamic and rewarding work environment. We have an experienced leadership team, excellent technology and product expertise, and strong relationships with a broad base of customers and partners.\nWe offer competitive compensation and benefits package, regular performance review, performance bonuses, and regular trainings.\nWhat is it like working here?\nWe pride ourselves on being industry leaders and providing an enjoyable work environment where our people can grow personally and professionally. Hitachi is the place people can develop skills they’re excited about. The following are our commitments to employees.\nWe recognize our profitability and project success comes from our team-great people doing great things. As such, we pursue profitable growth and expanded opportunities for our team.\nWe offer challenging and diverse work across multiple industries and reward creativity and entrepreneurial innovation.\nWe respect, encourage, and support each individual needs to continually learn and grow personally and professionally. We are committed to fostering our people.\nWe listen. Every employee has something important to say that can contribute to enriching our environment.\nWe compensate fairly. And while employees might come for the paycheck, they stay for the people. Our people are the reason we are exceptional. This is something we never forget.\n Job Description:\nWe are looking for a highly experienced Data Engineer to join our product organization in a full-time role. This position focuses on Big Data systems design and data architecture, with a special emphasis on Spark and Delta/Data Lake technology.\nIn this role, you will help design, develop, enhance, and maintain complex data pipeline and API products that manage business-critical operations and large-scale analytics. We are looking for applicants who demonstrate a capability to learn new concepts quickly and bring a robust background in data engineering or software engineering expertise.\nResponsibilities\nCollaborate: Work collaboratively with other engineers to architect and implement complex systems with minimal oversight, while partnering with team leadership to identify how best to improve and expand platform capabilities.\nBuild & Design: Design, develop, and maintain complex data pipeline products that support business-critical operations and large-scale analytics applications.\nSupport the Team: Partner with analytics, data science, and engineering teams to understand and solve their unique data needs and challenges.\nContinuous Learning: Dedicate time to staying current with the latest developments in the space and embrace new concepts to keep up with fast-moving data engineering technology.\nAutonomy: Enjoy a role that offers strong independence and autonomy while contributing to the technical maturity of the organization.\n Qualifications & Skills\nExperience: 5+ years of Data Engineering experience, including 4+ years designing and building Databricks data pipelines is essential. While Azure cloud experience is preferred, we are happy to consider experience with AWS, GCP, or other cloud platforms.\n Technical Stack:4+ years of hands-on experience with Python, Pyspark, or SparkSQL is key. Experience with Scala is a plus.\n4+ years of experience with Big Data pipelines or DAG Tools (such as Airflow, Dbt, Data Factory, or similar).\n4+ years of Spark experience, especially with Databricks Spark and Delta Lake.\n4+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes.\n5+ years of relevant software development experience, including Python 3.x, Django/Flask Frameworks, FastAPI (or other standard industry API), and relational databases (SQL/ORM).\n\n Additional Skills (Great to have):Experience with Microsoft Fabric specifically with Pyspark on Fabric and Fabric Pipelines\nExperience with conceptual, logical, and/or physical database designs.\nStrong SQL experience, specifically writing complex, highly optimized queries across large volumes of data.\nStrong data modeling/profiling capabilities using Kimball/star schema methodology as well as medallion architecture.\nProfessional experience with Kafka, EventHub or other live streaming technologies.\nFamiliarity with database deployment pipelines (e.g., dacpac or similar).\nExperience with unit testing or data quality frameworks.\n\nBeware of scams\nOur recruiting team may communicate with candidates via our @hitachisolutions.com domain email address and/or via our SmartRecruiters (Applicant Tracking System)  domain email address regarding your application and interview requests.\nAll offers will originate from our @hitachisolutions.com domain email address. If you receive an offer or information from someone purporting to be an employee of Hitachi Solutions from any other domain, it may not be legitimate.","description_format":"text","description_chars":5702,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Continuous learning"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Systems Integrators","Enterprise Apps Implementation Partners","Cloud Consulting & Migration"],"lifecycle":[{"event":"open","at":"2026-10-13T16:47:39Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":47,"reasons":["conf:1","win:early"],"computed_at":"2026-10-14T06:34:16Z"},"pay":null,"html_url":"https://alion.io/job/hitachi-solutions-databricks-data-engineer","json_url":"https://alion.io/job/hitachi-solutions-databricks-data-engineer.json","meta":{"generated_at":"2026-10-14T10:19:06Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11944,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5069},"rest":"https://alion.io/mcp/rest/get_company?id=5069"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhitachi-solutions-databricks-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhitachi-solutions-databricks-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhitachi-solutions-databricks-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hitachi-solutions-databricks-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhitachi-solutions-databricks-data-engineer"}]}