{"id":2448705,"url":"https://alion.io/job/fission-labs-lead-senior-data-engineer","title":"Lead / Senior Data Engineer","company":{"id":3809034,"name":"Fission Labs","domain":"fissionlabs.com","url":"https://alion.io/company/fission-labs","size_band":"1-10","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":29000,"max_usd":62000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":20},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"ClickHouse","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"FastAPI","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"AWS Lambda","optional":true},{"name":"IAM","optional":true},{"name":"Machine Learning","optional":true},{"name":"Spark","optional":true},{"name":"SQL","optional":true}],"status":"live","first_seen_at":"2026-10-13T11:11:37Z","employer_posted_date":null,"last_verified_at":"2026-10-13T11:11:37Z","board_verified":false,"closed_at":null,"days_open":14,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":14},"description":"Role: Lead Senior Data Engineer\nExperience: 5-10 years\nLocation: Hyderabad (Hybrid)\n\nFission Labs, Headquartered in Sunnyvale, with offices in Dallas & Hyderabad, Fission Labs is a leading software development company, specializing in crafting flexible, agile, and scalable solutions that propel businesses forward. With a comprehensive range of services, including product development, cloud engineering, big data analytics, QA, DevOps consulting, and AI/ML solutions, we empower clients to achieve sustainable digital transformation that aligns seamlessly with their business goals.\n\nRole Overview\nSenior Data Engineer is responsible for overseeing the design, development, and management of data infrastructure and pipelines within an organization. This role involves a mix of technical leadership, project management, and collaboration with other teams to ensure the efficient collection, storage, processing, and analysis of large datasets. The Lead Data Engineer typically manages a team of data engineers, architects, and analysts, ensuring that data workflows are scalable, reliable, and meet the business's requirements.\n\nResponsibilities\nLead the design, development, and maintenance of data pipelines and ETL processes architect and implement scalable data solutions using Databricks and AWS.\nOptimize data storage and retrieval systems using Rockset, Clickhouse, and CrateDB.\nDevelop and maintain data APIs using FastAPI.\nOrchestrate and automate data workflows using Airflow.\nCollaborate with data scientists and analysts to support their data needs.\nEnsure data quality, security, and compliance across all data systems.\nMentor junior data engineers and promote best practices in data engineering.\nEvaluate and implement new data technologies to improve the data infrastructure.\nParticipate in cross-functional projects and provide technical leadership.\nManage and optimize data storage solutions using AWS S3, implementing best practices for data lakes and data warehouses.\nImplement and manage Databricks Unity Catalog for centralized data governance and access control across the organization.\n\nQualifications\nBachelor's or Master's degree in Computer Science, Engineering, or related field\n5+ years of experience in data engineering, with at least 2 years in a leading project\nStrong proficiency in Python, PySpark, and SQL\nExtensive experience with Databricks and AWS cloud services\nHands-on experience with Airflow for workflow orchestration\nFamiliarity with FastAPI for building high-performance APIs\nExperience with columnar databases like Rockset, Clickhouse, and CrateDB\nSolid understanding of data modeling, data warehousing, and ETL processes\nExperience with version control systems (e.g., Git) and CI/CD pipelines\nExcellent problem-solving skills and ability to work in a fast-paced environment\nStrong communication skills and ability to work effectively in cross-functional teams\nKnowledge of data governance, security, and compliance best practices\nProficiency in designing and implementing data lake architectures using AWS S3\nExperience with Databricks Unity Catalog or similar data governance and metadata management tools\n\nNice To Have\nExperience with real-time data processing and streaming technologies\nFamiliarity with machine learning workflows and MLOps\nCertifications in Databricks, AWS\nExperience implementing data mesh or data fabric architectures\nKnowledge of data lineage and metadata management best practices\n\nTech Stack\nDatabricks, Python, PySpark, SQL, Airflow, FastAPI, AWS (S3, IAM, ECR, Lambda), Rockset, CLickhouse, CrateDB\n\nYou Would Enjoy\nOpportunity to work on business challenges from top global clientele with high impact\nVast opportunities for self-development, including online university access and sponsored certifications.\nSponsored Tech Talks, industry events & seminars to foster innovation and learning.\nGenerous benefits package including health insurance, retirement benefits, flexible work hours, and more.\nSupportive work environment with forums to explore passions beyond work.","description_format":"text","description_chars":4046,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Health insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Machine Learning","IT Consulting & Digital Transformation"],"lifecycle":[{"event":"open","at":"2026-10-13T14:09:00Z"}],"visa":[],"liveness":{"score":77,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":0.9,"age_days":13,"expected_fill_days":24,"reasons":["seen:13","velocity","win:mid"],"computed_at":"2026-10-27T05:46:45Z"},"pay":null,"html_url":"https://alion.io/job/fission-labs-lead-senior-data-engineer","json_url":"https://alion.io/job/fission-labs-lead-senior-data-engineer.json","meta":{"generated_at":"2026-10-27T19:08:16Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9630,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-28T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3809034},"rest":"https://alion.io/mcp/rest/get_company?id=3809034"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffission-labs-lead-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffission-labs-lead-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffission-labs-lead-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/fission-labs-lead-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffission-labs-lead-senior-data-engineer"}]}